-- Logs begin at Fri 2022-10-28 20:10:35 UTC, end at Fri 2022-10-28 21:13:54 UTC. -- Oct 28 20:36:56.712795 dv-cinder-859839-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Oct 28 20:36:56.721042 dv-cinder-859839-2-iscsi devstack@keystone.service[91639]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 28 20:36:56.723305 dv-cinder-859839-2-iscsi devstack@keystone.service[91639]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 28 20:36:56 2022] *** Oct 28 20:36:56.723305 dv-cinder-859839-2-iscsi devstack@keystone.service[91639]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 28 20:36:56.723305 dv-cinder-859839-2-iscsi devstack@keystone.service[91639]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 28 20:36:56.723305 dv-cinder-859839-2-iscsi devstack@keystone.service[91639]: nodename: dv-cinder-859839-2-iscsi Oct 28 20:36:56.723305 dv-cinder-859839-2-iscsi devstack@keystone.service[91639]: machine: x86_64 Oct 28 20:36:56.723305 dv-cinder-859839-2-iscsi devstack@keystone.service[91639]: clock source: unix Oct 28 20:36:56.723305 dv-cinder-859839-2-iscsi devstack@keystone.service[91639]: pcre jit disabled Oct 28 20:36:56.723305 dv-cinder-859839-2-iscsi devstack@keystone.service[91639]: detected number of CPU cores: 4 Oct 28 20:36:56.724157 dv-cinder-859839-2-iscsi devstack@keystone.service[91639]: current working directory: / Oct 28 20:36:56.724157 dv-cinder-859839-2-iscsi devstack@keystone.service[91639]: detected binary path: /usr/bin/uwsgi-core Oct 28 20:36:56.724157 dv-cinder-859839-2-iscsi devstack@keystone.service[91639]: your processes number limit is 47680 Oct 28 20:36:56.724157 dv-cinder-859839-2-iscsi devstack@keystone.service[91639]: your memory page size is 4096 bytes Oct 28 20:36:56.724157 dv-cinder-859839-2-iscsi devstack@keystone.service[91639]: detected max file descriptor number: 2048 Oct 28 20:36:56.724157 dv-cinder-859839-2-iscsi devstack@keystone.service[91639]: lock engine: pthread robust mutexes Oct 28 20:36:56.724157 dv-cinder-859839-2-iscsi devstack@keystone.service[91639]: thunder lock: enabled Oct 28 20:36:56.724157 dv-cinder-859839-2-iscsi devstack@keystone.service[91639]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 28 20:36:56.725064 dv-cinder-859839-2-iscsi devstack@keystone.service[91639]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 28 20:36:56.770800 dv-cinder-859839-2-iscsi devstack@keystone.service[91639]: Python main interpreter initialized at 0x5646cfd4b9c0 Oct 28 20:36:56.770800 dv-cinder-859839-2-iscsi devstack@keystone.service[91639]: python threads support enabled Oct 28 20:36:56.770800 dv-cinder-859839-2-iscsi devstack@keystone.service[91639]: your server socket listen backlog is limited to 100 connections Oct 28 20:36:56.770800 dv-cinder-859839-2-iscsi devstack@keystone.service[91639]: your mercy for graceful operations on workers is 90 seconds Oct 28 20:36:56.771316 dv-cinder-859839-2-iscsi devstack@keystone.service[91639]: mapped 403077 bytes (393 KB) for 2 cores Oct 28 20:36:56.771316 dv-cinder-859839-2-iscsi devstack@keystone.service[91639]: *** Operational MODE: preforking *** Oct 28 20:36:56.771548 dv-cinder-859839-2-iscsi devstack@keystone.service[91639]: *** uWSGI is running in multiple interpreter mode *** Oct 28 20:36:56.771548 dv-cinder-859839-2-iscsi devstack@keystone.service[91639]: spawned uWSGI master process (pid: 91639) Oct 28 20:36:56.771820 dv-cinder-859839-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Oct 28 20:36:56.774425 dv-cinder-859839-2-iscsi devstack@keystone.service[91639]: spawned uWSGI worker 1 (pid: 91651, cores: 1) Oct 28 20:36:56.774425 dv-cinder-859839-2-iscsi devstack@keystone.service[91639]: spawned uWSGI worker 2 (pid: 91652, cores: 1) Oct 28 20:36:56.774425 dv-cinder-859839-2-iscsi devstack@keystone.service[91639]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 28 20:37:02.853457 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 20:37:02.853457 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: from cryptography.utils import int_from_bytes Oct 28 20:37:02.854245 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 20:37:02.854245 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: from cryptography.utils import int_from_bytes Oct 28 20:37:02.854499 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 20:37:02.854499 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: from cryptography.utils import int_from_bytes Oct 28 20:37:02.854923 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 20:37:02.854923 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: from cryptography.utils import int_from_bytes Oct 28 20:37:02.900712 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 20:37:02.900912 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 20:37:02.901119 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] command line args: [] {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 20:37:02.901331 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 20:37:02.901504 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ================================================================================ {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 20:37:02.901587 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 20:37:02.901733 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 20:37:02.901819 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] admin_token = **** {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.901887 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] command line args: [] {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 20:37:02.902048 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] config_dir = [] {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.902127 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 20:37:02.902196 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.902376 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] config_source = [] {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.902500 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ================================================================================ {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 20:37:02.902616 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] debug = True {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.902710 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] admin_token = **** {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.902813 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.905526 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] config_dir = [] {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.905526 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.905732 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.905841 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] config_source = [] {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.905927 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.905995 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] debug = True {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.906099 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.906172 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.906378 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.906455 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.906455 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.906598 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] list_limit = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.906598 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] log_config_append = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.906712 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.906770 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.906826 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.906889 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] log_dir = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.906889 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] log_file = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.906990 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] list_limit = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.906990 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] log_config_append = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.907620 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.907848 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.908052 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.908221 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] log_dir = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.908446 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.908655 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] log_file = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.908825 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.909033 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.909259 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.909463 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.909625 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.909815 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.910009 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.910207 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.910434 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.910599 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.910788 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.910982 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.911174 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.911372 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.911601 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.911793 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.911989 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.912159 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.912322 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.912768 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.912905 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.913063 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.913785 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.913975 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.913975 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.914376 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.914610 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.914780 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] publish_errors = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.914907 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.915044 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.915044 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.915320 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.915451 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.915585 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] publish_errors = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.915716 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.915888 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.916022 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.916147 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.916292 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] standard_threads = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.916479 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.916622 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.916755 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.916881 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.917010 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.917191 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.917191 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] use_journal = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.917441 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] standard_threads = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.917567 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] use_json = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.917691 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.917897 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] use_stderr = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.917897 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] use_syslog = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.918150 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.918150 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.918408 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.918535 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] use_journal = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.918658 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.918791 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] use_json = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.918791 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] use_stderr = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.919033 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.919170 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] use_syslog = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.919300 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.919430 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 20:37:02.919563 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.919688 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.919921 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.920065 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.920202 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.920326 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.920461 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.920461 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.920728 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.920897 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.921036 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.921167 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.921301 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.921427 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.921551 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.921681 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.921812 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.921943 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.922086 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.922212 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.922336 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.922459 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.922582 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.922788 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.922926 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.923052 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.923176 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.923300 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.923423 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.923557 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.923684 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.923890 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.924048 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.924225 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.924354 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.924486 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.924628 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.924755 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.924878 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.925001 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.925133 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.925308 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.925439 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.925569 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.925712 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.925839 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.925968 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.926105 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.926105 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.926340 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.926469 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.926599 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.926599 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.926869 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.926869 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.927146 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.927146 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.927449 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.927585 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.927718 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.927951 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.928117 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.928252 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.928388 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.928519 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.928652 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.928783 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.928925 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.929120 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.929327 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.929539 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.929764 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.929893 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.930026 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.930152 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.930277 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.930401 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.930533 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.930659 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.930783 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.930913 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.931040 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.931173 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.931299 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.931423 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.932887 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.933064 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.933260 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.933494 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.933657 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.933852 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.934044 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.934044 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.934452 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.934452 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.934825 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.934825 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.935181 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.935366 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.935640 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.935875 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.936039 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.936228 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.936424 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.936623 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.936821 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.937051 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.937214 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.937457 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.937617 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.937806 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.937966 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.938147 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.938295 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.938424 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.938593 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.938724 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.938857 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.938984 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.939109 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.939273 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.939406 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.939531 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.939656 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.939836 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.939978 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.940115 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.940241 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.940366 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.940507 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.940677 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.940807 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.940941 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.941066 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.941191 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.941316 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.941441 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.941566 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.941699 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.941839 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.941965 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.942089 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.942089 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.942324 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.942457 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.942585 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.942710 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.942835 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.942959 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.943084 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.943217 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.943409 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.943550 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.943676 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.943823 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.943959 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.944095 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.944221 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.944221 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.944483 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.944483 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.944839 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.945066 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.945267 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.945402 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.945529 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.945673 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.945802 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.946004 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.946133 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.946259 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.946385 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.946511 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.946647 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.946647 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.946913 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.947041 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.947166 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.947291 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.947456 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.947604 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.947854 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.947992 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.948125 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.948254 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.948406 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.948663 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.948824 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.948958 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.949089 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.949216 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.949341 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.949466 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.949610 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.949737 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.949863 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.949988 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.950206 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.950346 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.950730 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.950876 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] auth.external = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.951005 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.951131 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.951256 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.951390 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.951527 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.951655 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.951811 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.951944 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] auth.password = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.952107 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.952269 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] auth.token = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.952406 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] auth.external = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.952534 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.952668 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.952795 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.952920 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.953050 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.953175 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.953319 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.953456 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] auth.password = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.953594 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.953722 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] auth.token = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.953848 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.953974 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.954101 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.954235 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.954363 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] credential.caching = True {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.954489 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.954615 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.954747 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.954874 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.955008 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.955137 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.955263 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.955400 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.955527 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.955661 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.955819 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] credential.caching = True {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.955953 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.956078 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.956211 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.956336 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.956471 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.956599 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.956724 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.956850 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.956983 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.957120 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.957255 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.957388 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.957560 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.957695 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.957827 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.957953 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.958098 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.958225 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.958358 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.958488 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.958614 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] federation.caching = True {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.958740 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.958874 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.959011 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.959136 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.959261 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.959388 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.959388 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.959634 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.959882 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.960581 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.960777 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.960947 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] federation.caching = True {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.961141 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.961364 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.961364 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.961708 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.961849 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.961977 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.962113 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.962251 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.962379 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.962508 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.962634 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.962760 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] identity.caching = True {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.962887 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.963097 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.963236 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.963365 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.963491 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.963634 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.963781 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.964072 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.964214 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.964342 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.964468 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] identity.caching = True {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.964595 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.964721 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.964856 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.964982 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.965109 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.965234 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.965360 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.965495 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.965631 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.965759 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.965885 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.966010 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.966136 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.966268 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.966404 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.966531 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.966664 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.966791 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.966917 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.967042 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.967176 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.967314 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.967441 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.967567 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.967781 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.967927 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.968057 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.968188 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.968406 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.968554 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.968684 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.968819 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.968948 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.969074 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.969210 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.969336 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.969462 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.969596 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.969723 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.969850 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.969976 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.970101 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.970226 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.970360 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.970487 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.970612 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.970738 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.970864 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.970999 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.971133 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.971268 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.971395 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.971522 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.971648 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.971824 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.971969 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.972098 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.972224 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.972350 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.972350 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.972587 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.972725 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.972863 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.972991 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.973116 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.973242 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.973368 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.973501 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.973601 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.973909 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.973995 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.974069 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.974131 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.974284 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.974366 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.974440 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.974512 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.974584 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.974719 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.974811 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.974886 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.974886 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.975034 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.975034 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.975369 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.975369 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.975491 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.975577 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.975713 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.976338 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.976441 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.user = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.976574 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.976689 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.976803 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.976920 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.977005 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.977078 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.977146 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.977208 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.977272 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.977331 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.977394 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.user = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.977455 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.977520 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.977591 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.977650 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.977770 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.977849 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.977918 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.978080 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.978159 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.978289 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.978370 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.978464 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.978581 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.978664 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.978733 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.978833 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.978833 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.979124 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.979194 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.979270 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.979333 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.979392 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.979451 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.979509 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.979576 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.979638 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.979696 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.979838 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.979905 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.979965 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.980038 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.980102 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.980161 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.980220 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.980279 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.980279 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.980390 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.980451 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.980451 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.980554 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.980613 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.980672 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.980737 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.980798 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.980856 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.980914 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.980971 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.981030 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.981096 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.981157 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.981228 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.981374 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.981437 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.981496 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.981563 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.981625 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.981690 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.981751 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.981809 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.981867 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.981933 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.981999 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.982058 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.982116 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.982116 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] resource.caching = True {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.982218 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.982218 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.982331 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.982389 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.982448 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.982505 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] resource.caching = True {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.982563 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.982563 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.982676 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.982734 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.982791 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.982849 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.982906 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.983041 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.983104 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.983163 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.983221 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.983297 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.983356 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.983422 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] role.caching = True {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.983482 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.983541 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] role.driver = sql {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.983599 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.983657 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.983714 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.983805 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.983869 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] role.caching = True {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.983928 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.983986 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] role.driver = sql {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.984044 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.984108 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.984177 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.984238 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.984297 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.984355 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.984414 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.984472 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.984539 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.984599 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.984658 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.984716 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.984775 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.984833 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.984899 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.984959 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.985018 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.985076 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.985135 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.985193 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.985270 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.985332 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.985332 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.985436 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.985436 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.985546 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.985607 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.985666 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.985724 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.985782 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.985840 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.985911 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.985972 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.986030 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.986093 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.986151 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.986209 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.986274 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.986335 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.986393 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.986451 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.986508 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.986566 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.986632 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.986692 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.986750 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.986807 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.986865 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.986922 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.986987 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.987055 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.987114 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.987187 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.987245 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.987302 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.987368 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.987428 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.987486 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.987543 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.987601 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.987658 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] token.caching = True {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.987723 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.987847 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.987908 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.987967 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.988026 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.988084 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.988155 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] token.caching = True {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.988217 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.988277 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.988336 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.988336 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.988439 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.988522 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.988584 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.988643 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.988700 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.988758 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.988816 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.988881 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.988941 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.989000 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.989057 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.989114 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.989183 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.989249 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.989309 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.989367 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.989424 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.989481 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.989546 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.989607 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.989664 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.989664 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.989766 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.989824 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.989889 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] database.connection = **** {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.989958 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.990033 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.990094 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.990152 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.990152 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.990254 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.990312 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.990377 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] database.connection = **** {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.990444 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.990511 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.990572 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.990629 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.990688 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.990745 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.990811 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.990871 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.990929 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.990995 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.991065 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.991141 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.991234 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.991298 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.991357 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.991357 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.991465 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.991575 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.991692 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.991853 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.991965 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.992078 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.992189 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.992296 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.992401 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.992466 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.992525 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.992583 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 20:37:02.992641 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.992641 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.992641 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.992641 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.992641 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 20:37:02.992641 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 20:37:03.020141 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.020442 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.020708 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.020940 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.021177 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.021409 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.029816 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.030612 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.060561 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.060821 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.060951 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.061069 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.120097 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.120545 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.175595 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.175595 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.176090 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.176440 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.246796 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.247052 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.247357 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.247498 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.247627 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.247800 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.247924 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.248041 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.248155 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.248155 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.248390 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.248504 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.274608 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.274815 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.275036 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.275133 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.275289 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.275385 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.275528 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.275646 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.275729 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.276047 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.276150 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.276223 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.276295 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.276487 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.289298 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.289784 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.302924 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.303177 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.303321 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.303476 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.303604 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.303818 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.304420 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.304539 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.304669 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.304791 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.304791 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.304997 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.305108 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91652) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.305236 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91651) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 20:37:03.322925 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.323344 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 28 20:37:03.323559 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.323808 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.324043 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 28 20:37:03.324252 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 28 20:37:03.324469 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.324681 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.324878 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 28 20:37:03.325080 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.325295 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.325497 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.325707 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.325922 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.326127 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.326127 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.335443 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.335960 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.336133 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.336226 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.336310 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.336400 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.336483 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.336680 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.344877 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91652) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 20:37:03.345274 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91651) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 20:37:03.348176 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91652) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 20:37:03.348440 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.348640 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91651) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 20:37:03.348839 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.349036 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.349245 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.349451 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.349655 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.349875 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.350074 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.350263 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.350464 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.351180 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.351371 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.351589 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.351884 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.352121 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.352353 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.352555 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.352770 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.352957 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.352957 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.378340 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.379010 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.379870 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91652) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 20:37:03.380153 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.380673 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91651) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 20:37:03.380933 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.385607 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91652) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 20:37:03.385946 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.386192 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.386616 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91651) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 20:37:03.386905 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.387189 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.393294 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91652) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 20:37:03.393573 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.395782 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91651) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 20:37:03.396072 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.398147 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91652) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 20:37:03.398403 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.398680 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.398950 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.399212 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.399472 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.399728 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.400009 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.400583 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91651) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 20:37:03.400866 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.401147 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.401421 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.401689 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.401953 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.402216 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.402477 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.419356 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.419642 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.422007 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.422295 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.424190 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91652) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 20:37:03.426848 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91651) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 20:37:03.427858 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.428146 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.431179 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.431470 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.433737 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91652) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 20:37:03.436469 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91651) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 20:37:03.437276 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91652) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 20:37:03.440045 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91651) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 20:37:03.440861 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.441153 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.441443 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.441732 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.442003 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.442274 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.443627 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.443949 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.444231 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.444544 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.444829 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.445106 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.461304 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91652) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 20:37:03.461612 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.461837 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.462089 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.464195 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91651) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 20:37:03.464498 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.464765 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.465033 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.470158 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.472026 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.472294 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.472976 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.474853 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.475126 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.475271 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91652) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 20:37:03.475542 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.476371 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.476696 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.476968 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.478686 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91651) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 20:37:03.478976 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.479268 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.479549 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.479844 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.492388 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91652) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 20:37:03.492740 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.492993 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.493270 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.493544 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.493828 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.494102 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.495224 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91651) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 20:37:03.495517 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.495822 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.496107 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.496389 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.496679 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.496954 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.512397 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91652) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 20:37:03.515300 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91651) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 20:37:03.515587 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91652) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 20:37:03.518673 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91651) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 20:37:03.623080 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.624699 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.625507 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.626273 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91652) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 20:37:03.626546 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.626829 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.627113 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.628803 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91651) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 20:37:03.629029 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.629322 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.634958 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.636571 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91652) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 20:37:03.637241 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.638844 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91651) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 20:37:03.639887 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.640171 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.640441 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.640714 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.642267 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.642559 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.642842 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.643114 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.649794 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91652) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 20:37:03.650082 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.650358 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.652272 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91651) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 20:37:03.652582 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.652858 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.658274 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91652) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 20:37:03.658601 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.658829 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.659070 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.659294 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.659549 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.659837 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.660111 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.660383 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.660640 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.660932 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91651) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 20:37:03.661167 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.661450 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.661671 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.661671 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.662066 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.662285 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91652) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.662816 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.662816 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.662816 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.662816 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.664569 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.664569 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.664569 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.664569 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.664569 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.664569 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.665702 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91651) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 20:37:03.700784 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5646cfd4b9c0 pid: 91652 (default app) Oct 28 20:37:03.703909 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5646cfd4b9c0 pid: 91651 (default app) Oct 28 20:37:03.704372 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95caa06-55b3-45cf-b6c5-c433450a93e1 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:03.704662 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95caa06-55b3-45cf-b6c5-c433450a93e1 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:03.704934 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95caa06-55b3-45cf-b6c5-c433450a93e1 None None] PATH_INFO: `/v3` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:03.709345 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 791 bytes} [Fri Oct 28 20:37:03 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:12.264324 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02028791-2d01-45d9-b873-786bb956de3e None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:12.265070 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02028791-2d01-45d9-b873-786bb956de3e None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:12.265232 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02028791-2d01-45d9-b873-786bb956de3e None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:12.270438 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1/2] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:37:12 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:37:12.277052 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffee22-0a48-4280-9abe-784e3d5dd479 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:12.277566 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffee22-0a48-4280-9abe-784e3d5dd479 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:12.277683 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ffee22-0a48-4280-9abe-784e3d5dd479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:12.310558 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG oslo_db.sqlalchemy.engines [None req-61ffee22-0a48-4280-9abe-784e3d5dd479 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91652) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 20:37:12.509042 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG passlib.handlers.bcrypt [None req-61ffee22-0a48-4280-9abe-784e3d5dd479 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=91652) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 28 20:37:12.509385 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG passlib.handlers.bcrypt [None req-61ffee22-0a48-4280-9abe-784e3d5dd479 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91652) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 28 20:37:12.568082 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-61ffee22-0a48-4280-9abe-784e3d5dd479 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:37:12.570865 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-61ffee22-0a48-4280-9abe-784e3d5dd479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:37:12.713712 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 2/3] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:37:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 28 20:37:12.747800 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02028791-2d01-45d9-b873-786bb956de3e None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:12.783853 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG oslo_db.sqlalchemy.engines [None req-02028791-2d01-45d9-b873-786bb956de3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91651) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 20:37:12.919040 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02028791-2d01-45d9-b873-786bb956de3e None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:12.923677 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c225d6-9e2b-4d8e-a591-222fb293cf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:12.924384 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c225d6-9e2b-4d8e-a591-222fb293cf2d admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:12.924668 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c225d6-9e2b-4d8e-a591-222fb293cf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:12.925045 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c225d6-9e2b-4d8e-a591-222fb293cf2d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:12.934214 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c225d6-9e2b-4d8e-a591-222fb293cf2d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:12.985533 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.common.rbac_enforcer.enforcer [None req-14c225d6-9e2b-4d8e-a591-222fb293cf2d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 28 20:37:12.985874 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c225d6-9e2b-4d8e-a591-222fb293cf2d admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:12.997075 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1324 bytes} [Fri Oct 28 20:37:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 20:37:13.003472 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ffee22-0a48-4280-9abe-784e3d5dd479 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:13.019028 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ffee22-0a48-4280-9abe-784e3d5dd479 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:13.024299 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c3209-60f4-480d-b4de-13d8fe65f4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:13.025430 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c3209-60f4-480d-b4de-13d8fe65f4ff admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:13.025708 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c3209-60f4-480d-b4de-13d8fe65f4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:13.026094 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c3209-60f4-480d-b4de-13d8fe65f4ff admin admin] PATH_INFO: `/v3/projects/3ac39942cf3a45f18781d7210d0aa25e` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:13.027626 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c3209-60f4-480d-b4de-13d8fe65f4ff admin admin] RBAC: Authorizing `identity:get_project(project_id=3ac39942cf3a45f18781d7210d0aa25e)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:13.081975 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.common.rbac_enforcer.enforcer [None req-522c3209-60f4-480d-b4de-13d8fe65f4ff admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 28 20:37:13.082233 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c3209-60f4-480d-b4de-13d8fe65f4ff admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:13.088224 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 3/5] 10.222.0.49 () {56 vars in 1207 bytes} [Fri Oct 28 20:37:13 2022] GET /identity/v3/projects/3ac39942cf3a45f18781d7210d0aa25e => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:37:16.296584 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abae2b-a1b0-420e-9286-47e194b7d6c1 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:16.297132 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abae2b-a1b0-420e-9286-47e194b7d6c1 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:16.297556 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abae2b-a1b0-420e-9286-47e194b7d6c1 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:16.307453 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 3/6] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:37:16 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:37:16.315291 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cebbf-bc38-4f7e-a046-bf69b8d71c2d None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:16.316067 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cebbf-bc38-4f7e-a046-bf69b8d71c2d None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:16.316067 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cebbf-bc38-4f7e-a046-bf69b8d71c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:16.339093 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-768cebbf-bc38-4f7e-a046-bf69b8d71c2d None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:37:16.340825 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-768cebbf-bc38-4f7e-a046-bf69b8d71c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:37:16.349243 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 4/7] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:37:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 28 20:37:16.374792 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abae2b-a1b0-420e-9286-47e194b7d6c1 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:16.396231 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abae2b-a1b0-420e-9286-47e194b7d6c1 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:16.403950 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4019c6-c348-401f-81aa-d53722b087b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:16.405036 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4019c6-c348-401f-81aa-d53722b087b2 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:16.405540 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4019c6-c348-401f-81aa-d53722b087b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:16.406033 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4019c6-c348-401f-81aa-d53722b087b2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:16.421589 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4019c6-c348-401f-81aa-d53722b087b2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:16.423614 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4019c6-c348-401f-81aa-d53722b087b2 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:16.434219 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 4/8] 10.222.0.49 () {58 vars in 1324 bytes} [Fri Oct 28 20:37:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 20:37:16.440633 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cebbf-bc38-4f7e-a046-bf69b8d71c2d None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:16.451446 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cebbf-bc38-4f7e-a046-bf69b8d71c2d None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:16.456490 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2ad72-abaa-4873-99e0-9e5a451192b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:16.457483 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2ad72-abaa-4873-99e0-9e5a451192b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:16.457823 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2ad72-abaa-4873-99e0-9e5a451192b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:16.458160 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2ad72-abaa-4873-99e0-9e5a451192b5 admin admin] PATH_INFO: `/v3/users/57b0953dcb104303876815cf22027f50` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:16.461213 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2ad72-abaa-4873-99e0-9e5a451192b5 admin admin] RBAC: Authorizing `identity:get_user(user_id=57b0953dcb104303876815cf22027f50)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:16.463453 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2ad72-abaa-4873-99e0-9e5a451192b5 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:16.465376 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 5/9] 10.222.0.49 () {56 vars in 1198 bytes} [Fri Oct 28 20:37:16 2022] GET /identity/v3/users/57b0953dcb104303876815cf22027f50 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:19.013984 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7cc25-dab2-4cee-a3c7-d7375f4a9a80 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:19.014530 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7cc25-dab2-4cee-a3c7-d7375f4a9a80 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:19.014530 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7cc25-dab2-4cee-a3c7-d7375f4a9a80 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:19.016325 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 5/10] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:37:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:37:19.022781 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970c1a6-69ce-43d0-ab23-544c3e747297 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:19.023264 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970c1a6-69ce-43d0-ab23-544c3e747297 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:19.023696 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970c1a6-69ce-43d0-ab23-544c3e747297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:19.042747 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-e970c1a6-69ce-43d0-ab23-544c3e747297 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:37:19.044050 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-e970c1a6-69ce-43d0-ab23-544c3e747297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:37:19.142972 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 6/11] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:37:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:37:19.185338 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7cc25-dab2-4cee-a3c7-d7375f4a9a80 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:19.394272 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7cc25-dab2-4cee-a3c7-d7375f4a9a80 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:19.433252 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258d722-5674-465c-b2c0-e2a81eade2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:19.434068 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258d722-5674-465c-b2c0-e2a81eade2d8 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:19.434350 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258d722-5674-465c-b2c0-e2a81eade2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:19.434625 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258d722-5674-465c-b2c0-e2a81eade2d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:19.448271 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258d722-5674-465c-b2c0-e2a81eade2d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:37:19.455445 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-f258d722-5674-465c-b2c0-e2a81eade2d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 20:37:19.457035 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 6/12] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 20:37:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:37:19.464083 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970c1a6-69ce-43d0-ab23-544c3e747297 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:19.533337 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b96cf6-27c3-45e6-8d8a-75ac68eb4839 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:19.533635 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b96cf6-27c3-45e6-8d8a-75ac68eb4839 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:19.533977 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b96cf6-27c3-45e6-8d8a-75ac68eb4839 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:19.535929 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 7/13] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:37:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:37:19.544020 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875640c5-7690-4b20-aff4-96fc58388807 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:19.544584 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875640c5-7690-4b20-aff4-96fc58388807 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:19.545038 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875640c5-7690-4b20-aff4-96fc58388807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:19.567281 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG passlib.handlers.bcrypt [None req-875640c5-7690-4b20-aff4-96fc58388807 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=91651) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 28 20:37:19.568418 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG passlib.handlers.bcrypt [None req-875640c5-7690-4b20-aff4-96fc58388807 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91651) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 28 20:37:19.593819 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970c1a6-69ce-43d0-ab23-544c3e747297 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:19.619177 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-875640c5-7690-4b20-aff4-96fc58388807 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:37:19.621221 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-875640c5-7690-4b20-aff4-96fc58388807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:37:19.636742 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac89b72-28ac-4fd4-9f6b-601af388db95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:19.637437 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac89b72-28ac-4fd4-9f6b-601af388db95 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:19.637726 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac89b72-28ac-4fd4-9f6b-601af388db95 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:19.638001 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac89b72-28ac-4fd4-9f6b-601af388db95 None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:19.638791 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac89b72-28ac-4fd4-9f6b-601af388db95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:37:19.639098 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac89b72-28ac-4fd4-9f6b-601af388db95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:19.640583 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac89b72-28ac-4fd4-9f6b-601af388db95 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:19.655525 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 7/14] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:37:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:19.661093 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac89b72-28ac-4fd4-9f6b-601af388db95 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:19.729424 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 8/15] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:37:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 20:37:19.753368 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875640c5-7690-4b20-aff4-96fc58388807 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:19.819157 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac89b72-28ac-4fd4-9f6b-601af388db95 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:19.871650 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875640c5-7690-4b20-aff4-96fc58388807 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:19.878842 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb57ce4-f77f-48c5-9d89-f174c842fbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:19.878842 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb57ce4-f77f-48c5-9d89-f174c842fbe6 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:19.879266 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb57ce4-f77f-48c5-9d89-f174c842fbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:19.879706 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb57ce4-f77f-48c5-9d89-f174c842fbe6 None admin] PATH_INFO: `/v3/users/57b0953dcb104303876815cf22027f50` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:19.883093 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb57ce4-f77f-48c5-9d89-f174c842fbe6 None admin] RBAC: Authorizing `identity:get_user(user_id=57b0953dcb104303876815cf22027f50)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:19.885793 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb57ce4-f77f-48c5-9d89-f174c842fbe6 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:19.889430 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 8/16] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:37:19 2022] GET /identity/v3/users/57b0953dcb104303876815cf22027f50 => generated 247 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:37:19.895042 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb57ce4-f77f-48c5-9d89-f174c842fbe6 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:19.926008 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c13c99-4820-4d58-93cc-db203cf7c812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:19.927368 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c13c99-4820-4d58-93cc-db203cf7c812 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:19.927859 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c13c99-4820-4d58-93cc-db203cf7c812 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:19.928322 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c13c99-4820-4d58-93cc-db203cf7c812 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:20.014364 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c13c99-4820-4d58-93cc-db203cf7c812 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:20.016058 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c13c99-4820-4d58-93cc-db203cf7c812 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:20.031037 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb57ce4-f77f-48c5-9d89-f174c842fbe6 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:20.071685 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f8f30-e452-4d02-b513-e759e0550671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:20.072548 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f8f30-e452-4d02-b513-e759e0550671 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:20.072832 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f8f30-e452-4d02-b513-e759e0550671 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:20.073114 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f8f30-e452-4d02-b513-e759e0550671 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:20.074425 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f8f30-e452-4d02-b513-e759e0550671 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:20.075981 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f8f30-e452-4d02-b513-e759e0550671 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:20.077831 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 9/17] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:37:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:20.084081 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f8f30-e452-4d02-b513-e759e0550671 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:20.131137 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 9/18] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:37:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 20:37:20.137405 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c13c99-4820-4d58-93cc-db203cf7c812 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:20.213219 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f8f30-e452-4d02-b513-e759e0550671 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:20.255575 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87e1e8-1a56-4421-9797-30eb59205f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:20.256186 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c13c99-4820-4d58-93cc-db203cf7c812 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:20.257034 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87e1e8-1a56-4421-9797-30eb59205f04 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:20.257309 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87e1e8-1a56-4421-9797-30eb59205f04 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:20.257534 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87e1e8-1a56-4421-9797-30eb59205f04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:20.258430 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87e1e8-1a56-4421-9797-30eb59205f04 None admin] RBAC: Adding query filter params (role.id=8fe105eeb7bf4856a94b0633bd781414, scope.domain.id=default, user.id=57b0953dcb104303876815cf22027f50) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:37:20.258753 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87e1e8-1a56-4421-9797-30eb59205f04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:20.260276 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87e1e8-1a56-4421-9797-30eb59205f04 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:20.269389 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 10/19] 10.222.0.49 () {56 vars in 1322 bytes} [Fri Oct 28 20:37:20 2022] GET /identity/v3/role_assignments?user.id=57b0953dcb104303876815cf22027f50&scope.domain.id=default&role.id=8fe105eeb7bf4856a94b0633bd781414 => generated 233 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:37:20.312648 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7385d-6bbc-4fea-b325-5f2364b447e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:20.313866 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7385d-6bbc-4fea-b325-5f2364b447e1 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:20.314297 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7385d-6bbc-4fea-b325-5f2364b447e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:20.314718 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7385d-6bbc-4fea-b325-5f2364b447e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:20.348751 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d7385d-6bbc-4fea-b325-5f2364b447e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:20.351998 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d7385d-6bbc-4fea-b325-5f2364b447e1 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:20.380098 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-f8d7385d-6bbc-4fea-b325-5f2364b447e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:37:20.382129 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 10/20] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:37:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:37:20.388827 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87e1e8-1a56-4421-9797-30eb59205f04 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:20.552192 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87e1e8-1a56-4421-9797-30eb59205f04 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:20.591469 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d487350-9a0e-427b-bfeb-55bbd436bf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:20.592163 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d487350-9a0e-427b-bfeb-55bbd436bf5b None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:20.592447 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d487350-9a0e-427b-bfeb-55bbd436bf5b None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:20.592717 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d487350-9a0e-427b-bfeb-55bbd436bf5b None admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:20.593457 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d487350-9a0e-427b-bfeb-55bbd436bf5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:37:20.593758 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d487350-9a0e-427b-bfeb-55bbd436bf5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:20.595189 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d487350-9a0e-427b-bfeb-55bbd436bf5b None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:20.614532 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 11/21] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:23.635958 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec35e1-0814-4a56-b159-60f0e1a2e45b None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:23.636448 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec35e1-0814-4a56-b159-60f0e1a2e45b None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:23.636448 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec35e1-0814-4a56-b159-60f0e1a2e45b None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:23.638992 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 11/22] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:37:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:37:23.647776 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53c3e9-20e5-4b8d-a9a6-498cc6a58157 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:23.648996 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53c3e9-20e5-4b8d-a9a6-498cc6a58157 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:23.649476 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53c3e9-20e5-4b8d-a9a6-498cc6a58157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:23.681073 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-3d53c3e9-20e5-4b8d-a9a6-498cc6a58157 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:37:23.683372 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-3d53c3e9-20e5-4b8d-a9a6-498cc6a58157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:37:23.778616 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 12/23] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:37:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:37:23.788530 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e715709-54bc-4c0c-8fe9-6b657fe73fca None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:23.789171 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e715709-54bc-4c0c-8fe9-6b657fe73fca None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:23.789637 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e715709-54bc-4c0c-8fe9-6b657fe73fca None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:23.791975 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 12/24] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:37:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:37:23.798100 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81706c90-58c0-42bd-af8a-b49cef8b88ef None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:23.798713 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81706c90-58c0-42bd-af8a-b49cef8b88ef None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:23.799184 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81706c90-58c0-42bd-af8a-b49cef8b88ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:23.816467 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e715709-54bc-4c0c-8fe9-6b657fe73fca None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:23.862543 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-81706c90-58c0-42bd-af8a-b49cef8b88ef None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:37:23.865071 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-81706c90-58c0-42bd-af8a-b49cef8b88ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:37:23.973708 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 13/25] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:37:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:37:24.025196 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffd6bc-5cff-4a59-b223-fb7fff1493d8 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:24.025494 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffd6bc-5cff-4a59-b223-fb7fff1493d8 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:24.025764 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffd6bc-5cff-4a59-b223-fb7fff1493d8 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:24.029319 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 14/26] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:37:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:37:24.033805 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd17ab-7dda-4bec-91fe-fe731a1c9084 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:24.034102 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd17ab-7dda-4bec-91fe-fe731a1c9084 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:24.034384 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd17ab-7dda-4bec-91fe-fe731a1c9084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:24.051752 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e715709-54bc-4c0c-8fe9-6b657fe73fca None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:24.056819 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-cdcd17ab-7dda-4bec-91fe-fe731a1c9084 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:37:24.058032 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-cdcd17ab-7dda-4bec-91fe-fe731a1c9084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:37:24.092040 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d84e6c-0a71-4237-b7fa-0146dc19d40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:24.093206 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d84e6c-0a71-4237-b7fa-0146dc19d40c None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:24.094590 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d84e6c-0a71-4237-b7fa-0146dc19d40c None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:24.095269 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d84e6c-0a71-4237-b7fa-0146dc19d40c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:24.118198 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d84e6c-0a71-4237-b7fa-0146dc19d40c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:37:24.127168 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-72d84e6c-0a71-4237-b7fa-0146dc19d40c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 20:37:24.133585 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 13/27] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 20:37:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:37:24.133585 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d84e6c-0a71-4237-b7fa-0146dc19d40c None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:24.184107 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 15/28] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:37:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:37:24.185442 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd17ab-7dda-4bec-91fe-fe731a1c9084 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:24.284328 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d84e6c-0a71-4237-b7fa-0146dc19d40c None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:24.322386 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd17ab-7dda-4bec-91fe-fe731a1c9084 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:24.329507 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8091f40-1f6b-404d-bec3-3f8c7de8d385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:24.330196 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8091f40-1f6b-404d-bec3-3f8c7de8d385 None admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:24.330477 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8091f40-1f6b-404d-bec3-3f8c7de8d385 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:24.330751 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8091f40-1f6b-404d-bec3-3f8c7de8d385 None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:24.331532 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8091f40-1f6b-404d-bec3-3f8c7de8d385 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:24.333892 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8091f40-1f6b-404d-bec3-3f8c7de8d385 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:24.369682 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc2cff-a193-4a6a-beaa-91b6893e4fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:24.370750 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc2cff-a193-4a6a-beaa-91b6893e4fe8 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:24.371271 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc2cff-a193-4a6a-beaa-91b6893e4fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:24.371780 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc2cff-a193-4a6a-beaa-91b6893e4fe8 None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:24.372781 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc2cff-a193-4a6a-beaa-91b6893e4fe8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:37:24.373311 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc2cff-a193-4a6a-beaa-91b6893e4fe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:24.374948 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc2cff-a193-4a6a-beaa-91b6893e4fe8 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:24.384682 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 16/29] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:37:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:24.386503 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ca590-f1e7-4838-a9db-3c71d3561c0e None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:24.387049 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ca590-f1e7-4838-a9db-3c71d3561c0e None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:24.387582 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ca590-f1e7-4838-a9db-3c71d3561c0e None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:24.389817 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 17/30] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:37:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:37:24.390813 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ca590-f1e7-4838-a9db-3c71d3561c0e None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:24.496214 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 14/31] 10.222.0.49 () {60 vars in 1131 bytes} [Fri Oct 28 20:37:24 2022] POST /identity/v3/roles => generated 219 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:37:24.497465 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8091f40-1f6b-404d-bec3-3f8c7de8d385 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:24.504765 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ca590-f1e7-4838-a9db-3c71d3561c0e None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:24.571336 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3d751-f946-4725-b260-5db75d5483eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:24.572507 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3d751-f946-4725-b260-5db75d5483eb None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:24.572990 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3d751-f946-4725-b260-5db75d5483eb None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:24.573462 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3d751-f946-4725-b260-5db75d5483eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:24.600014 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3d751-f946-4725-b260-5db75d5483eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:24.602673 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3d751-f946-4725-b260-5db75d5483eb None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:24.619915 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8091f40-1f6b-404d-bec3-3f8c7de8d385 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:24.635774 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-4fa3d751-f946-4725-b260-5db75d5483eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:37:24.637622 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 18/32] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:37:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:37:24.639374 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad289a-7b1d-4a19-b4b8-b18eb8d53aa5 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:24.639894 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad289a-7b1d-4a19-b4b8-b18eb8d53aa5 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:24.640365 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad289a-7b1d-4a19-b4b8-b18eb8d53aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:24.657712 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502ea2e-c5ab-4a49-bef5-0433186d64c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:24.658607 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502ea2e-c5ab-4a49-bef5-0433186d64c7 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:24.658890 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502ea2e-c5ab-4a49-bef5-0433186d64c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:24.659165 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502ea2e-c5ab-4a49-bef5-0433186d64c7 None admin] PATH_INFO: `/v3/users/57b0953dcb104303876815cf22027f50` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:24.660919 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f502ea2e-c5ab-4a49-bef5-0433186d64c7 None admin] RBAC: Authorizing `identity:get_user(user_id=57b0953dcb104303876815cf22027f50)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:24.663407 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f502ea2e-c5ab-4a49-bef5-0433186d64c7 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:24.669400 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 15/33] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:37:24 2022] GET /identity/v3/users/57b0953dcb104303876815cf22027f50 => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:24.669400 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502ea2e-c5ab-4a49-bef5-0433186d64c7 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:24.683288 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-30ad289a-7b1d-4a19-b4b8-b18eb8d53aa5 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:37:24.684575 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-30ad289a-7b1d-4a19-b4b8-b18eb8d53aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:37:24.765264 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 19/34] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:37:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:37:24.766162 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad289a-7b1d-4a19-b4b8-b18eb8d53aa5 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:24.812471 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502ea2e-c5ab-4a49-bef5-0433186d64c7 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:24.854261 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae979819-68dd-4fbc-88e2-41e996e6e77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:24.854848 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae979819-68dd-4fbc-88e2-41e996e6e77b None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:24.855113 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae979819-68dd-4fbc-88e2-41e996e6e77b None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:24.855386 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae979819-68dd-4fbc-88e2-41e996e6e77b None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:24.856149 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae979819-68dd-4fbc-88e2-41e996e6e77b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:37:24.856467 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae979819-68dd-4fbc-88e2-41e996e6e77b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:24.857876 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae979819-68dd-4fbc-88e2-41e996e6e77b None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:24.877405 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 16/35] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:24.879503 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd9d45-dcc8-4512-aa93-b4e560d1db6f None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:24.879503 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd9d45-dcc8-4512-aa93-b4e560d1db6f None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:24.879503 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd9d45-dcc8-4512-aa93-b4e560d1db6f None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:24.881337 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 17/36] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:37:24.882363 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd9d45-dcc8-4512-aa93-b4e560d1db6f None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:24.891078 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad289a-7b1d-4a19-b4b8-b18eb8d53aa5 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:24.933238 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0db49-51da-4045-8d77-6c2c70db16a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:24.934039 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0db49-51da-4045-8d77-6c2c70db16a8 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:24.934325 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0db49-51da-4045-8d77-6c2c70db16a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:24.934605 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0db49-51da-4045-8d77-6c2c70db16a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:24.935819 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0db49-51da-4045-8d77-6c2c70db16a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:24.937301 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0db49-51da-4045-8d77-6c2c70db16a8 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:24.938921 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 20/37] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:37:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:24.939839 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0db49-51da-4045-8d77-6c2c70db16a8 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:25.001151 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd9d45-dcc8-4512-aa93-b4e560d1db6f None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:25.035711 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4dde1-4090-426d-85f1-ee1cf028eca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:25.036428 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4dde1-4090-426d-85f1-ee1cf028eca9 None admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:25.036701 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4dde1-4090-426d-85f1-ee1cf028eca9 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:25.036985 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4dde1-4090-426d-85f1-ee1cf028eca9 None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:25.039053 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d4dde1-4090-426d-85f1-ee1cf028eca9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:25.039897 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0db49-51da-4045-8d77-6c2c70db16a8 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:25.040525 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d4dde1-4090-426d-85f1-ee1cf028eca9 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:25.063184 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 18/38] 10.222.0.49 () {60 vars in 1131 bytes} [Fri Oct 28 20:37:24 2022] POST /identity/v3/roles => generated 225 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:37:25.063184 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5caf897-e0ae-42b9-96e1-788d82b15249 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:25.063184 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5caf897-e0ae-42b9-96e1-788d82b15249 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:25.063184 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5caf897-e0ae-42b9-96e1-788d82b15249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:25.088037 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-c5caf897-e0ae-42b9-96e1-788d82b15249 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:37:25.090997 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-c5caf897-e0ae-42b9-96e1-788d82b15249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:37:25.097994 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086346de-3f51-4e08-8d27-4845f5c9b726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:25.098775 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086346de-3f51-4e08-8d27-4845f5c9b726 None admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:25.099128 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086346de-3f51-4e08-8d27-4845f5c9b726 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:25.099474 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086346de-3f51-4e08-8d27-4845f5c9b726 None admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:25.101052 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086346de-3f51-4e08-8d27-4845f5c9b726 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:25.102726 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086346de-3f51-4e08-8d27-4845f5c9b726 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:25.182328 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 19/39] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:37:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:37:25.183110 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5caf897-e0ae-42b9-96e1-788d82b15249 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:25.269780 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 21/40] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Oct 28 20:37:24 2022] POST /identity/v3/projects => generated 301 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:37:25.270539 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086346de-3f51-4e08-8d27-4845f5c9b726 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:25.324607 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5caf897-e0ae-42b9-96e1-788d82b15249 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:25.376541 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2d469-ee22-4662-a603-fa8bc248342c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:25.377774 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2d469-ee22-4662-a603-fa8bc248342c None admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:25.378061 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2d469-ee22-4662-a603-fa8bc248342c None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:25.378561 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2d469-ee22-4662-a603-fa8bc248342c None admin] PATH_INFO: `/v3/domains/default/users/57b0953dcb104303876815cf22027f50/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:25.382105 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2d469-ee22-4662-a603-fa8bc248342c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=57b0953dcb104303876815cf22027f50, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:25.384019 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2d469-ee22-4662-a603-fa8bc248342c None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:25.408022 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086346de-3f51-4e08-8d27-4845f5c9b726 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:25.411424 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 20/41] 10.222.0.49 () {58 vars in 1361 bytes} [Fri Oct 28 20:37:25 2022] PUT /identity/v3/domains/default/users/57b0953dcb104303876815cf22027f50/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:37:25.453498 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f107c00-5601-448c-8947-7afd76ee467c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:25.454308 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f107c00-5601-448c-8947-7afd76ee467c None admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:25.454689 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f107c00-5601-448c-8947-7afd76ee467c None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:25.455061 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f107c00-5601-448c-8947-7afd76ee467c None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:25.455960 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f107c00-5601-448c-8947-7afd76ee467c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:25.457699 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f107c00-5601-448c-8947-7afd76ee467c None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:25.479140 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 22/42] 10.222.0.49 () {60 vars in 1131 bytes} [Fri Oct 28 20:37:25 2022] POST /identity/v3/roles => generated 223 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:37:25.487575 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfe740-a07c-4649-b0cf-f68b9d8b72a9 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:25.487969 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfe740-a07c-4649-b0cf-f68b9d8b72a9 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:25.488288 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfe740-a07c-4649-b0cf-f68b9d8b72a9 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:25.491258 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 21/43] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:37:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:37:25.498367 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d0aa0-5b74-4bcc-8d74-8f6bae9a9461 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:25.498976 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d0aa0-5b74-4bcc-8d74-8f6bae9a9461 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:25.499463 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d0aa0-5b74-4bcc-8d74-8f6bae9a9461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:25.521098 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-047d0aa0-5b74-4bcc-8d74-8f6bae9a9461 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:37:25.523640 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-047d0aa0-5b74-4bcc-8d74-8f6bae9a9461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:37:25.611616 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 23/44] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:37:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:37:25.637482 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bfe740-a07c-4649-b0cf-f68b9d8b72a9 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:25.747132 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bfe740-a07c-4649-b0cf-f68b9d8b72a9 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:25.781046 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49af84-9597-4f33-986b-bafade90495d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:25.781835 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49af84-9597-4f33-986b-bafade90495d None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:25.782115 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49af84-9597-4f33-986b-bafade90495d None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:25.782386 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49af84-9597-4f33-986b-bafade90495d None admin] PATH_INFO: `/v3/domains/default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:25.783561 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b49af84-9597-4f33-986b-bafade90495d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:25.785115 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b49af84-9597-4f33-986b-bafade90495d None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:25.786729 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 22/45] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:37:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:25.793069 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d0aa0-5b74-4bcc-8d74-8f6bae9a9461 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:25.890506 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d0aa0-5b74-4bcc-8d74-8f6bae9a9461 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:25.924249 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8ec78-eb64-4a49-afa0-3a161c73620b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:25.924924 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8ec78-eb64-4a49-afa0-3a161c73620b None admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:25.925206 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8ec78-eb64-4a49-afa0-3a161c73620b None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:25.925480 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8ec78-eb64-4a49-afa0-3a161c73620b None admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:25.926213 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b8ec78-eb64-4a49-afa0-3a161c73620b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:25.927719 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b8ec78-eb64-4a49-afa0-3a161c73620b None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:25.955457 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 24/46] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Oct 28 20:37:25 2022] POST /identity/v3/projects => generated 312 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:37:27.847498 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6acd9-6008-4aae-a456-b60442b45718 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:27.848324 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6acd9-6008-4aae-a456-b60442b45718 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:27.848324 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6acd9-6008-4aae-a456-b60442b45718 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:27.850740 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 23/47] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:37:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:37:27.856369 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e716136-b597-40df-af0b-e73976190399 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:27.856848 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e716136-b597-40df-af0b-e73976190399 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:27.856962 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e716136-b597-40df-af0b-e73976190399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:27.875452 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-4e716136-b597-40df-af0b-e73976190399 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:37:27.876814 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-4e716136-b597-40df-af0b-e73976190399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:37:27.953181 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 25/48] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:37:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:37:27.998237 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6acd9-6008-4aae-a456-b60442b45718 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:28.171641 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6acd9-6008-4aae-a456-b60442b45718 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:28.238994 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee122ec8-84c5-4a60-b62d-7dbc322ab7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:28.240293 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee122ec8-84c5-4a60-b62d-7dbc322ab7d0 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:28.241451 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee122ec8-84c5-4a60-b62d-7dbc322ab7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:28.242027 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee122ec8-84c5-4a60-b62d-7dbc322ab7d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:28.260134 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee122ec8-84c5-4a60-b62d-7dbc322ab7d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:37:28.274908 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-ee122ec8-84c5-4a60-b62d-7dbc322ab7d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 20:37:28.277231 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 24/49] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 20:37:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:37:28.285959 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e716136-b597-40df-af0b-e73976190399 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:28.366699 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11852f25-7ff9-4a46-8dfd-fee2a02baf62 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:28.367063 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11852f25-7ff9-4a46-8dfd-fee2a02baf62 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:28.367406 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11852f25-7ff9-4a46-8dfd-fee2a02baf62 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:28.370128 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 25/50] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:37:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:37:28.376870 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af461b0f-7d2f-4843-ae45-1349a9674d27 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:28.377308 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af461b0f-7d2f-4843-ae45-1349a9674d27 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:28.377742 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af461b0f-7d2f-4843-ae45-1349a9674d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:28.406804 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-af461b0f-7d2f-4843-ae45-1349a9674d27 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:37:28.408982 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-af461b0f-7d2f-4843-ae45-1349a9674d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:37:28.441633 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e716136-b597-40df-af0b-e73976190399 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:28.482761 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367c071-17a6-45fc-8c6a-afc0393d225a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:28.483830 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367c071-17a6-45fc-8c6a-afc0393d225a None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:28.484266 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367c071-17a6-45fc-8c6a-afc0393d225a None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:28.484714 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367c071-17a6-45fc-8c6a-afc0393d225a None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:28.486011 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9367c071-17a6-45fc-8c6a-afc0393d225a None admin] RBAC: Adding query filter params (name=admin) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:37:28.486410 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9367c071-17a6-45fc-8c6a-afc0393d225a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:28.488162 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9367c071-17a6-45fc-8c6a-afc0393d225a None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:28.497628 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 26/51] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:37:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 20:37:28.502840 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 26/52] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:37:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:28.509035 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af461b0f-7d2f-4843-ae45-1349a9674d27 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:28.535080 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367c071-17a6-45fc-8c6a-afc0393d225a None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:28.672328 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af461b0f-7d2f-4843-ae45-1349a9674d27 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:28.687275 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367c071-17a6-45fc-8c6a-afc0393d225a None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:28.710691 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f160d4-0777-4313-b557-5bec89019a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:28.711569 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f160d4-0777-4313-b557-5bec89019a88 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:28.711884 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f160d4-0777-4313-b557-5bec89019a88 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:28.712159 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f160d4-0777-4313-b557-5bec89019a88 None admin] PATH_INFO: `/v3/users/57b0953dcb104303876815cf22027f50` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:28.713408 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f160d4-0777-4313-b557-5bec89019a88 None admin] RBAC: Authorizing `identity:get_user(user_id=57b0953dcb104303876815cf22027f50)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:28.714896 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f160d4-0777-4313-b557-5bec89019a88 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:28.716602 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 27/53] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:37:28 2022] GET /identity/v3/users/57b0953dcb104303876815cf22027f50 => generated 247 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:28.724360 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f160d4-0777-4313-b557-5bec89019a88 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:28.727642 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eeae15-1ecd-4089-a90b-cb4f8e84efa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:28.728543 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eeae15-1ecd-4089-a90b-cb4f8e84efa3 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:28.728886 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eeae15-1ecd-4089-a90b-cb4f8e84efa3 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:28.729223 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eeae15-1ecd-4089-a90b-cb4f8e84efa3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:28.730510 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eeae15-1ecd-4089-a90b-cb4f8e84efa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:28.732081 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eeae15-1ecd-4089-a90b-cb4f8e84efa3 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:28.733865 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 27/54] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:37:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:28.739562 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eeae15-1ecd-4089-a90b-cb4f8e84efa3 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:28.852207 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f160d4-0777-4313-b557-5bec89019a88 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:28.867793 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eeae15-1ecd-4089-a90b-cb4f8e84efa3 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:28.892481 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d2926-b737-48bc-8c59-a191cc897bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:28.893428 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d2926-b737-48bc-8c59-a191cc897bf8 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:28.893874 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d2926-b737-48bc-8c59-a191cc897bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:28.894237 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d2926-b737-48bc-8c59-a191cc897bf8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:28.895940 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d2926-b737-48bc-8c59-a191cc897bf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:28.898211 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d2926-b737-48bc-8c59-a191cc897bf8 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:28.900340 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 28/55] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:37:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:37:28.906884 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d2926-b737-48bc-8c59-a191cc897bf8 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:28.907085 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb434f2a-b5b7-49d0-b8ba-d72881be4aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:28.907822 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb434f2a-b5b7-49d0-b8ba-d72881be4aa0 None admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:28.908189 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb434f2a-b5b7-49d0-b8ba-d72881be4aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:28.908529 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb434f2a-b5b7-49d0-b8ba-d72881be4aa0 None admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:28.909313 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb434f2a-b5b7-49d0-b8ba-d72881be4aa0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:28.910947 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb434f2a-b5b7-49d0-b8ba-d72881be4aa0 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:28.947987 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 28/56] 10.222.0.49 () {60 vars in 1140 bytes} [Fri Oct 28 20:37:28 2022] POST /identity/v3/projects => generated 298 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:37:29.037642 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d2926-b737-48bc-8c59-a191cc897bf8 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:29.093001 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95480786-7ebb-46d7-8ca6-38d34c7f4f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:29.093801 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95480786-7ebb-46d7-8ca6-38d34c7f4f24 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:29.094169 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95480786-7ebb-46d7-8ca6-38d34c7f4f24 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:29.094530 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95480786-7ebb-46d7-8ca6-38d34c7f4f24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:29.095625 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95480786-7ebb-46d7-8ca6-38d34c7f4f24 None admin] RBAC: Adding query filter params (role.id=8fe105eeb7bf4856a94b0633bd781414, scope.domain.id=default, user.id=57b0953dcb104303876815cf22027f50) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:37:29.096077 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95480786-7ebb-46d7-8ca6-38d34c7f4f24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:29.097727 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95480786-7ebb-46d7-8ca6-38d34c7f4f24 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:29.107520 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 29/57] 10.222.0.49 () {56 vars in 1322 bytes} [Fri Oct 28 20:37:28 2022] GET /identity/v3/role_assignments?user.id=57b0953dcb104303876815cf22027f50&scope.domain.id=default&role.id=8fe105eeb7bf4856a94b0633bd781414 => generated 530 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:37:31.434147 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ccf61-5b81-4980-a6f9-eb229f201254 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:31.434653 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ccf61-5b81-4980-a6f9-eb229f201254 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:31.434737 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ccf61-5b81-4980-a6f9-eb229f201254 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:31.436510 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 29/58] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:37:31.442142 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02ac2a-01ad-42cf-9417-b3a9cd4bf708 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:31.442563 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02ac2a-01ad-42cf-9417-b3a9cd4bf708 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:31.442703 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02ac2a-01ad-42cf-9417-b3a9cd4bf708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:31.459984 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-cd02ac2a-01ad-42cf-9417-b3a9cd4bf708 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:37:31.461184 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-cd02ac2a-01ad-42cf-9417-b3a9cd4bf708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:37:31.528576 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 30/59] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:37:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:37:31.554318 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ccf61-5b81-4980-a6f9-eb229f201254 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:31.694946 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ccf61-5b81-4980-a6f9-eb229f201254 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:31.729556 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a3769-8552-4b6d-814f-b389dace3e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:31.730367 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a3769-8552-4b6d-814f-b389dace3e43 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:31.730646 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a3769-8552-4b6d-814f-b389dace3e43 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:31.730919 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a3769-8552-4b6d-814f-b389dace3e43 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:31.732190 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a3769-8552-4b6d-814f-b389dace3e43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:31.733755 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a3769-8552-4b6d-814f-b389dace3e43 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:31.735380 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 30/60] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:37:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:31.741114 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02ac2a-01ad-42cf-9417-b3a9cd4bf708 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:31.838458 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02ac2a-01ad-42cf-9417-b3a9cd4bf708 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:31.872679 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51355f-ec7b-47c5-b459-926e5f7f3d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:31.873353 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51355f-ec7b-47c5-b459-926e5f7f3d45 None admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:31.873634 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51355f-ec7b-47c5-b459-926e5f7f3d45 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:31.873907 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51355f-ec7b-47c5-b459-926e5f7f3d45 None admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:31.874638 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51355f-ec7b-47c5-b459-926e5f7f3d45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:31.876120 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51355f-ec7b-47c5-b459-926e5f7f3d45 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:31.904101 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 31/61] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Oct 28 20:37:31 2022] POST /identity/v3/users => generated 275 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:37:36.885435 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7178068-d8a3-4983-a81d-d3bb24ec0235 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:36.886966 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7178068-d8a3-4983-a81d-d3bb24ec0235 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:36.887775 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7178068-d8a3-4983-a81d-d3bb24ec0235 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:36.895884 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 31/62] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:37:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:37:36.899344 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca0a7e-0f93-482c-ad7b-a893ac2e8dec None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:36.900111 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca0a7e-0f93-482c-ad7b-a893ac2e8dec None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:36.900111 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca0a7e-0f93-482c-ad7b-a893ac2e8dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:36.926450 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-04ca0a7e-0f93-482c-ad7b-a893ac2e8dec None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:37:36.928267 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-04ca0a7e-0f93-482c-ad7b-a893ac2e8dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:37:37.024358 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 32/63] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:37:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:37:37.097857 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7178068-d8a3-4983-a81d-d3bb24ec0235 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:37.181275 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54751056-27ce-4162-bde8-2446c549497a None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:37.182201 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54751056-27ce-4162-bde8-2446c549497a None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:37.182981 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54751056-27ce-4162-bde8-2446c549497a None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:37.194619 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 33/64] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:37:37 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:37:37.196641 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfae698-c461-4725-9349-cff5115e1d69 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:37.197181 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfae698-c461-4725-9349-cff5115e1d69 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:37.197673 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfae698-c461-4725-9349-cff5115e1d69 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:37.199786 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 34/65] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:37:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:37:37.204562 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70677da-d771-40e9-932a-e289bb0c20c9 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:37.205450 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70677da-d771-40e9-932a-e289bb0c20c9 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:37.205450 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70677da-d771-40e9-932a-e289bb0c20c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:37.236514 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-b70677da-d771-40e9-932a-e289bb0c20c9 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:37:37.239914 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-b70677da-d771-40e9-932a-e289bb0c20c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:37:37.315232 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7178068-d8a3-4983-a81d-d3bb24ec0235 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:37.359354 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12158c0-6a7e-485e-b5ca-32ee5155f56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:37.360534 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12158c0-6a7e-485e-b5ca-32ee5155f56e None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:37.360991 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12158c0-6a7e-485e-b5ca-32ee5155f56e None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:37.361423 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12158c0-6a7e-485e-b5ca-32ee5155f56e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:37.378587 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12158c0-6a7e-485e-b5ca-32ee5155f56e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:37:37.380487 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 35/66] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:37:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:37:37.384424 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623d105-046c-4aa0-bc48-e37506bd3bad None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:37.385152 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623d105-046c-4aa0-bc48-e37506bd3bad None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:37.385786 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623d105-046c-4aa0-bc48-e37506bd3bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:37.392698 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-c12158c0-6a7e-485e-b5ca-32ee5155f56e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 20:37:37.395066 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 32/67] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 20:37:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:37:37.410355 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12158c0-6a7e-485e-b5ca-32ee5155f56e None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:37.440289 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-5623d105-046c-4aa0-bc48-e37506bd3bad None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:37:37.442121 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-5623d105-046c-4aa0-bc48-e37506bd3bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:37:37.574428 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 36/68] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:37:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:37:37.574428 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623d105-046c-4aa0-bc48-e37506bd3bad None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:37.600729 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12158c0-6a7e-485e-b5ca-32ee5155f56e None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:37.667186 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a603284-2d11-4514-8631-d90651e9cfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:37.667935 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a603284-2d11-4514-8631-d90651e9cfc7 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:37.668229 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a603284-2d11-4514-8631-d90651e9cfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:37.668510 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a603284-2d11-4514-8631-d90651e9cfc7 None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:37.669288 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a603284-2d11-4514-8631-d90651e9cfc7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:37:37.669598 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a603284-2d11-4514-8631-d90651e9cfc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:37.671108 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a603284-2d11-4514-8631-d90651e9cfc7 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:37.686938 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 33/69] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:37:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:37:37.686938 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2870208-ce35-413b-9857-b03075587e2e None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:37.686938 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2870208-ce35-413b-9857-b03075587e2e None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:37.686938 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2870208-ce35-413b-9857-b03075587e2e None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:37.686938 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 34/70] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:37:37.686938 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2870208-ce35-413b-9857-b03075587e2e None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:37.736923 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623d105-046c-4aa0-bc48-e37506bd3bad None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:37.792408 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b824d-c6b4-4907-bf6b-0f50ec5bb127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:37.793674 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b824d-c6b4-4907-bf6b-0f50ec5bb127 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:37.794138 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b824d-c6b4-4907-bf6b-0f50ec5bb127 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:37.794583 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b824d-c6b4-4907-bf6b-0f50ec5bb127 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:37.812646 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b824d-c6b4-4907-bf6b-0f50ec5bb127 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:37:37.825230 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-797b824d-c6b4-4907-bf6b-0f50ec5bb127 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 20:37:37.827286 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 37/71] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:37:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:37:37.829465 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674533c8-47ed-416b-8b44-1e71f5ee2bc0 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:37.829964 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674533c8-47ed-416b-8b44-1e71f5ee2bc0 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:37.830447 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674533c8-47ed-416b-8b44-1e71f5ee2bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:37.841889 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2870208-ce35-413b-9857-b03075587e2e None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:37.853238 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-674533c8-47ed-416b-8b44-1e71f5ee2bc0 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:37:37.854623 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-674533c8-47ed-416b-8b44-1e71f5ee2bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:37:37.885036 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8306b3d-3f97-4399-96cc-86db54ac978f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:37.885988 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8306b3d-3f97-4399-96cc-86db54ac978f None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:37.886894 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8306b3d-3f97-4399-96cc-86db54ac978f None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:37.886894 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8306b3d-3f97-4399-96cc-86db54ac978f None admin] PATH_INFO: `/v3/roles/member` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:37.899881 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8306b3d-3f97-4399-96cc-86db54ac978f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:37:37.907136 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-f8306b3d-3f97-4399-96cc-86db54ac978f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 20:37:37.908557 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 35/72] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:37:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:37:37.909915 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8306b3d-3f97-4399-96cc-86db54ac978f None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:37.936187 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 38/73] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:37:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:37:37.939549 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65023163-0a84-4bec-9b1a-e4146b8393e5 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:37.940032 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65023163-0a84-4bec-9b1a-e4146b8393e5 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:37.940471 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65023163-0a84-4bec-9b1a-e4146b8393e5 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:37.944982 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 39/74] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:37:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:37:37.946156 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65023163-0a84-4bec-9b1a-e4146b8393e5 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:38.073819 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8306b3d-3f97-4399-96cc-86db54ac978f None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:38.110181 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65023163-0a84-4bec-9b1a-e4146b8393e5 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:38.128410 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8ad3a-6d26-4cd3-914b-2467440dd5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:38.129764 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8ad3a-6d26-4cd3-914b-2467440dd5cc None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:38.130181 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8ad3a-6d26-4cd3-914b-2467440dd5cc None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:38.130618 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8ad3a-6d26-4cd3-914b-2467440dd5cc None admin] PATH_INFO: `/v3/users/57b0953dcb104303876815cf22027f50` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:38.133496 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8ad3a-6d26-4cd3-914b-2467440dd5cc None admin] RBAC: Authorizing `identity:get_user(user_id=57b0953dcb104303876815cf22027f50)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:38.135917 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8ad3a-6d26-4cd3-914b-2467440dd5cc None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:38.138976 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 36/75] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:37:37 2022] GET /identity/v3/users/57b0953dcb104303876815cf22027f50 => generated 247 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:38.140143 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8ad3a-6d26-4cd3-914b-2467440dd5cc None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:38.172496 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a7713-d652-4294-991b-8c896059d67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:38.173558 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a7713-d652-4294-991b-8c896059d67b None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:38.174005 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a7713-d652-4294-991b-8c896059d67b None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:38.174451 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a7713-d652-4294-991b-8c896059d67b None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:38.175704 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a7713-d652-4294-991b-8c896059d67b None admin] RBAC: Adding query filter params (name=member) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:37:38.176103 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a7713-d652-4294-991b-8c896059d67b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:38.179190 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a7713-d652-4294-991b-8c896059d67b None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:38.204283 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 40/76] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 20:37:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:38.204283 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691589a-9d35-443d-8e70-739ccc5c1ed7 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:38.204283 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691589a-9d35-443d-8e70-739ccc5c1ed7 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:38.204283 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691589a-9d35-443d-8e70-739ccc5c1ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:38.228446 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-1691589a-9d35-443d-8e70-739ccc5c1ed7 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:37:38.229931 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-1691589a-9d35-443d-8e70-739ccc5c1ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:37:38.289656 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8ad3a-6d26-4cd3-914b-2467440dd5cc None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:38.328900 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 41/77] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:37:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:37:38.330028 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691589a-9d35-443d-8e70-739ccc5c1ed7 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:38.344596 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360b7f9-e642-40a3-b2dc-330faa675b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:38.346289 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360b7f9-e642-40a3-b2dc-330faa675b16 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:38.346747 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360b7f9-e642-40a3-b2dc-330faa675b16 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:38.347175 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360b7f9-e642-40a3-b2dc-330faa675b16 None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:38.348750 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360b7f9-e642-40a3-b2dc-330faa675b16 None admin] RBAC: Adding query filter params (name=member) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:37:38.348921 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360b7f9-e642-40a3-b2dc-330faa675b16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:38.351859 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360b7f9-e642-40a3-b2dc-330faa675b16 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:38.365684 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 37/78] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 20:37:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:38.368400 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360b7f9-e642-40a3-b2dc-330faa675b16 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:38.484602 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691589a-9d35-443d-8e70-739ccc5c1ed7 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:38.520838 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360b7f9-e642-40a3-b2dc-330faa675b16 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:38.540746 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb446a-8354-4c44-bdff-d38fe5f1b6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:38.541835 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb446a-8354-4c44-bdff-d38fe5f1b6d4 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:38.542182 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb446a-8354-4c44-bdff-d38fe5f1b6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:38.542520 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb446a-8354-4c44-bdff-d38fe5f1b6d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:38.559507 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb446a-8354-4c44-bdff-d38fe5f1b6d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:37:38.573104 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-51eb446a-8354-4c44-bdff-d38fe5f1b6d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 20:37:38.575162 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 42/79] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 20:37:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:37:38.576205 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb446a-8354-4c44-bdff-d38fe5f1b6d4 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:38.579959 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699719e-cb5f-4167-a620-0fdb89c56ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:38.581003 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699719e-cb5f-4167-a620-0fdb89c56ce6 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:38.581513 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699719e-cb5f-4167-a620-0fdb89c56ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:38.582003 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699719e-cb5f-4167-a620-0fdb89c56ce6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:38.674064 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699719e-cb5f-4167-a620-0fdb89c56ce6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:38.675887 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699719e-cb5f-4167-a620-0fdb89c56ce6 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:38.703571 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb446a-8354-4c44-bdff-d38fe5f1b6d4 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:38.744678 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504a34f-4a03-4743-8858-35b662d2b791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:38.745718 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504a34f-4a03-4743-8858-35b662d2b791 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:38.746082 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504a34f-4a03-4743-8858-35b662d2b791 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:38.746449 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504a34f-4a03-4743-8858-35b662d2b791 None admin] PATH_INFO: `/v3/users/4041574dcab14bf1acdf530a63ba0554` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:38.768104 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504a34f-4a03-4743-8858-35b662d2b791 None admin] RBAC: Authorizing `identity:get_user(user_id=4041574dcab14bf1acdf530a63ba0554)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:38.770137 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504a34f-4a03-4743-8858-35b662d2b791 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:38.773348 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 43/80] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:37:38 2022] GET /identity/v3/users/4041574dcab14bf1acdf530a63ba0554 => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:38.774423 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504a34f-4a03-4743-8858-35b662d2b791 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:38.801460 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 38/81] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:37:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:38.802678 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699719e-cb5f-4167-a620-0fdb89c56ce6 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:38.899859 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504a34f-4a03-4743-8858-35b662d2b791 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:38.928825 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699719e-cb5f-4167-a620-0fdb89c56ce6 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:38.949880 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1322e-2a19-454b-b27f-2196d512d9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:38.951083 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1322e-2a19-454b-b27f-2196d512d9d1 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:38.951454 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1322e-2a19-454b-b27f-2196d512d9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:38.951942 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1322e-2a19-454b-b27f-2196d512d9d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:38.953893 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1322e-2a19-454b-b27f-2196d512d9d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:38.956403 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1322e-2a19-454b-b27f-2196d512d9d1 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:38.959785 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 44/82] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:37:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:38.961321 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1322e-2a19-454b-b27f-2196d512d9d1 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:38.983363 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df63d5-502d-4b6e-8ec6-a8db74dfde2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:38.984883 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df63d5-502d-4b6e-8ec6-a8db74dfde2f None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:38.985313 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df63d5-502d-4b6e-8ec6-a8db74dfde2f None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:38.985762 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df63d5-502d-4b6e-8ec6-a8db74dfde2f None admin] PATH_INFO: `/v3/users/4041574dcab14bf1acdf530a63ba0554` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:38.987773 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df63d5-502d-4b6e-8ec6-a8db74dfde2f None admin] RBAC: Authorizing `identity:get_user(user_id=4041574dcab14bf1acdf530a63ba0554)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:38.990271 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df63d5-502d-4b6e-8ec6-a8db74dfde2f None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:38.998599 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 39/83] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:37:38 2022] GET /identity/v3/users/4041574dcab14bf1acdf530a63ba0554 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:38.998599 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df63d5-502d-4b6e-8ec6-a8db74dfde2f None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:39.113120 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df63d5-502d-4b6e-8ec6-a8db74dfde2f None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:39.116695 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1322e-2a19-454b-b27f-2196d512d9d1 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:39.148467 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6296d90-7070-478a-85dd-ab963f771cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:39.149124 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6296d90-7070-478a-85dd-ab963f771cc3 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:39.149406 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6296d90-7070-478a-85dd-ab963f771cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:39.149678 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6296d90-7070-478a-85dd-ab963f771cc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:39.171365 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7db1a8-5edc-4566-96b2-c00862bfbd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:39.172496 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7db1a8-5edc-4566-96b2-c00862bfbd51 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:39.173002 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7db1a8-5edc-4566-96b2-c00862bfbd51 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:39.173500 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7db1a8-5edc-4566-96b2-c00862bfbd51 None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:39.174929 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7db1a8-5edc-4566-96b2-c00862bfbd51 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:37:39.175483 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7db1a8-5edc-4566-96b2-c00862bfbd51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:39.178672 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7db1a8-5edc-4566-96b2-c00862bfbd51 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:39.194423 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 45/84] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:37:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:39.195893 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7db1a8-5edc-4566-96b2-c00862bfbd51 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:39.220172 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6296d90-7070-478a-85dd-ab963f771cc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:39.221669 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6296d90-7070-478a-85dd-ab963f771cc3 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:39.345602 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7db1a8-5edc-4566-96b2-c00862bfbd51 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:39.346511 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 40/85] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:37:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:39.347335 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6296d90-7070-478a-85dd-ab963f771cc3 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:39.385396 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0bcc55-7fa0-4c8f-9d5a-7652d4535182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:39.386263 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bcc55-7fa0-4c8f-9d5a-7652d4535182 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:39.386541 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bcc55-7fa0-4c8f-9d5a-7652d4535182 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:39.386812 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bcc55-7fa0-4c8f-9d5a-7652d4535182 None admin] PATH_INFO: `/v3/projects/7651e6b03b65497ab11181afb4e27ca6` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:39.388075 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0bcc55-7fa0-4c8f-9d5a-7652d4535182 None admin] RBAC: Authorizing `identity:get_project(project_id=7651e6b03b65497ab11181afb4e27ca6)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:39.389562 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0bcc55-7fa0-4c8f-9d5a-7652d4535182 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:39.391309 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 46/86] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:37:39 2022] GET /identity/v3/projects/7651e6b03b65497ab11181afb4e27ca6 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:39.392108 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0bcc55-7fa0-4c8f-9d5a-7652d4535182 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:39.481393 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6296d90-7070-478a-85dd-ab963f771cc3 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:39.513507 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0bcc55-7fa0-4c8f-9d5a-7652d4535182 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:39.525051 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b246fc-f7fa-40f4-aee2-17807f3c5fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:39.525858 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b246fc-f7fa-40f4-aee2-17807f3c5fc5 None admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:39.526323 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b246fc-f7fa-40f4-aee2-17807f3c5fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:39.526718 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b246fc-f7fa-40f4-aee2-17807f3c5fc5 None admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:39.527520 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b246fc-f7fa-40f4-aee2-17807f3c5fc5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:39.529329 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b246fc-f7fa-40f4-aee2-17807f3c5fc5 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:39.559427 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d3332-9037-4888-96e9-0057a1f6eb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:39.560516 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d3332-9037-4888-96e9-0057a1f6eb99 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:39.560959 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d3332-9037-4888-96e9-0057a1f6eb99 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:39.561412 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d3332-9037-4888-96e9-0057a1f6eb99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:39.565420 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 41/87] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Oct 28 20:37:39 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:37:39.566899 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b246fc-f7fa-40f4-aee2-17807f3c5fc5 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:39.671658 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d3332-9037-4888-96e9-0057a1f6eb99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:39.673272 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d3332-9037-4888-96e9-0057a1f6eb99 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:39.723645 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b246fc-f7fa-40f4-aee2-17807f3c5fc5 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:39.768170 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1f2f4-5d6a-481d-ae49-8f7f1eca7408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:39.768982 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1f2f4-5d6a-481d-ae49-8f7f1eca7408 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:39.769352 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1f2f4-5d6a-481d-ae49-8f7f1eca7408 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:39.769628 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1f2f4-5d6a-481d-ae49-8f7f1eca7408 None admin] PATH_INFO: `/v3/users/4041574dcab14bf1acdf530a63ba0554` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:39.771084 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1f2f4-5d6a-481d-ae49-8f7f1eca7408 None admin] RBAC: Authorizing `identity:get_user(user_id=4041574dcab14bf1acdf530a63ba0554)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:39.773338 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1f2f4-5d6a-481d-ae49-8f7f1eca7408 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:39.775777 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 42/88] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:37:39 2022] GET /identity/v3/users/4041574dcab14bf1acdf530a63ba0554 => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:39.782076 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1f2f4-5d6a-481d-ae49-8f7f1eca7408 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:39.854419 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 47/89] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:37:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:39.854419 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d3332-9037-4888-96e9-0057a1f6eb99 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:39.916478 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1f2f4-5d6a-481d-ae49-8f7f1eca7408 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:39.966156 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cdb97-668c-4c8e-b109-daeaa14df26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:39.968073 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cdb97-668c-4c8e-b109-daeaa14df26e None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:39.968613 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cdb97-668c-4c8e-b109-daeaa14df26e None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:39.969091 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cdb97-668c-4c8e-b109-daeaa14df26e None admin] PATH_INFO: `/v3/projects/7651e6b03b65497ab11181afb4e27ca6` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:39.970900 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5cdb97-668c-4c8e-b109-daeaa14df26e None admin] RBAC: Authorizing `identity:get_project(project_id=7651e6b03b65497ab11181afb4e27ca6)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:39.972746 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5cdb97-668c-4c8e-b109-daeaa14df26e None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:39.974983 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 43/90] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:37:39 2022] GET /identity/v3/projects/7651e6b03b65497ab11181afb4e27ca6 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:39.976198 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cdb97-668c-4c8e-b109-daeaa14df26e None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:40.027673 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d3332-9037-4888-96e9-0057a1f6eb99 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:40.089295 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84207dd9-c9d5-4ae7-a131-73ceecc90330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:40.090322 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84207dd9-c9d5-4ae7-a131-73ceecc90330 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:40.090725 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84207dd9-c9d5-4ae7-a131-73ceecc90330 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:40.091109 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84207dd9-c9d5-4ae7-a131-73ceecc90330 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:40.095951 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84207dd9-c9d5-4ae7-a131-73ceecc90330 None admin] RBAC: Adding query filter params (role.id=8fe105eeb7bf4856a94b0633bd781414, scope.project.id=7651e6b03b65497ab11181afb4e27ca6, user.id=57b0953dcb104303876815cf22027f50) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:37:40.095951 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84207dd9-c9d5-4ae7-a131-73ceecc90330 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:40.096298 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cdb97-668c-4c8e-b109-daeaa14df26e None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:40.096436 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84207dd9-c9d5-4ae7-a131-73ceecc90330 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:40.106563 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 48/91] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:37:39 2022] GET /identity/v3/role_assignments?user.id=57b0953dcb104303876815cf22027f50&scope.project.id=7651e6b03b65497ab11181afb4e27ca6&role.id=8fe105eeb7bf4856a94b0633bd781414 => generated 259 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:40.112187 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84207dd9-c9d5-4ae7-a131-73ceecc90330 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:40.132744 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26988dd-70e7-4ad8-a027-ad2a0c7e5da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:40.133449 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26988dd-70e7-4ad8-a027-ad2a0c7e5da6 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:40.133730 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26988dd-70e7-4ad8-a027-ad2a0c7e5da6 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:40.134008 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26988dd-70e7-4ad8-a027-ad2a0c7e5da6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:40.214694 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26988dd-70e7-4ad8-a027-ad2a0c7e5da6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:40.216293 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26988dd-70e7-4ad8-a027-ad2a0c7e5da6 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:40.337451 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 44/92] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:37:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:40.338255 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26988dd-70e7-4ad8-a027-ad2a0c7e5da6 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:40.458443 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26988dd-70e7-4ad8-a027-ad2a0c7e5da6 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:40.499510 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9ed0f-72e8-48fe-9aa8-c9bb27272df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:40.500061 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84207dd9-c9d5-4ae7-a131-73ceecc90330 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:40.500216 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9ed0f-72e8-48fe-9aa8-c9bb27272df6 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:40.500486 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9ed0f-72e8-48fe-9aa8-c9bb27272df6 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:40.500753 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9ed0f-72e8-48fe-9aa8-c9bb27272df6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:40.501598 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9ed0f-72e8-48fe-9aa8-c9bb27272df6 None admin] RBAC: Adding query filter params (role.id=aaafbf9fe78e46cd9f06410394fdb531, scope.project.id=7651e6b03b65497ab11181afb4e27ca6, user.id=4041574dcab14bf1acdf530a63ba0554) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:37:40.501993 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9ed0f-72e8-48fe-9aa8-c9bb27272df6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:40.503377 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9ed0f-72e8-48fe-9aa8-c9bb27272df6 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:40.510864 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 45/93] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:37:40 2022] GET /identity/v3/role_assignments?user.id=4041574dcab14bf1acdf530a63ba0554&scope.project.id=7651e6b03b65497ab11181afb4e27ca6&role.id=aaafbf9fe78e46cd9f06410394fdb531 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:40.511780 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9ed0f-72e8-48fe-9aa8-c9bb27272df6 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:40.626789 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9ed0f-72e8-48fe-9aa8-c9bb27272df6 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:40.637500 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532648a-5600-4987-b7a3-d7f92cffd2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:40.638961 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532648a-5600-4987-b7a3-d7f92cffd2e5 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:40.639403 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532648a-5600-4987-b7a3-d7f92cffd2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:40.639911 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532648a-5600-4987-b7a3-d7f92cffd2e5 None admin] PATH_INFO: `/v3/projects/5d0663efa51942c4928fc87312753a7b` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:40.642198 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532648a-5600-4987-b7a3-d7f92cffd2e5 None admin] RBAC: Authorizing `identity:get_project(project_id=5d0663efa51942c4928fc87312753a7b)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:40.653390 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532648a-5600-4987-b7a3-d7f92cffd2e5 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:40.656901 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 49/94] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:37:40 2022] GET /identity/v3/projects/5d0663efa51942c4928fc87312753a7b => generated 312 bytes in 550 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:40.667449 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532648a-5600-4987-b7a3-d7f92cffd2e5 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:40.667670 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366825ab-8a05-4be3-bf78-028ab9a8298f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:40.668669 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366825ab-8a05-4be3-bf78-028ab9a8298f None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:40.668953 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366825ab-8a05-4be3-bf78-028ab9a8298f None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:40.669228 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366825ab-8a05-4be3-bf78-028ab9a8298f None admin] PATH_INFO: `/v3/projects/7651e6b03b65497ab11181afb4e27ca6` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:40.670538 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366825ab-8a05-4be3-bf78-028ab9a8298f None admin] RBAC: Authorizing `identity:get_project(project_id=7651e6b03b65497ab11181afb4e27ca6)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:40.672087 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366825ab-8a05-4be3-bf78-028ab9a8298f None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:40.674198 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 46/95] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:37:40 2022] GET /identity/v3/projects/7651e6b03b65497ab11181afb4e27ca6 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:40.680323 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366825ab-8a05-4be3-bf78-028ab9a8298f None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:40.919557 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366825ab-8a05-4be3-bf78-028ab9a8298f None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:40.972948 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532648a-5600-4987-b7a3-d7f92cffd2e5 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:40.995234 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29249d3c-25bb-47ad-af75-c45bfae00a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:40.996335 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29249d3c-25bb-47ad-af75-c45bfae00a28 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:40.996826 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29249d3c-25bb-47ad-af75-c45bfae00a28 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:40.997305 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29249d3c-25bb-47ad-af75-c45bfae00a28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:40.998927 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29249d3c-25bb-47ad-af75-c45bfae00a28 None admin] RBAC: Adding query filter params (role.id=28b8756191f44cadbdae28d1af156b6c, scope.project.id=7651e6b03b65497ab11181afb4e27ca6, user.id=4041574dcab14bf1acdf530a63ba0554) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:37:40.999465 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29249d3c-25bb-47ad-af75-c45bfae00a28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:41.002217 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29249d3c-25bb-47ad-af75-c45bfae00a28 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:41.013681 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 47/96] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:37:40 2022] GET /identity/v3/role_assignments?user.id=4041574dcab14bf1acdf530a63ba0554&scope.project.id=7651e6b03b65497ab11181afb4e27ca6&role.id=28b8756191f44cadbdae28d1af156b6c => generated 259 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:37:41.051344 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4c3b2-c281-44d7-89f8-2db5e51b8e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:41.052188 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4c3b2-c281-44d7-89f8-2db5e51b8e54 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:41.052350 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4c3b2-c281-44d7-89f8-2db5e51b8e54 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:41.052742 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4c3b2-c281-44d7-89f8-2db5e51b8e54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:41.053574 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc4c3b2-c281-44d7-89f8-2db5e51b8e54 None admin] RBAC: Adding query filter params (role.id=aaafbf9fe78e46cd9f06410394fdb531, scope.project.id=5d0663efa51942c4928fc87312753a7b, user.id=4041574dcab14bf1acdf530a63ba0554) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:37:41.053892 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc4c3b2-c281-44d7-89f8-2db5e51b8e54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:41.055518 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc4c3b2-c281-44d7-89f8-2db5e51b8e54 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:41.069672 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 50/97] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:37:40 2022] GET /identity/v3/role_assignments?user.id=4041574dcab14bf1acdf530a63ba0554&scope.project.id=5d0663efa51942c4928fc87312753a7b&role.id=aaafbf9fe78e46cd9f06410394fdb531 => generated 259 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:43.857339 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca470d6-ed96-4ba5-a5da-b80ed517ac3e None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:43.858406 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca470d6-ed96-4ba5-a5da-b80ed517ac3e None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:43.858904 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca470d6-ed96-4ba5-a5da-b80ed517ac3e None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:43.861036 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 48/98] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:37:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:37:43.867681 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf1b6f-0eba-434d-a0df-d5b17c88a7b2 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:43.868648 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf1b6f-0eba-434d-a0df-d5b17c88a7b2 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:43.869125 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf1b6f-0eba-434d-a0df-d5b17c88a7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:43.897542 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-a4bf1b6f-0eba-434d-a0df-d5b17c88a7b2 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:37:43.899164 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-a4bf1b6f-0eba-434d-a0df-d5b17c88a7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:37:43.993719 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 51/99] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:37:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:37:44.036167 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca470d6-ed96-4ba5-a5da-b80ed517ac3e None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:44.191625 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f33f3-7f8b-4c27-a7f5-4a350d6f04e2 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:44.191927 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f33f3-7f8b-4c27-a7f5-4a350d6f04e2 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:44.192201 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f33f3-7f8b-4c27-a7f5-4a350d6f04e2 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:44.195291 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 52/100] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:37:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:37:44.201398 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e13d7-c080-44e9-a4e5-fe2f8fa0cc54 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:44.201698 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e13d7-c080-44e9-a4e5-fe2f8fa0cc54 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:44.201957 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e13d7-c080-44e9-a4e5-fe2f8fa0cc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:44.206364 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca470d6-ed96-4ba5-a5da-b80ed517ac3e None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:44.234945 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-456e13d7-c080-44e9-a4e5-fe2f8fa0cc54 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:37:44.236292 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-456e13d7-c080-44e9-a4e5-fe2f8fa0cc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:37:44.308555 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f04d92-3a63-4f5f-b81a-ff99df2507b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:44.309801 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f04d92-3a63-4f5f-b81a-ff99df2507b3 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:44.310290 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f04d92-3a63-4f5f-b81a-ff99df2507b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:44.310766 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f04d92-3a63-4f5f-b81a-ff99df2507b3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:44.329750 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f04d92-3a63-4f5f-b81a-ff99df2507b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:37:44.346177 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-70f04d92-3a63-4f5f-b81a-ff99df2507b3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 20:37:44.347823 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 49/101] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:37:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:37:44.354896 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f04d92-3a63-4f5f-b81a-ff99df2507b3 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:44.362815 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 53/102] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:37:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:37:44.399390 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e13d7-c080-44e9-a4e5-fe2f8fa0cc54 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:44.499616 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f04d92-3a63-4f5f-b81a-ff99df2507b3 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:44.530994 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e13d7-c080-44e9-a4e5-fe2f8fa0cc54 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:44.541797 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb72ff-7103-48c1-a324-f921f2e83afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:44.542654 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb72ff-7103-48c1-a324-f921f2e83afe None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:44.543045 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb72ff-7103-48c1-a324-f921f2e83afe None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:44.543426 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb72ff-7103-48c1-a324-f921f2e83afe None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:44.544651 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb72ff-7103-48c1-a324-f921f2e83afe None admin] RBAC: Adding query filter params (name=reader) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:37:44.544651 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb72ff-7103-48c1-a324-f921f2e83afe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:44.546375 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb72ff-7103-48c1-a324-f921f2e83afe None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:44.564346 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 50/103] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 20:37:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:37:44.570947 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb72ff-7103-48c1-a324-f921f2e83afe None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:44.579258 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4dbe2e-0eeb-4ade-b608-ac84d7158580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:44.580435 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dbe2e-0eeb-4ade-b608-ac84d7158580 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:44.580923 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dbe2e-0eeb-4ade-b608-ac84d7158580 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:44.581368 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dbe2e-0eeb-4ade-b608-ac84d7158580 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:44.585296 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4dbe2e-0eeb-4ade-b608-ac84d7158580 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:44.587123 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4dbe2e-0eeb-4ade-b608-ac84d7158580 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:44.589430 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 54/104] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:37:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:44.595795 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4dbe2e-0eeb-4ade-b608-ac84d7158580 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:44.730150 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4dbe2e-0eeb-4ade-b608-ac84d7158580 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:44.737745 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb72ff-7103-48c1-a324-f921f2e83afe None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:44.777306 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d626a5-032d-48b1-b0ea-f7e717422ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:44.778218 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d626a5-032d-48b1-b0ea-f7e717422ad7 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:44.778502 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0acc44-79d2-425d-afbf-5806b80f75d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:44.778628 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d626a5-032d-48b1-b0ea-f7e717422ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:44.778941 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d626a5-032d-48b1-b0ea-f7e717422ad7 None admin] PATH_INFO: `/v3/users/46e5c6abf14644c180c042e458f17374` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:44.779700 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0acc44-79d2-425d-afbf-5806b80f75d5 None admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:44.780045 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0acc44-79d2-425d-afbf-5806b80f75d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:44.780387 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0acc44-79d2-425d-afbf-5806b80f75d5 None admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:44.781215 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0acc44-79d2-425d-afbf-5806b80f75d5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:44.782847 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0acc44-79d2-425d-afbf-5806b80f75d5 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:44.800658 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d626a5-032d-48b1-b0ea-f7e717422ad7 None admin] RBAC: Authorizing `identity:get_user(user_id=46e5c6abf14644c180c042e458f17374)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:44.802461 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d626a5-032d-48b1-b0ea-f7e717422ad7 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:44.805739 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 51/105] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:37:44 2022] GET /identity/v3/users/46e5c6abf14644c180c042e458f17374 => generated 289 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:44.812072 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d626a5-032d-48b1-b0ea-f7e717422ad7 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:44.843808 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 55/106] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Oct 28 20:37:44 2022] POST /identity/v3/projects => generated 302 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:37:45.049647 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d626a5-032d-48b1-b0ea-f7e717422ad7 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:45.121533 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c284619-0849-4e84-997f-c64b482ad2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:45.122657 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c284619-0849-4e84-997f-c64b482ad2f3 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:45.123156 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c284619-0849-4e84-997f-c64b482ad2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:45.123640 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c284619-0849-4e84-997f-c64b482ad2f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:45.245475 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb2976-28e6-44b8-b8fc-2e487567c771 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:45.245987 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb2976-28e6-44b8-b8fc-2e487567c771 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:45.246060 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb2976-28e6-44b8-b8fc-2e487567c771 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:45.248194 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 56/107] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:37:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:37:45.254555 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed138f5b-8c55-4c56-ad5e-7eb386f47ca9 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:45.254870 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed138f5b-8c55-4c56-ad5e-7eb386f47ca9 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:45.255111 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed138f5b-8c55-4c56-ad5e-7eb386f47ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:45.274705 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c284619-0849-4e84-997f-c64b482ad2f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:45.277634 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c284619-0849-4e84-997f-c64b482ad2f3 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:45.307268 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-ed138f5b-8c55-4c56-ad5e-7eb386f47ca9 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:37:45.308462 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-ed138f5b-8c55-4c56-ad5e-7eb386f47ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:37:45.436457 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 57/108] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:37:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:37:45.471711 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 52/109] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:37:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 20:37:45.480493 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed138f5b-8c55-4c56-ad5e-7eb386f47ca9 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:45.488115 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c284619-0849-4e84-997f-c64b482ad2f3 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:45.652592 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed138f5b-8c55-4c56-ad5e-7eb386f47ca9 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:45.680598 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c284619-0849-4e84-997f-c64b482ad2f3 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:45.698557 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e57b3e-cb59-4f1d-8113-e0bdbb28a7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:45.699444 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e57b3e-cb59-4f1d-8113-e0bdbb28a7d3 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:45.699722 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e57b3e-cb59-4f1d-8113-e0bdbb28a7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:45.700023 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e57b3e-cb59-4f1d-8113-e0bdbb28a7d3 None admin] PATH_INFO: `/v3/projects/7651e6b03b65497ab11181afb4e27ca6` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:45.704745 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e57b3e-cb59-4f1d-8113-e0bdbb28a7d3 None admin] RBAC: Authorizing `identity:get_project(project_id=7651e6b03b65497ab11181afb4e27ca6)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:45.706310 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e57b3e-cb59-4f1d-8113-e0bdbb28a7d3 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:45.708333 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 58/110] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:37:45 2022] GET /identity/v3/projects/7651e6b03b65497ab11181afb4e27ca6 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:45.715538 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e57b3e-cb59-4f1d-8113-e0bdbb28a7d3 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:45.757369 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b3016-0f41-4971-bee4-c730e2a9b3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:45.759174 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b3016-0f41-4971-bee4-c730e2a9b3a3 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:45.759966 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b3016-0f41-4971-bee4-c730e2a9b3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:45.760722 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b3016-0f41-4971-bee4-c730e2a9b3a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:45.789959 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b3016-0f41-4971-bee4-c730e2a9b3a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:37:45.816238 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-2f3b3016-0f41-4971-bee4-c730e2a9b3a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 20:37:45.819243 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 53/111] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 20:37:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:37:45.828783 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b3016-0f41-4971-bee4-c730e2a9b3a3 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:45.842138 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e57b3e-cb59-4f1d-8113-e0bdbb28a7d3 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:45.889660 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7443b2-18ee-49d9-b5c4-3584c273c7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:45.890346 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7443b2-18ee-49d9-b5c4-3584c273c7d7 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:45.890633 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7443b2-18ee-49d9-b5c4-3584c273c7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:45.890906 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7443b2-18ee-49d9-b5c4-3584c273c7d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:45.891781 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7443b2-18ee-49d9-b5c4-3584c273c7d7 None admin] RBAC: Adding query filter params (role.id=a5a6a249ab1f472e93ce008d03b41039, scope.project.id=7651e6b03b65497ab11181afb4e27ca6, user.id=46e5c6abf14644c180c042e458f17374) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:37:45.892120 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7443b2-18ee-49d9-b5c4-3584c273c7d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:45.893626 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7443b2-18ee-49d9-b5c4-3584c273c7d7 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:45.906158 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 59/112] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:37:45 2022] GET /identity/v3/role_assignments?user.id=46e5c6abf14644c180c042e458f17374&scope.project.id=7651e6b03b65497ab11181afb4e27ca6&role.id=a5a6a249ab1f472e93ce008d03b41039 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:37:46.045725 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b3016-0f41-4971-bee4-c730e2a9b3a3 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:46.116754 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7d615-c230-434d-9674-6dbd23f18825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:46.119006 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7d615-c230-434d-9674-6dbd23f18825 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:46.119783 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7d615-c230-434d-9674-6dbd23f18825 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:46.120510 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7d615-c230-434d-9674-6dbd23f18825 None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:46.122146 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7d615-c230-434d-9674-6dbd23f18825 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:37:46.122937 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7d615-c230-434d-9674-6dbd23f18825 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:46.125743 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7d615-c230-434d-9674-6dbd23f18825 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:46.147770 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 54/113] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:37:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:37:46.160518 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7443b2-18ee-49d9-b5c4-3584c273c7d7 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:46.266961 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cfb275-20fb-46a1-9ea1-d69d3c80c2f6 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:46.267823 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cfb275-20fb-46a1-9ea1-d69d3c80c2f6 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:46.268580 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cfb275-20fb-46a1-9ea1-d69d3c80c2f6 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:46.276480 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 55/114] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:37:46 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:37:46.286173 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7683f32-a3a8-4bb5-a7dd-a9bdc7e36429 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:46.287905 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7683f32-a3a8-4bb5-a7dd-a9bdc7e36429 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:46.288655 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7683f32-a3a8-4bb5-a7dd-a9bdc7e36429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:46.341599 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-c7683f32-a3a8-4bb5-a7dd-a9bdc7e36429 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:37:46.344159 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-c7683f32-a3a8-4bb5-a7dd-a9bdc7e36429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:37:46.374829 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7443b2-18ee-49d9-b5c4-3584c273c7d7 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:46.437875 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636a1e1-6640-4fdc-b94c-b5a2214b9ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:46.439280 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636a1e1-6640-4fdc-b94c-b5a2214b9ae6 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:46.439812 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636a1e1-6640-4fdc-b94c-b5a2214b9ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:46.440316 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636a1e1-6640-4fdc-b94c-b5a2214b9ae6 None admin] PATH_INFO: `/v3/users/57b0953dcb104303876815cf22027f50` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:46.442455 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636a1e1-6640-4fdc-b94c-b5a2214b9ae6 None admin] RBAC: Authorizing `identity:get_user(user_id=57b0953dcb104303876815cf22027f50)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:46.445832 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636a1e1-6640-4fdc-b94c-b5a2214b9ae6 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:46.450180 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 60/115] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:37:46 2022] GET /identity/v3/users/57b0953dcb104303876815cf22027f50 => generated 247 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:46.462229 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636a1e1-6640-4fdc-b94c-b5a2214b9ae6 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:46.512872 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 56/116] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:37:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:37:46.558257 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7683f32-a3a8-4bb5-a7dd-a9bdc7e36429 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:46.664751 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636a1e1-6640-4fdc-b94c-b5a2214b9ae6 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:46.730118 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf85e8d-af96-4320-8784-b0bcaaea5f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:46.731001 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf85e8d-af96-4320-8784-b0bcaaea5f4a None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:46.731275 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf85e8d-af96-4320-8784-b0bcaaea5f4a None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:46.731552 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf85e8d-af96-4320-8784-b0bcaaea5f4a None admin] PATH_INFO: `/v3/projects/7651e6b03b65497ab11181afb4e27ca6` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:46.735268 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf85e8d-af96-4320-8784-b0bcaaea5f4a None admin] RBAC: Authorizing `identity:get_project(project_id=7651e6b03b65497ab11181afb4e27ca6)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:46.736853 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf85e8d-af96-4320-8784-b0bcaaea5f4a None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:46.738602 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 61/117] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:37:46 2022] GET /identity/v3/projects/7651e6b03b65497ab11181afb4e27ca6 => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:46.739890 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2c2ec-46ea-48b7-9f7b-93eff829bde7 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:46.740763 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2c2ec-46ea-48b7-9f7b-93eff829bde7 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:46.741013 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2c2ec-46ea-48b7-9f7b-93eff829bde7 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:46.752161 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 62/118] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:37:46 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:37:46.753607 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb18d2-8e2a-46a4-8592-45431cb110fd None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:46.753894 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb18d2-8e2a-46a4-8592-45431cb110fd None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:46.754171 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb18d2-8e2a-46a4-8592-45431cb110fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:46.769607 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7683f32-a3a8-4bb5-a7dd-a9bdc7e36429 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:46.783259 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-77bb18d2-8e2a-46a4-8592-45431cb110fd None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:37:46.784515 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-77bb18d2-8e2a-46a4-8592-45431cb110fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:37:46.837967 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9e950-1171-483c-a06f-0f08ae379a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:46.839361 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9e950-1171-483c-a06f-0f08ae379a27 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:46.839909 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9e950-1171-483c-a06f-0f08ae379a27 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:46.840413 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9e950-1171-483c-a06f-0f08ae379a27 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:46.887452 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e9e950-1171-483c-a06f-0f08ae379a27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:37:46.909066 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-f8e9e950-1171-483c-a06f-0f08ae379a27 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 20:37:46.911433 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 57/119] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:37:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:37:46.913975 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9e950-1171-483c-a06f-0f08ae379a27 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:46.953384 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 63/120] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:37:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:37:46.955355 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb18d2-8e2a-46a4-8592-45431cb110fd None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:47.169934 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9e950-1171-483c-a06f-0f08ae379a27 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:47.212594 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bb746-1097-4583-9fbc-04c0e5a779df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:47.212840 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb18d2-8e2a-46a4-8592-45431cb110fd None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:47.213869 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bb746-1097-4583-9fbc-04c0e5a779df None admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:47.214298 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bb746-1097-4583-9fbc-04c0e5a779df None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:47.214724 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bb746-1097-4583-9fbc-04c0e5a779df None admin] PATH_INFO: `/v3/projects/7651e6b03b65497ab11181afb4e27ca6/users/57b0953dcb104303876815cf22027f50/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:47.223555 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785bb746-1097-4583-9fbc-04c0e5a779df None admin] RBAC: Authorizing `identity:create_grant(project_id=7651e6b03b65497ab11181afb4e27ca6, user_id=57b0953dcb104303876815cf22027f50, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:47.225819 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785bb746-1097-4583-9fbc-04c0e5a779df None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:47.244265 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 58/121] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 20:37:46 2022] PUT /identity/v3/projects/7651e6b03b65497ab11181afb4e27ca6/users/57b0953dcb104303876815cf22027f50/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:37:47.245576 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bb746-1097-4583-9fbc-04c0e5a779df None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:47.279623 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a41be4-b8b4-4076-90ce-228cebc2c10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:47.281293 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a41be4-b8b4-4076-90ce-228cebc2c10c None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:47.282127 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a41be4-b8b4-4076-90ce-228cebc2c10c None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:47.282852 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a41be4-b8b4-4076-90ce-228cebc2c10c None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:47.285026 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a41be4-b8b4-4076-90ce-228cebc2c10c None admin] RBAC: Adding query filter params (name=member) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:37:47.285885 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a41be4-b8b4-4076-90ce-228cebc2c10c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:47.289881 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a41be4-b8b4-4076-90ce-228cebc2c10c None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:47.308764 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 64/122] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 20:37:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:47.312390 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f044b6-1666-40e7-825a-73129154f50a None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:47.313257 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f044b6-1666-40e7-825a-73129154f50a None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:47.314072 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f044b6-1666-40e7-825a-73129154f50a None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:47.319790 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 65/123] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:37:47 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:37:47.321851 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f044b6-1666-40e7-825a-73129154f50a None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:47.405350 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bb746-1097-4583-9fbc-04c0e5a779df None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:47.467155 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7d558-b966-4c0b-afec-89c580a7bd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:47.469134 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7d558-b966-4c0b-afec-89c580a7bd5f None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:47.469991 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7d558-b966-4c0b-afec-89c580a7bd5f None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:47.470794 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7d558-b966-4c0b-afec-89c580a7bd5f None admin] PATH_INFO: `/v3/roles/member` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:47.492865 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f044b6-1666-40e7-825a-73129154f50a None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:47.503954 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf7d558-b966-4c0b-afec-89c580a7bd5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:37:47.536178 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-2bf7d558-b966-4c0b-afec-89c580a7bd5f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 20:37:47.542527 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 59/124] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:37:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:37:47.548364 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9bc45-929f-4f6a-98a4-2ad4489f5935 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:47.549230 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9bc45-929f-4f6a-98a4-2ad4489f5935 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:47.551418 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9bc45-929f-4f6a-98a4-2ad4489f5935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:47.584649 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-6fc9bc45-929f-4f6a-98a4-2ad4489f5935 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:37:47.587797 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-6fc9bc45-929f-4f6a-98a4-2ad4489f5935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:37:47.602937 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d68a12-6917-44c7-84cd-33dba9c5b9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:47.603869 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d68a12-6917-44c7-84cd-33dba9c5b9ed None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:47.604153 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d68a12-6917-44c7-84cd-33dba9c5b9ed None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:47.604427 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d68a12-6917-44c7-84cd-33dba9c5b9ed None admin] PATH_INFO: `/v3/users/4041574dcab14bf1acdf530a63ba0554` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:47.610772 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d68a12-6917-44c7-84cd-33dba9c5b9ed None admin] RBAC: Authorizing `identity:get_user(user_id=4041574dcab14bf1acdf530a63ba0554)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:47.612346 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d68a12-6917-44c7-84cd-33dba9c5b9ed None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:47.619794 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 66/125] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:37:47 2022] GET /identity/v3/users/4041574dcab14bf1acdf530a63ba0554 => generated 275 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:47.619794 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d68a12-6917-44c7-84cd-33dba9c5b9ed None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:47.749882 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 60/126] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:37:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:37:47.756385 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9bc45-929f-4f6a-98a4-2ad4489f5935 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:47.875779 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d68a12-6917-44c7-84cd-33dba9c5b9ed None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:47.948339 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07041ca9-0055-4ffe-b66c-bc454d1f3bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:47.949517 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07041ca9-0055-4ffe-b66c-bc454d1f3bda None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:47.950004 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07041ca9-0055-4ffe-b66c-bc454d1f3bda None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:47.950487 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07041ca9-0055-4ffe-b66c-bc454d1f3bda None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:47.951947 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07041ca9-0055-4ffe-b66c-bc454d1f3bda None admin] RBAC: Adding query filter params (name=member) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:37:47.952500 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07041ca9-0055-4ffe-b66c-bc454d1f3bda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:47.961514 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07041ca9-0055-4ffe-b66c-bc454d1f3bda None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:47.992627 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 67/127] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 20:37:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:47.994101 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07041ca9-0055-4ffe-b66c-bc454d1f3bda None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:48.032874 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9bc45-929f-4f6a-98a4-2ad4489f5935 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:48.096961 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a74688-ae87-41a5-9223-75586fe2dc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:48.098520 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a74688-ae87-41a5-9223-75586fe2dc2d None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:48.099052 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a74688-ae87-41a5-9223-75586fe2dc2d None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:48.100627 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a74688-ae87-41a5-9223-75586fe2dc2d None admin] PATH_INFO: `/v3/projects/5d0663efa51942c4928fc87312753a7b` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:48.105344 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a74688-ae87-41a5-9223-75586fe2dc2d None admin] RBAC: Authorizing `identity:get_project(project_id=5d0663efa51942c4928fc87312753a7b)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:48.110482 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a74688-ae87-41a5-9223-75586fe2dc2d None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:48.115676 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 61/128] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:37:47 2022] GET /identity/v3/projects/5d0663efa51942c4928fc87312753a7b => generated 312 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:48.117077 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a74688-ae87-41a5-9223-75586fe2dc2d None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:48.328244 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07041ca9-0055-4ffe-b66c-bc454d1f3bda None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:48.414045 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a74688-ae87-41a5-9223-75586fe2dc2d None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:48.454216 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58820737-4b91-4c17-9660-5cfa6a4740db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:48.455550 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58820737-4b91-4c17-9660-5cfa6a4740db None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:48.456051 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58820737-4b91-4c17-9660-5cfa6a4740db None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:48.456527 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58820737-4b91-4c17-9660-5cfa6a4740db None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:48.494736 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58820737-4b91-4c17-9660-5cfa6a4740db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:37:48.514799 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeeac79-a7ef-427f-b2d5-a8f70ccb67a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:48.516789 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeeac79-a7ef-427f-b2d5-a8f70ccb67a4 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:48.524530 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeeac79-a7ef-427f-b2d5-a8f70ccb67a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:48.525414 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeeac79-a7ef-427f-b2d5-a8f70ccb67a4 None admin] PATH_INFO: `/v3/users/4041574dcab14bf1acdf530a63ba0554` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:48.528166 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeeac79-a7ef-427f-b2d5-a8f70ccb67a4 None admin] RBAC: Authorizing `identity:get_user(user_id=4041574dcab14bf1acdf530a63ba0554)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:48.531485 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeeac79-a7ef-427f-b2d5-a8f70ccb67a4 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:48.532448 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-58820737-4b91-4c17-9660-5cfa6a4740db None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 20:37:48.536474 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 68/129] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 20:37:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 543 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:37:48.541430 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58820737-4b91-4c17-9660-5cfa6a4740db None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:48.542409 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 62/130] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:37:48 2022] GET /identity/v3/users/4041574dcab14bf1acdf530a63ba0554 => generated 275 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:48.546898 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeeac79-a7ef-427f-b2d5-a8f70ccb67a4 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:48.759248 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeeac79-a7ef-427f-b2d5-a8f70ccb67a4 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:48.831015 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d1bd2-0960-4cc4-9ec1-858dfee77397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:48.832002 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d1bd2-0960-4cc4-9ec1-858dfee77397 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:48.832459 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d1bd2-0960-4cc4-9ec1-858dfee77397 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:48.832887 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d1bd2-0960-4cc4-9ec1-858dfee77397 None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:48.836174 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d1bd2-0960-4cc4-9ec1-858dfee77397 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:37:48.836647 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d1bd2-0960-4cc4-9ec1-858dfee77397 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:48.839313 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d1bd2-0960-4cc4-9ec1-858dfee77397 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:48.862466 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58820737-4b91-4c17-9660-5cfa6a4740db None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:48.875251 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 63/131] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:37:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:37:48.877210 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d1bd2-0960-4cc4-9ec1-858dfee77397 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:48.942298 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7d920-6507-4eb4-8529-a65718c5d319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:48.944856 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7d920-6507-4eb4-8529-a65718c5d319 None admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:48.945371 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7d920-6507-4eb4-8529-a65718c5d319 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:48.945905 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7d920-6507-4eb4-8529-a65718c5d319 None admin] PATH_INFO: `/v3/projects/5d0663efa51942c4928fc87312753a7b/users/4041574dcab14bf1acdf530a63ba0554/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:48.950010 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7d920-6507-4eb4-8529-a65718c5d319 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d0663efa51942c4928fc87312753a7b, user_id=4041574dcab14bf1acdf530a63ba0554, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:48.952936 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7d920-6507-4eb4-8529-a65718c5d319 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:48.984376 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 69/132] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 20:37:48 2022] PUT /identity/v3/projects/5d0663efa51942c4928fc87312753a7b/users/4041574dcab14bf1acdf530a63ba0554/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:37:48.988387 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7d920-6507-4eb4-8529-a65718c5d319 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:49.129976 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d1bd2-0960-4cc4-9ec1-858dfee77397 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:49.231788 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7d920-6507-4eb4-8529-a65718c5d319 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:49.236997 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840addf-ce50-4dcf-8b10-6b4af64b2a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:49.238475 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840addf-ce50-4dcf-8b10-6b4af64b2a8f None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:49.238950 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840addf-ce50-4dcf-8b10-6b4af64b2a8f None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:49.239423 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840addf-ce50-4dcf-8b10-6b4af64b2a8f None admin] PATH_INFO: `/v3/projects/7651e6b03b65497ab11181afb4e27ca6` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:49.249283 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c840addf-ce50-4dcf-8b10-6b4af64b2a8f None admin] RBAC: Authorizing `identity:get_project(project_id=7651e6b03b65497ab11181afb4e27ca6)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:49.252156 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c840addf-ce50-4dcf-8b10-6b4af64b2a8f None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:49.255441 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 64/133] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:37:48 2022] GET /identity/v3/projects/7651e6b03b65497ab11181afb4e27ca6 => generated 298 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:49.258246 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0a418-f1b5-4bfd-987b-af922bcd2bbb None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:49.258730 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0a418-f1b5-4bfd-987b-af922bcd2bbb None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:49.259218 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0a418-f1b5-4bfd-987b-af922bcd2bbb None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:49.272088 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 65/134] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:37:49 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:37:49.273095 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0a418-f1b5-4bfd-987b-af922bcd2bbb None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:49.301862 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237adcc1-45dd-477c-b847-e45ea199e906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:49.305328 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237adcc1-45dd-477c-b847-e45ea199e906 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:49.305819 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237adcc1-45dd-477c-b847-e45ea199e906 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:49.306371 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237adcc1-45dd-477c-b847-e45ea199e906 None admin] PATH_INFO: `/v3/users/4041574dcab14bf1acdf530a63ba0554` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:49.311253 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237adcc1-45dd-477c-b847-e45ea199e906 None admin] RBAC: Authorizing `identity:get_user(user_id=4041574dcab14bf1acdf530a63ba0554)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:49.314141 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237adcc1-45dd-477c-b847-e45ea199e906 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:49.317829 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 70/135] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:37:48 2022] GET /identity/v3/users/4041574dcab14bf1acdf530a63ba0554 => generated 275 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:49.325696 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851e6a4-b8d0-45da-89f1-ba7bd420bbf5 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:49.326074 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851e6a4-b8d0-45da-89f1-ba7bd420bbf5 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:49.326543 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851e6a4-b8d0-45da-89f1-ba7bd420bbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:49.361434 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-2851e6a4-b8d0-45da-89f1-ba7bd420bbf5 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:37:49.363577 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-2851e6a4-b8d0-45da-89f1-ba7bd420bbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:37:49.441569 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0a418-f1b5-4bfd-987b-af922bcd2bbb None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:49.492632 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358084f6-89ff-4709-846f-134954be6ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:49.493560 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358084f6-89ff-4709-846f-134954be6ef2 None admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:49.493843 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358084f6-89ff-4709-846f-134954be6ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:49.494117 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358084f6-89ff-4709-846f-134954be6ef2 None admin] PATH_INFO: `/v3/projects/7651e6b03b65497ab11181afb4e27ca6/users/4041574dcab14bf1acdf530a63ba0554/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:49.496327 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358084f6-89ff-4709-846f-134954be6ef2 None admin] RBAC: Authorizing `identity:create_grant(project_id=7651e6b03b65497ab11181afb4e27ca6, user_id=4041574dcab14bf1acdf530a63ba0554, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:49.497798 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358084f6-89ff-4709-846f-134954be6ef2 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:49.507244 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 71/136] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:37:49.508836 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851e6a4-b8d0-45da-89f1-ba7bd420bbf5 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:49.530009 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 66/137] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 20:37:49 2022] PUT /identity/v3/projects/7651e6b03b65497ab11181afb4e27ca6/users/4041574dcab14bf1acdf530a63ba0554/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:37:49.581231 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358084f6-89ff-4709-846f-134954be6ef2 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:49.641238 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851e6a4-b8d0-45da-89f1-ba7bd420bbf5 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:49.680947 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f641da5-4233-4524-a925-deae77739041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:49.681823 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f641da5-4233-4524-a925-deae77739041 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:49.682105 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f641da5-4233-4524-a925-deae77739041 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:49.682446 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f641da5-4233-4524-a925-deae77739041 None admin] PATH_INFO: `/v3/projects/7651e6b03b65497ab11181afb4e27ca6` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:49.683840 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f641da5-4233-4524-a925-deae77739041 None admin] RBAC: Authorizing `identity:get_project(project_id=7651e6b03b65497ab11181afb4e27ca6)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:49.685396 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f641da5-4233-4524-a925-deae77739041 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:49.687581 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 72/138] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:37:49 2022] GET /identity/v3/projects/7651e6b03b65497ab11181afb4e27ca6 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:49.694081 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f641da5-4233-4524-a925-deae77739041 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:49.806164 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f641da5-4233-4524-a925-deae77739041 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:49.844076 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb268414-51b2-409e-a63a-89e0c4bbd6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:49.845098 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb268414-51b2-409e-a63a-89e0c4bbd6f2 None admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:49.845393 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb268414-51b2-409e-a63a-89e0c4bbd6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:49.845626 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb268414-51b2-409e-a63a-89e0c4bbd6f2 None admin] PATH_INFO: `/v3/projects/7651e6b03b65497ab11181afb4e27ca6/users/4041574dcab14bf1acdf530a63ba0554/roles/28b8756191f44cadbdae28d1af156b6c` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:49.847958 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb268414-51b2-409e-a63a-89e0c4bbd6f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=7651e6b03b65497ab11181afb4e27ca6, user_id=4041574dcab14bf1acdf530a63ba0554, role_id=28b8756191f44cadbdae28d1af156b6c)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:49.850052 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb268414-51b2-409e-a63a-89e0c4bbd6f2 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:49.878800 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 73/139] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 20:37:49 2022] PUT /identity/v3/projects/7651e6b03b65497ab11181afb4e27ca6/users/4041574dcab14bf1acdf530a63ba0554/roles/28b8756191f44cadbdae28d1af156b6c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:37:49.885173 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358084f6-89ff-4709-846f-134954be6ef2 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:49.968829 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5255d7-6a70-4b47-ac90-48eba06cf913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:49.969709 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5255d7-6a70-4b47-ac90-48eba06cf913 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:49.970071 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5255d7-6a70-4b47-ac90-48eba06cf913 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:49.970394 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5255d7-6a70-4b47-ac90-48eba06cf913 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:49.972012 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5255d7-6a70-4b47-ac90-48eba06cf913 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:49.973660 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5255d7-6a70-4b47-ac90-48eba06cf913 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:49.976954 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 67/140] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:37:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:37:49.983971 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb268414-51b2-409e-a63a-89e0c4bbd6f2 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:50.098835 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb268414-51b2-409e-a63a-89e0c4bbd6f2 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:50.142304 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd28b1-1118-43fa-a783-bb06a8b513bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:50.142989 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd28b1-1118-43fa-a783-bb06a8b513bb None admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:50.143269 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd28b1-1118-43fa-a783-bb06a8b513bb None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:50.143539 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd28b1-1118-43fa-a783-bb06a8b513bb None admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:50.144307 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd28b1-1118-43fa-a783-bb06a8b513bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:50.145762 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd28b1-1118-43fa-a783-bb06a8b513bb None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:50.175752 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 74/141] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Oct 28 20:37:49 2022] POST /identity/v3/users => generated 283 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:37:50.468027 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941832df-56d8-498f-80a8-1adba3345d7b None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:50.468570 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941832df-56d8-498f-80a8-1adba3345d7b None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:50.468570 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941832df-56d8-498f-80a8-1adba3345d7b None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:50.470869 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 68/142] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:37:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:37:50.477292 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c85dcd-2ef8-431d-8ed5-7d78930e6b5a None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:50.477566 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c85dcd-2ef8-431d-8ed5-7d78930e6b5a None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:50.477769 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c85dcd-2ef8-431d-8ed5-7d78930e6b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:50.501637 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-b0c85dcd-2ef8-431d-8ed5-7d78930e6b5a None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:37:50.502861 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-b0c85dcd-2ef8-431d-8ed5-7d78930e6b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:37:50.594039 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 75/143] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:37:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:37:50.630078 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941832df-56d8-498f-80a8-1adba3345d7b None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:50.823294 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941832df-56d8-498f-80a8-1adba3345d7b None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:50.895064 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580532fe-ddb9-42d8-9fef-8925d4b0d9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:50.897044 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580532fe-ddb9-42d8-9fef-8925d4b0d9a3 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:50.897555 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580532fe-ddb9-42d8-9fef-8925d4b0d9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:50.898051 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580532fe-ddb9-42d8-9fef-8925d4b0d9a3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:50.925462 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580532fe-ddb9-42d8-9fef-8925d4b0d9a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:37:50.939329 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-580532fe-ddb9-42d8-9fef-8925d4b0d9a3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 20:37:50.941688 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 69/144] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:37:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:37:50.948848 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c85dcd-2ef8-431d-8ed5-7d78930e6b5a None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:51.155585 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c85dcd-2ef8-431d-8ed5-7d78930e6b5a None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:51.229301 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed305ed1-1e04-414c-b743-143a43ef651e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:51.230332 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed305ed1-1e04-414c-b743-143a43ef651e None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:51.230755 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed305ed1-1e04-414c-b743-143a43ef651e None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:51.231188 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed305ed1-1e04-414c-b743-143a43ef651e None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:51.232607 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed305ed1-1e04-414c-b743-143a43ef651e None admin] RBAC: Adding query filter params (name=reader) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:37:51.233083 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed305ed1-1e04-414c-b743-143a43ef651e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:51.235447 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed305ed1-1e04-414c-b743-143a43ef651e None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:51.251226 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 76/145] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 20:37:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:51.258422 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580532fe-ddb9-42d8-9fef-8925d4b0d9a3 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:51.278062 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7241cc-8df0-4255-872e-25d763e246db None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:51.278062 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7241cc-8df0-4255-872e-25d763e246db None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:51.278062 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7241cc-8df0-4255-872e-25d763e246db None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:51.280408 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 77/146] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:37:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:37:51.290741 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4b899-3702-4b7a-a9fd-c6d8e2a26e40 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:51.291187 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4b899-3702-4b7a-a9fd-c6d8e2a26e40 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:51.291618 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4b899-3702-4b7a-a9fd-c6d8e2a26e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:51.329620 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-a0e4b899-3702-4b7a-a9fd-c6d8e2a26e40 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:37:51.330838 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-a0e4b899-3702-4b7a-a9fd-c6d8e2a26e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:37:51.418604 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580532fe-ddb9-42d8-9fef-8925d4b0d9a3 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:51.458170 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bf547-51c2-4776-95fc-0d17626a29ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:51.459990 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bf547-51c2-4776-95fc-0d17626a29ca None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:51.460502 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bf547-51c2-4776-95fc-0d17626a29ca None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:51.460972 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bf547-51c2-4776-95fc-0d17626a29ca None admin] PATH_INFO: `/v3/users/46e5c6abf14644c180c042e458f17374` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:51.462580 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67bf547-51c2-4776-95fc-0d17626a29ca None admin] RBAC: Authorizing `identity:get_user(user_id=46e5c6abf14644c180c042e458f17374)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:51.464366 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67bf547-51c2-4776-95fc-0d17626a29ca None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:51.466631 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 70/147] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:37:51 2022] GET /identity/v3/users/46e5c6abf14644c180c042e458f17374 => generated 289 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:51.472503 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bf547-51c2-4776-95fc-0d17626a29ca None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:51.502528 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 78/148] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:37:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:37:51.551289 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4b899-3702-4b7a-a9fd-c6d8e2a26e40 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:51.655644 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bf547-51c2-4776-95fc-0d17626a29ca None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:51.742715 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c8b5e-3347-4248-b7d7-d9dcbbe6c028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:51.744396 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c8b5e-3347-4248-b7d7-d9dcbbe6c028 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:51.744894 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c8b5e-3347-4248-b7d7-d9dcbbe6c028 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:51.745390 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c8b5e-3347-4248-b7d7-d9dcbbe6c028 None admin] PATH_INFO: `/v3/projects/7651e6b03b65497ab11181afb4e27ca6` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:51.748779 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c8b5e-3347-4248-b7d7-d9dcbbe6c028 None admin] RBAC: Authorizing `identity:get_project(project_id=7651e6b03b65497ab11181afb4e27ca6)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:51.750304 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c8b5e-3347-4248-b7d7-d9dcbbe6c028 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:51.753139 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 71/149] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:37:51 2022] GET /identity/v3/projects/7651e6b03b65497ab11181afb4e27ca6 => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:51.758351 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c8b5e-3347-4248-b7d7-d9dcbbe6c028 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:51.806804 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4b899-3702-4b7a-a9fd-c6d8e2a26e40 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:51.889997 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd208eb1-d37b-4f4b-9fb4-aa5401d2973b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:51.890817 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd208eb1-d37b-4f4b-9fb4-aa5401d2973b None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:51.891102 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd208eb1-d37b-4f4b-9fb4-aa5401d2973b None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:51.891377 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd208eb1-d37b-4f4b-9fb4-aa5401d2973b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:51.920757 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd208eb1-d37b-4f4b-9fb4-aa5401d2973b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:37:51.928794 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-fd208eb1-d37b-4f4b-9fb4-aa5401d2973b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 20:37:51.930277 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 79/150] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 20:37:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:37:51.936357 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd208eb1-d37b-4f4b-9fb4-aa5401d2973b None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:51.988194 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c8b5e-3347-4248-b7d7-d9dcbbe6c028 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:52.054799 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012643d-8ac6-415f-b728-49a889135723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:52.055604 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012643d-8ac6-415f-b728-49a889135723 None admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:52.055927 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012643d-8ac6-415f-b728-49a889135723 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:52.056210 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012643d-8ac6-415f-b728-49a889135723 None admin] PATH_INFO: `/v3/projects/7651e6b03b65497ab11181afb4e27ca6/users/46e5c6abf14644c180c042e458f17374/roles/a5a6a249ab1f472e93ce008d03b41039` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:52.059882 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012643d-8ac6-415f-b728-49a889135723 None admin] RBAC: Authorizing `identity:create_grant(project_id=7651e6b03b65497ab11181afb4e27ca6, user_id=46e5c6abf14644c180c042e458f17374, role_id=a5a6a249ab1f472e93ce008d03b41039)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:52.061379 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012643d-8ac6-415f-b728-49a889135723 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:52.098403 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 72/151] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 20:37:51 2022] PUT /identity/v3/projects/7651e6b03b65497ab11181afb4e27ca6/users/46e5c6abf14644c180c042e458f17374/roles/a5a6a249ab1f472e93ce008d03b41039 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:37:52.128795 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd208eb1-d37b-4f4b-9fb4-aa5401d2973b None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:52.170302 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec20351-a614-497f-ba53-bc354622cc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:52.171024 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec20351-a614-497f-ba53-bc354622cc9f None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:52.171313 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec20351-a614-497f-ba53-bc354622cc9f None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:52.171594 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec20351-a614-497f-ba53-bc354622cc9f None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:52.172479 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec20351-a614-497f-ba53-bc354622cc9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:37:52.172800 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec20351-a614-497f-ba53-bc354622cc9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:52.174349 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec20351-a614-497f-ba53-bc354622cc9f None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:52.187617 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 80/152] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:37:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:37:52.194168 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012643d-8ac6-415f-b728-49a889135723 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:52.317270 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012643d-8ac6-415f-b728-49a889135723 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:52.363616 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafdd546-b0b7-4cf4-941f-c15a6ebced3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:52.364548 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdd546-b0b7-4cf4-941f-c15a6ebced3a None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:52.364882 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdd546-b0b7-4cf4-941f-c15a6ebced3a None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:52.365163 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdd546-b0b7-4cf4-941f-c15a6ebced3a None admin] PATH_INFO: `/v3/users/57b0953dcb104303876815cf22027f50` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:52.366516 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafdd546-b0b7-4cf4-941f-c15a6ebced3a None admin] RBAC: Authorizing `identity:get_user(user_id=57b0953dcb104303876815cf22027f50)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:52.368116 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafdd546-b0b7-4cf4-941f-c15a6ebced3a None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:52.369900 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 73/153] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:37:52 2022] GET /identity/v3/users/57b0953dcb104303876815cf22027f50 => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:52.375786 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec20351-a614-497f-ba53-bc354622cc9f None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:52.486229 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec20351-a614-497f-ba53-bc354622cc9f None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:52.532662 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0e77a-e4b0-46e1-b968-30eab743a547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:52.533331 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0e77a-e4b0-46e1-b968-30eab743a547 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:52.533621 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0e77a-e4b0-46e1-b968-30eab743a547 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:52.533901 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0e77a-e4b0-46e1-b968-30eab743a547 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:52.627094 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0e77a-e4b0-46e1-b968-30eab743a547 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:52.628536 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0e77a-e4b0-46e1-b968-30eab743a547 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:52.743942 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 81/154] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:37:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:52.749229 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafdd546-b0b7-4cf4-941f-c15a6ebced3a None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:52.917981 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafdd546-b0b7-4cf4-941f-c15a6ebced3a None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:52.988818 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed72cf5-781e-4848-ae3a-8fc2c2233c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:52.990828 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed72cf5-781e-4848-ae3a-8fc2c2233c19 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:52.991616 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed72cf5-781e-4848-ae3a-8fc2c2233c19 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:52.992431 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed72cf5-781e-4848-ae3a-8fc2c2233c19 None admin] PATH_INFO: `/v3/projects/7651e6b03b65497ab11181afb4e27ca6` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:53.001555 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed72cf5-781e-4848-ae3a-8fc2c2233c19 None admin] RBAC: Authorizing `identity:get_project(project_id=7651e6b03b65497ab11181afb4e27ca6)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:53.004899 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed72cf5-781e-4848-ae3a-8fc2c2233c19 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:53.008461 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 74/155] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:37:52 2022] GET /identity/v3/projects/7651e6b03b65497ab11181afb4e27ca6 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:53.014349 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0e77a-e4b0-46e1-b968-30eab743a547 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:53.135888 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747c452-b138-4535-9498-22faa097e6d8 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:53.136934 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747c452-b138-4535-9498-22faa097e6d8 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:53.137693 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747c452-b138-4535-9498-22faa097e6d8 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:53.141125 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 75/156] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:37:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:37:53.150307 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef5afb-33f5-43c4-b5bc-64c506187162 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:53.151093 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef5afb-33f5-43c4-b5bc-64c506187162 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:53.151795 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef5afb-33f5-43c4-b5bc-64c506187162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:53.152468 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0e77a-e4b0-46e1-b968-30eab743a547 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:53.200751 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe39f8-90dc-4687-b999-6f23e81af221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:53.201305 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe39f8-90dc-4687-b999-6f23e81af221 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:53.201574 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe39f8-90dc-4687-b999-6f23e81af221 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:53.201850 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe39f8-90dc-4687-b999-6f23e81af221 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:53.202687 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe39f8-90dc-4687-b999-6f23e81af221 None admin] RBAC: Adding query filter params (role.id=8fe105eeb7bf4856a94b0633bd781414, scope.project.id=7651e6b03b65497ab11181afb4e27ca6, user.id=57b0953dcb104303876815cf22027f50) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:37:53.202998 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe39f8-90dc-4687-b999-6f23e81af221 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:53.204504 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe39f8-90dc-4687-b999-6f23e81af221 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:53.211335 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 82/157] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:37:53 2022] GET /identity/v3/role_assignments?user.id=57b0953dcb104303876815cf22027f50&scope.project.id=7651e6b03b65497ab11181afb4e27ca6&role.id=8fe105eeb7bf4856a94b0633bd781414 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:53.212297 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-ddef5afb-33f5-43c4-b5bc-64c506187162 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:37:53.214538 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-ddef5afb-33f5-43c4-b5bc-64c506187162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:37:53.381926 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 76/158] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:37:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:37:53.433810 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe39f8-90dc-4687-b999-6f23e81af221 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:53.575574 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe39f8-90dc-4687-b999-6f23e81af221 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:53.619171 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa084881-e488-4267-8e5a-c8c659839bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:53.620007 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa084881-e488-4267-8e5a-c8c659839bac None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:53.620279 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa084881-e488-4267-8e5a-c8c659839bac None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:53.620547 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa084881-e488-4267-8e5a-c8c659839bac None admin] PATH_INFO: `/v3/roles/member` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:53.634277 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa084881-e488-4267-8e5a-c8c659839bac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:37:53.641500 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-fa084881-e488-4267-8e5a-c8c659839bac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 20:37:53.642760 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 83/159] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:37:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:37:53.653073 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef5afb-33f5-43c4-b5bc-64c506187162 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:53.871807 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef5afb-33f5-43c4-b5bc-64c506187162 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:53.946909 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e86b9-2dcf-45fa-bc0c-cdfe07b63f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:53.947591 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e86b9-2dcf-45fa-bc0c-cdfe07b63f2b None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:53.947902 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e86b9-2dcf-45fa-bc0c-cdfe07b63f2b None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:53.948178 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e86b9-2dcf-45fa-bc0c-cdfe07b63f2b None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:53.948941 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e86b9-2dcf-45fa-bc0c-cdfe07b63f2b None admin] RBAC: Adding query filter params (name=member) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:37:53.949248 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e86b9-2dcf-45fa-bc0c-cdfe07b63f2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:53.950654 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e86b9-2dcf-45fa-bc0c-cdfe07b63f2b None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:53.963105 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 77/160] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 20:37:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:53.971949 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa084881-e488-4267-8e5a-c8c659839bac None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:54.119974 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa084881-e488-4267-8e5a-c8c659839bac None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:54.163878 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126dc6dd-b949-4233-9e9b-dc00a0153f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:54.164727 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126dc6dd-b949-4233-9e9b-dc00a0153f27 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:54.164978 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126dc6dd-b949-4233-9e9b-dc00a0153f27 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:54.165261 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126dc6dd-b949-4233-9e9b-dc00a0153f27 None admin] PATH_INFO: `/v3/users/4041574dcab14bf1acdf530a63ba0554` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:54.166537 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126dc6dd-b949-4233-9e9b-dc00a0153f27 None admin] RBAC: Authorizing `identity:get_user(user_id=4041574dcab14bf1acdf530a63ba0554)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:54.168020 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126dc6dd-b949-4233-9e9b-dc00a0153f27 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:54.169938 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 84/161] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:37:53 2022] GET /identity/v3/users/4041574dcab14bf1acdf530a63ba0554 => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:37:54.179268 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e86b9-2dcf-45fa-bc0c-cdfe07b63f2b None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:54.331277 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e86b9-2dcf-45fa-bc0c-cdfe07b63f2b None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:54.375347 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784cba7e-5b09-4455-8908-640352f40235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:54.376093 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784cba7e-5b09-4455-8908-640352f40235 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:54.376371 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784cba7e-5b09-4455-8908-640352f40235 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:54.376636 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784cba7e-5b09-4455-8908-640352f40235 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:54.461126 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784cba7e-5b09-4455-8908-640352f40235 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:54.462635 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784cba7e-5b09-4455-8908-640352f40235 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:54.586668 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 78/162] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:37:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:54.595113 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126dc6dd-b949-4233-9e9b-dc00a0153f27 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:54.645365 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d4464-2cbf-4b25-b027-3565880a071c None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:54.645688 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d4464-2cbf-4b25-b027-3565880a071c None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:54.646460 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d4464-2cbf-4b25-b027-3565880a071c None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:54.648557 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 79/163] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:37:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:37:54.656901 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8790c7b-b5a0-4cba-8f58-2b2db23d3556 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:54.657244 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8790c7b-b5a0-4cba-8f58-2b2db23d3556 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:54.657448 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8790c7b-b5a0-4cba-8f58-2b2db23d3556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:54.688880 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-f8790c7b-b5a0-4cba-8f58-2b2db23d3556 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:37:54.690098 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-f8790c7b-b5a0-4cba-8f58-2b2db23d3556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:37:54.744148 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126dc6dd-b949-4233-9e9b-dc00a0153f27 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:54.797888 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c7186-12fd-4de5-b42a-eecb97889ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:54.798770 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c7186-12fd-4de5-b42a-eecb97889ff2 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:54.799044 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c7186-12fd-4de5-b42a-eecb97889ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:54.799307 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c7186-12fd-4de5-b42a-eecb97889ff2 None admin] PATH_INFO: `/v3/projects/5d0663efa51942c4928fc87312753a7b` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:54.801520 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c7186-12fd-4de5-b42a-eecb97889ff2 None admin] RBAC: Authorizing `identity:get_project(project_id=5d0663efa51942c4928fc87312753a7b)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:54.803822 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c7186-12fd-4de5-b42a-eecb97889ff2 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:54.807357 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 85/164] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:37:54 2022] GET /identity/v3/projects/5d0663efa51942c4928fc87312753a7b => generated 312 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:54.818402 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c7186-12fd-4de5-b42a-eecb97889ff2 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:54.851344 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 80/165] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:37:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:37:54.923309 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8790c7b-b5a0-4cba-8f58-2b2db23d3556 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:54.981116 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c7186-12fd-4de5-b42a-eecb97889ff2 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:55.030206 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26515531-03c5-4d20-947e-4dc6c54c04a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:55.030877 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26515531-03c5-4d20-947e-4dc6c54c04a7 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:55.031158 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26515531-03c5-4d20-947e-4dc6c54c04a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:55.031429 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26515531-03c5-4d20-947e-4dc6c54c04a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:55.032348 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26515531-03c5-4d20-947e-4dc6c54c04a7 None admin] RBAC: Adding query filter params (role.id=aaafbf9fe78e46cd9f06410394fdb531, scope.project.id=5d0663efa51942c4928fc87312753a7b, user.id=4041574dcab14bf1acdf530a63ba0554) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:37:55.032656 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26515531-03c5-4d20-947e-4dc6c54c04a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:55.034220 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26515531-03c5-4d20-947e-4dc6c54c04a7 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:55.042105 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 86/166] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:37:54 2022] GET /identity/v3/role_assignments?user.id=4041574dcab14bf1acdf530a63ba0554&scope.project.id=5d0663efa51942c4928fc87312753a7b&role.id=aaafbf9fe78e46cd9f06410394fdb531 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:55.074936 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8790c7b-b5a0-4cba-8f58-2b2db23d3556 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:55.119586 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8830740-da9c-41fd-858b-dcdec226a29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:55.120446 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8830740-da9c-41fd-858b-dcdec226a29a None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:55.120729 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8830740-da9c-41fd-858b-dcdec226a29a None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:55.121001 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8830740-da9c-41fd-858b-dcdec226a29a None admin] PATH_INFO: `/v3/roles/member` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:55.132759 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8830740-da9c-41fd-858b-dcdec226a29a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:37:55.144343 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-f8830740-da9c-41fd-858b-dcdec226a29a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 20:37:55.145614 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 81/167] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:37:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:37:55.155843 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26515531-03c5-4d20-947e-4dc6c54c04a7 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:55.323919 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26515531-03c5-4d20-947e-4dc6c54c04a7 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:55.371569 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54abe0-b7aa-48fa-a921-d88d5e550b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:55.372290 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54abe0-b7aa-48fa-a921-d88d5e550b3c None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:55.372567 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54abe0-b7aa-48fa-a921-d88d5e550b3c None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:55.372836 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54abe0-b7aa-48fa-a921-d88d5e550b3c None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:55.373630 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54abe0-b7aa-48fa-a921-d88d5e550b3c None admin] RBAC: Adding query filter params (name=member) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:37:55.373992 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54abe0-b7aa-48fa-a921-d88d5e550b3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:55.375460 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54abe0-b7aa-48fa-a921-d88d5e550b3c None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:55.385404 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 87/168] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 20:37:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:55.394044 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8830740-da9c-41fd-858b-dcdec226a29a None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:55.548979 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8830740-da9c-41fd-858b-dcdec226a29a None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:55.601919 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f350d-819a-44f5-96b9-2161d90dfbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:55.602801 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f350d-819a-44f5-96b9-2161d90dfbc7 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:55.603693 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f350d-819a-44f5-96b9-2161d90dfbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:55.603693 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f350d-819a-44f5-96b9-2161d90dfbc7 None admin] PATH_INFO: `/v3/users/4041574dcab14bf1acdf530a63ba0554` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:55.604883 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f350d-819a-44f5-96b9-2161d90dfbc7 None admin] RBAC: Authorizing `identity:get_user(user_id=4041574dcab14bf1acdf530a63ba0554)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:55.606491 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f350d-819a-44f5-96b9-2161d90dfbc7 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:55.610745 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 82/169] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:37:55 2022] GET /identity/v3/users/4041574dcab14bf1acdf530a63ba0554 => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:55.620927 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54abe0-b7aa-48fa-a921-d88d5e550b3c None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:55.781948 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d43a10-a56c-4abb-9677-3944d25c39e3 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:55.782973 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d43a10-a56c-4abb-9677-3944d25c39e3 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:55.783795 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d43a10-a56c-4abb-9677-3944d25c39e3 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:55.792922 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 83/170] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:37:55 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:37:55.794507 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54abe0-b7aa-48fa-a921-d88d5e550b3c None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:55.799440 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f3cad-9eaf-4cc1-98fa-6a4b2cf490e3 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:55.800363 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f3cad-9eaf-4cc1-98fa-6a4b2cf490e3 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:55.801132 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f3cad-9eaf-4cc1-98fa-6a4b2cf490e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:55.839040 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8816bea-cff2-40cc-ad1e-bf4f13c1c4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:55.839697 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8816bea-cff2-40cc-ad1e-bf4f13c1c4dc None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:55.840004 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8816bea-cff2-40cc-ad1e-bf4f13c1c4dc None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:55.840277 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8816bea-cff2-40cc-ad1e-bf4f13c1c4dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:55.845884 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-b13f3cad-9eaf-4cc1-98fa-6a4b2cf490e3 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:37:55.848572 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-b13f3cad-9eaf-4cc1-98fa-6a4b2cf490e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:37:55.928115 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8816bea-cff2-40cc-ad1e-bf4f13c1c4dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:55.929552 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8816bea-cff2-40cc-ad1e-bf4f13c1c4dc None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:55.998070 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 84/171] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:37:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:37:56.057567 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f3cad-9eaf-4cc1-98fa-6a4b2cf490e3 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:56.099809 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 88/172] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:37:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:56.115058 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8816bea-cff2-40cc-ad1e-bf4f13c1c4dc None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:56.322927 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f3cad-9eaf-4cc1-98fa-6a4b2cf490e3 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:56.364221 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8816bea-cff2-40cc-ad1e-bf4f13c1c4dc None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:56.413711 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9a52c-b299-4dec-a6d2-d1c8c576f372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:56.414545 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9a52c-b299-4dec-a6d2-d1c8c576f372 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:56.414817 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9a52c-b299-4dec-a6d2-d1c8c576f372 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:56.415160 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9a52c-b299-4dec-a6d2-d1c8c576f372 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:56.438633 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e76e77-a82f-4a33-96c4-867b77c29539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:56.440164 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e76e77-a82f-4a33-96c4-867b77c29539 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:56.440689 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e76e77-a82f-4a33-96c4-867b77c29539 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:56.441124 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e76e77-a82f-4a33-96c4-867b77c29539 None admin] PATH_INFO: `/v3/projects/7651e6b03b65497ab11181afb4e27ca6` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:56.443806 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9a52c-b299-4dec-a6d2-d1c8c576f372 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:37:56.444353 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e76e77-a82f-4a33-96c4-867b77c29539 None admin] RBAC: Authorizing `identity:get_project(project_id=7651e6b03b65497ab11181afb4e27ca6)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:56.447161 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e76e77-a82f-4a33-96c4-867b77c29539 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:56.450548 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 89/173] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:37:56 2022] GET /identity/v3/projects/7651e6b03b65497ab11181afb4e27ca6 => generated 298 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:56.451456 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-01f9a52c-b299-4dec-a6d2-d1c8c576f372 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 20:37:56.452809 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ee65c-29c8-423a-9bf9-d1e71f663eac None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:56.453296 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ee65c-29c8-423a-9bf9-d1e71f663eac None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:56.453777 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ee65c-29c8-423a-9bf9-d1e71f663eac None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:56.457210 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 90/174] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:37:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:37:56.463357 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ee65c-29c8-423a-9bf9-d1e71f663eac None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:56.464404 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 85/175] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 20:37:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:37:56.470756 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de174d4-e88b-4737-abe2-8444479b3538 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:56.471210 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de174d4-e88b-4737-abe2-8444479b3538 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:56.471686 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de174d4-e88b-4737-abe2-8444479b3538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:56.526187 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-1de174d4-e88b-4737-abe2-8444479b3538 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:37:56.527274 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-1de174d4-e88b-4737-abe2-8444479b3538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:37:56.695321 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 86/176] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:37:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:37:56.695949 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de174d4-e88b-4737-abe2-8444479b3538 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:56.718590 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ee65c-29c8-423a-9bf9-d1e71f663eac None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:56.788960 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f4cf6-3203-4ee0-822b-4e0028919fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:56.789946 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f4cf6-3203-4ee0-822b-4e0028919fc9 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:56.790431 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f4cf6-3203-4ee0-822b-4e0028919fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:56.791826 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f4cf6-3203-4ee0-822b-4e0028919fc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:56.793477 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f4cf6-3203-4ee0-822b-4e0028919fc9 None admin] RBAC: Adding query filter params (role.id=aaafbf9fe78e46cd9f06410394fdb531, scope.project.id=7651e6b03b65497ab11181afb4e27ca6, user.id=4041574dcab14bf1acdf530a63ba0554) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:37:56.794020 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f4cf6-3203-4ee0-822b-4e0028919fc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:56.796923 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f4cf6-3203-4ee0-822b-4e0028919fc9 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:56.817739 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 91/177] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:37:56 2022] GET /identity/v3/role_assignments?user.id=4041574dcab14bf1acdf530a63ba0554&scope.project.id=7651e6b03b65497ab11181afb4e27ca6&role.id=aaafbf9fe78e46cd9f06410394fdb531 => generated 608 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:56.819191 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f4cf6-3203-4ee0-822b-4e0028919fc9 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:56.928507 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de174d4-e88b-4737-abe2-8444479b3538 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:56.976586 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6eeafb-6644-4fc3-b60a-953397c8ea5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:56.977290 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6eeafb-6644-4fc3-b60a-953397c8ea5e None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:56.977570 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6eeafb-6644-4fc3-b60a-953397c8ea5e None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:56.977842 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6eeafb-6644-4fc3-b60a-953397c8ea5e None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:56.979784 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6eeafb-6644-4fc3-b60a-953397c8ea5e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:37:56.979784 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6eeafb-6644-4fc3-b60a-953397c8ea5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:56.980386 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6eeafb-6644-4fc3-b60a-953397c8ea5e None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:56.995809 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 87/178] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:37:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:57.001767 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6eeafb-6644-4fc3-b60a-953397c8ea5e None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:57.125349 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6eeafb-6644-4fc3-b60a-953397c8ea5e None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:57.168768 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f4cf6-3203-4ee0-822b-4e0028919fc9 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:57.172439 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4db599-bee5-42c8-99fd-9dd1eeed70e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:57.172439 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4db599-bee5-42c8-99fd-9dd1eeed70e8 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:57.172821 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4db599-bee5-42c8-99fd-9dd1eeed70e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:57.172943 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4db599-bee5-42c8-99fd-9dd1eeed70e8 None admin] PATH_INFO: `/v3/users/4041574dcab14bf1acdf530a63ba0554` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:57.179774 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4db599-bee5-42c8-99fd-9dd1eeed70e8 None admin] RBAC: Authorizing `identity:get_user(user_id=4041574dcab14bf1acdf530a63ba0554)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:57.179774 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4db599-bee5-42c8-99fd-9dd1eeed70e8 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:57.181677 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 88/179] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:37:57 2022] GET /identity/v3/users/4041574dcab14bf1acdf530a63ba0554 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:37:57.184435 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69038c4-3a33-4115-84f1-b9dab8fcc8a4 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:57.185245 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69038c4-3a33-4115-84f1-b9dab8fcc8a4 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:57.185978 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69038c4-3a33-4115-84f1-b9dab8fcc8a4 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:57.189612 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 89/180] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:37:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:37:57.191703 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69038c4-3a33-4115-84f1-b9dab8fcc8a4 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:57.222251 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ead1d-da98-4d1b-8432-44850bceb46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:57.224672 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ead1d-da98-4d1b-8432-44850bceb46f None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:57.225445 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ead1d-da98-4d1b-8432-44850bceb46f None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:57.226192 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ead1d-da98-4d1b-8432-44850bceb46f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:57.249825 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ead1d-da98-4d1b-8432-44850bceb46f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:37:57.264574 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-e48ead1d-da98-4d1b-8432-44850bceb46f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 20:37:57.267323 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 92/181] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 20:37:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 449 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:37:57.272308 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6e2f0-864b-4bbb-a693-aeb5a641dc10 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:57.272308 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6e2f0-864b-4bbb-a693-aeb5a641dc10 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:57.272308 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6e2f0-864b-4bbb-a693-aeb5a641dc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:57.307327 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-77e6e2f0-864b-4bbb-a693-aeb5a641dc10 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:37:57.309542 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-77e6e2f0-864b-4bbb-a693-aeb5a641dc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:37:57.384715 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69038c4-3a33-4115-84f1-b9dab8fcc8a4 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:57.401295 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 93/182] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:37:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:37:57.410668 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6e2f0-864b-4bbb-a693-aeb5a641dc10 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:57.422446 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a34f53-4072-4d59-9cb8-71f82758934c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:57.423099 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a34f53-4072-4d59-9cb8-71f82758934c None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:57.423362 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a34f53-4072-4d59-9cb8-71f82758934c None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:57.423653 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a34f53-4072-4d59-9cb8-71f82758934c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:57.501373 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a34f53-4072-4d59-9cb8-71f82758934c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:57.502856 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a34f53-4072-4d59-9cb8-71f82758934c None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:57.532599 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6e2f0-864b-4bbb-a693-aeb5a641dc10 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:57.585430 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc54ef-e601-47fc-a5ef-736155b2247c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:57.586478 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc54ef-e601-47fc-a5ef-736155b2247c None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:57.586919 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc54ef-e601-47fc-a5ef-736155b2247c None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:57.587357 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc54ef-e601-47fc-a5ef-736155b2247c None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:57.588534 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc54ef-e601-47fc-a5ef-736155b2247c None admin] RBAC: Adding query filter params (name=admin) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:37:57.589031 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc54ef-e601-47fc-a5ef-736155b2247c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:57.591540 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc54ef-e601-47fc-a5ef-736155b2247c None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:57.602841 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 94/183] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:37:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:57.605072 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7272a-fd2a-429a-9014-3f63b2522816 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:57.605549 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7272a-fd2a-429a-9014-3f63b2522816 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:57.606019 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7272a-fd2a-429a-9014-3f63b2522816 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:57.609474 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 95/184] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:37:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:37:57.612453 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f31fc2-6134-4ac6-804d-7a40df119d8e None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:57.612933 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f31fc2-6134-4ac6-804d-7a40df119d8e None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:57.613408 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f31fc2-6134-4ac6-804d-7a40df119d8e None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:57.617195 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 96/185] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:37:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:37:57.617195 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f31fc2-6134-4ac6-804d-7a40df119d8e None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:57.637397 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 90/186] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:37:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 20:37:57.638363 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a34f53-4072-4d59-9cb8-71f82758934c None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:57.732526 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f31fc2-6134-4ac6-804d-7a40df119d8e None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:57.746556 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a34f53-4072-4d59-9cb8-71f82758934c None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:57.769610 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced1d8d-8b51-4a6a-af2b-1e3cc0386085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:57.770461 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced1d8d-8b51-4a6a-af2b-1e3cc0386085 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:57.770812 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced1d8d-8b51-4a6a-af2b-1e3cc0386085 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:57.771091 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced1d8d-8b51-4a6a-af2b-1e3cc0386085 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:57.773248 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced1d8d-8b51-4a6a-af2b-1e3cc0386085 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:57.774719 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced1d8d-8b51-4a6a-af2b-1e3cc0386085 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:57.781742 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 97/187] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:37:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:57.781742 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183716a-9c0f-4a72-a7de-9f1630be1367 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:57.781742 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183716a-9c0f-4a72-a7de-9f1630be1367 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:57.781742 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183716a-9c0f-4a72-a7de-9f1630be1367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:57.787481 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483d8dd-8fa4-484c-835c-338f95887b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:57.788480 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483d8dd-8fa4-484c-835c-338f95887b59 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:57.788815 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483d8dd-8fa4-484c-835c-338f95887b59 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:57.789145 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483d8dd-8fa4-484c-835c-338f95887b59 None admin] PATH_INFO: `/v3/users/e2886346629049e9a01a3e679616bd42` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:57.796353 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-e183716a-9c0f-4a72-a7de-9f1630be1367 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:37:57.797577 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-e183716a-9c0f-4a72-a7de-9f1630be1367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:37:57.804372 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483d8dd-8fa4-484c-835c-338f95887b59 None admin] RBAC: Authorizing `identity:get_user(user_id=e2886346629049e9a01a3e679616bd42)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:57.806011 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483d8dd-8fa4-484c-835c-338f95887b59 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:57.807809 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 91/188] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:37:57 2022] GET /identity/v3/users/e2886346629049e9a01a3e679616bd42 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:57.809136 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec834b-edae-486e-85f0-93feaa53fd54 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:57.809417 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec834b-edae-486e-85f0-93feaa53fd54 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:57.809692 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec834b-edae-486e-85f0-93feaa53fd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:57.832193 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-5fec834b-edae-486e-85f0-93feaa53fd54 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:37:57.834020 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-5fec834b-edae-486e-85f0-93feaa53fd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:37:57.872372 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 98/189] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:37:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:37:57.877211 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183716a-9c0f-4a72-a7de-9f1630be1367 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:57.910387 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 92/190] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:37:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:37:57.912399 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec834b-edae-486e-85f0-93feaa53fd54 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:58.016473 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183716a-9c0f-4a72-a7de-9f1630be1367 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:58.036841 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec834b-edae-486e-85f0-93feaa53fd54 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:58.052983 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d758a-14e4-4fef-a1bf-cae554e4986f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:58.053858 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d758a-14e4-4fef-a1bf-cae554e4986f None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:58.054139 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d758a-14e4-4fef-a1bf-cae554e4986f None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:58.054409 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d758a-14e4-4fef-a1bf-cae554e4986f None admin] PATH_INFO: `/v3/projects/7651e6b03b65497ab11181afb4e27ca6` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:58.055625 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d758a-14e4-4fef-a1bf-cae554e4986f None admin] RBAC: Authorizing `identity:get_project(project_id=7651e6b03b65497ab11181afb4e27ca6)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:58.057129 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d758a-14e4-4fef-a1bf-cae554e4986f None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:58.058854 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 99/191] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:37:57 2022] GET /identity/v3/projects/7651e6b03b65497ab11181afb4e27ca6 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:58.059642 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d758a-14e4-4fef-a1bf-cae554e4986f None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:58.072671 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11e3ae-1ce5-47eb-a289-5fd5738d6e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:58.073354 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11e3ae-1ce5-47eb-a289-5fd5738d6e8a None admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:58.073630 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11e3ae-1ce5-47eb-a289-5fd5738d6e8a None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:58.073901 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11e3ae-1ce5-47eb-a289-5fd5738d6e8a None admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:58.074619 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11e3ae-1ce5-47eb-a289-5fd5738d6e8a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:58.076097 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11e3ae-1ce5-47eb-a289-5fd5738d6e8a None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:58.098185 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 93/192] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Oct 28 20:37:57 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:37:58.099854 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11e3ae-1ce5-47eb-a289-5fd5738d6e8a None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:58.195613 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d758a-14e4-4fef-a1bf-cae554e4986f None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:58.226143 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11e3ae-1ce5-47eb-a289-5fd5738d6e8a None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:58.238904 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd7188-b38f-41a7-8551-4fe3bcfd1bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:58.241029 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd7188-b38f-41a7-8551-4fe3bcfd1bf1 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:58.241643 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd7188-b38f-41a7-8551-4fe3bcfd1bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:58.242025 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd7188-b38f-41a7-8551-4fe3bcfd1bf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:58.274078 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78017ed8-9232-46bc-8833-5c9bae50b607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:58.274974 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78017ed8-9232-46bc-8833-5c9bae50b607 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:58.275250 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78017ed8-9232-46bc-8833-5c9bae50b607 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:58.275511 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78017ed8-9232-46bc-8833-5c9bae50b607 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:58.289654 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78017ed8-9232-46bc-8833-5c9bae50b607 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:37:58.301666 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-78017ed8-9232-46bc-8833-5c9bae50b607 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 20:37:58.304204 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 94/193] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 20:37:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:37:58.305742 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78017ed8-9232-46bc-8833-5c9bae50b607 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:58.345629 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd7188-b38f-41a7-8551-4fe3bcfd1bf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:58.348115 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd7188-b38f-41a7-8551-4fe3bcfd1bf1 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:58.450109 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78017ed8-9232-46bc-8833-5c9bae50b607 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:58.504691 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5fad3-504d-456a-b95b-a6d779e35470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:58.506169 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5fad3-504d-456a-b95b-a6d779e35470 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:58.506451 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5fad3-504d-456a-b95b-a6d779e35470 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:58.506721 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5fad3-504d-456a-b95b-a6d779e35470 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:58.514794 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 100/194] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:37:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 20:37:58.517918 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd7188-b38f-41a7-8551-4fe3bcfd1bf1 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:58.524515 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf5fad3-504d-456a-b95b-a6d779e35470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:37:58.531915 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-8cf5fad3-504d-456a-b95b-a6d779e35470 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 20:37:58.533467 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 95/195] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:37:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:37:58.534458 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5fad3-504d-456a-b95b-a6d779e35470 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:58.707570 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd7188-b38f-41a7-8551-4fe3bcfd1bf1 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:58.714741 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5fad3-504d-456a-b95b-a6d779e35470 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:58.780305 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe65ce3-83ac-4fb0-8686-a309948d8a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:58.781826 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe65ce3-83ac-4fb0-8686-a309948d8a2b None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:58.781977 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b26e3e-c2bb-4a69-bb8f-3deb1fcfa9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:58.782809 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe65ce3-83ac-4fb0-8686-a309948d8a2b None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:58.782958 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b26e3e-c2bb-4a69-bb8f-3deb1fcfa9b2 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:58.783295 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b26e3e-c2bb-4a69-bb8f-3deb1fcfa9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:58.783875 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe65ce3-83ac-4fb0-8686-a309948d8a2b None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:58.784220 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b26e3e-c2bb-4a69-bb8f-3deb1fcfa9b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:58.785498 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe65ce3-83ac-4fb0-8686-a309948d8a2b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:37:58.786156 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe65ce3-83ac-4fb0-8686-a309948d8a2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:58.786891 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b26e3e-c2bb-4a69-bb8f-3deb1fcfa9b2 None admin] RBAC: Adding query filter params (role.id=28b8756191f44cadbdae28d1af156b6c, scope.project.id=7651e6b03b65497ab11181afb4e27ca6, user.id=4041574dcab14bf1acdf530a63ba0554) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:37:58.787617 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b26e3e-c2bb-4a69-bb8f-3deb1fcfa9b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:58.789672 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe65ce3-83ac-4fb0-8686-a309948d8a2b None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:58.790622 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b26e3e-c2bb-4a69-bb8f-3deb1fcfa9b2 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:58.801678 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 101/196] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:37:58 2022] GET /identity/v3/role_assignments?user.id=4041574dcab14bf1acdf530a63ba0554&scope.project.id=7651e6b03b65497ab11181afb4e27ca6&role.id=28b8756191f44cadbdae28d1af156b6c => generated 608 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:58.804160 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b26e3e-c2bb-4a69-bb8f-3deb1fcfa9b2 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:58.807407 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 96/197] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:37:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:58.809137 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe65ce3-83ac-4fb0-8686-a309948d8a2b None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:58.995565 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b26e3e-c2bb-4a69-bb8f-3deb1fcfa9b2 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:59.011214 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe65ce3-83ac-4fb0-8686-a309948d8a2b None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:59.077294 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba62972-b835-40e3-802c-3293f3d7513d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:59.079020 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba62972-b835-40e3-802c-3293f3d7513d None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:59.082270 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba62972-b835-40e3-802c-3293f3d7513d None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:59.083731 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba62972-b835-40e3-802c-3293f3d7513d None admin] PATH_INFO: `/v3/projects/38cebd4b9d0f44b4af767a7143050e7d` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:59.087677 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba62972-b835-40e3-802c-3293f3d7513d None admin] RBAC: Authorizing `identity:get_project(project_id=38cebd4b9d0f44b4af767a7143050e7d)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:59.093145 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba62972-b835-40e3-802c-3293f3d7513d None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:59.098107 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 102/198] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:37:58 2022] GET /identity/v3/projects/38cebd4b9d0f44b4af767a7143050e7d => generated 302 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:59.103037 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba62972-b835-40e3-802c-3293f3d7513d None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:59.107690 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1a6a2-d66c-43cb-9ff4-bfcb4739dd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:59.110044 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1a6a2-d66c-43cb-9ff4-bfcb4739dd06 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:59.114175 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1a6a2-d66c-43cb-9ff4-bfcb4739dd06 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:59.115703 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1a6a2-d66c-43cb-9ff4-bfcb4739dd06 None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:59.117482 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1a6a2-d66c-43cb-9ff4-bfcb4739dd06 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:37:59.118344 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1a6a2-d66c-43cb-9ff4-bfcb4739dd06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:59.123125 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1a6a2-d66c-43cb-9ff4-bfcb4739dd06 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:59.151210 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 97/199] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 20:37:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:59.153332 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1a6a2-d66c-43cb-9ff4-bfcb4739dd06 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:59.346827 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba62972-b835-40e3-802c-3293f3d7513d None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:59.348070 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1a6a2-d66c-43cb-9ff4-bfcb4739dd06 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:59.423147 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c640e1-4e33-4632-b537-fcc7ec9a8157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:59.424525 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c640e1-4e33-4632-b537-fcc7ec9a8157 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:59.425233 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c640e1-4e33-4632-b537-fcc7ec9a8157 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:59.425738 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d72f49-7e8a-4dbe-ad04-d63362073b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:59.426086 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c640e1-4e33-4632-b537-fcc7ec9a8157 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:59.427180 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d72f49-7e8a-4dbe-ad04-d63362073b1a None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:59.427636 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d72f49-7e8a-4dbe-ad04-d63362073b1a None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:59.428161 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d72f49-7e8a-4dbe-ad04-d63362073b1a None admin] PATH_INFO: `/v3/users/e2886346629049e9a01a3e679616bd42` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:59.428501 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c640e1-4e33-4632-b537-fcc7ec9a8157 None admin] RBAC: Adding query filter params (role.id=8fe105eeb7bf4856a94b0633bd781414, scope.project.id=38cebd4b9d0f44b4af767a7143050e7d, user.id=e2886346629049e9a01a3e679616bd42) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:37:59.429298 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c640e1-4e33-4632-b537-fcc7ec9a8157 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:59.430299 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d72f49-7e8a-4dbe-ad04-d63362073b1a None admin] RBAC: Authorizing `identity:get_user(user_id=e2886346629049e9a01a3e679616bd42)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:59.432240 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c640e1-4e33-4632-b537-fcc7ec9a8157 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:59.432864 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d72f49-7e8a-4dbe-ad04-d63362073b1a None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:59.439821 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 103/200] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:37:59 2022] GET /identity/v3/users/e2886346629049e9a01a3e679616bd42 => generated 283 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:59.439821 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d72f49-7e8a-4dbe-ad04-d63362073b1a None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:59.450303 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 98/201] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:37:59 2022] GET /identity/v3/role_assignments?user.id=e2886346629049e9a01a3e679616bd42&scope.project.id=38cebd4b9d0f44b4af767a7143050e7d&role.id=8fe105eeb7bf4856a94b0633bd781414 => generated 259 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:59.456091 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c640e1-4e33-4632-b537-fcc7ec9a8157 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:59.723949 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c640e1-4e33-4632-b537-fcc7ec9a8157 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:59.724713 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d72f49-7e8a-4dbe-ad04-d63362073b1a None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:37:59.786319 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509f819-d2aa-458b-88fe-d7c2cdb3f4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:59.788584 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509f819-d2aa-458b-88fe-d7c2cdb3f4bd None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:59.789429 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509f819-d2aa-458b-88fe-d7c2cdb3f4bd None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:59.790176 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509f819-d2aa-458b-88fe-d7c2cdb3f4bd None admin] PATH_INFO: `/v3/users/46e5c6abf14644c180c042e458f17374` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:59.792782 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b509f819-d2aa-458b-88fe-d7c2cdb3f4bd None admin] RBAC: Authorizing `identity:get_user(user_id=46e5c6abf14644c180c042e458f17374)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:59.793727 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d264a21-4c39-42be-9392-f305d427fbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:37:59.794747 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d264a21-4c39-42be-9392-f305d427fbd8 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:37:59.795211 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d264a21-4c39-42be-9392-f305d427fbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:37:59.795675 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d264a21-4c39-42be-9392-f305d427fbd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:37:59.797076 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b509f819-d2aa-458b-88fe-d7c2cdb3f4bd None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:37:59.807916 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 104/202] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:37:59 2022] GET /identity/v3/users/46e5c6abf14644c180c042e458f17374 => generated 289 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:37:59.810991 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509f819-d2aa-458b-88fe-d7c2cdb3f4bd None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:37:59.945460 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d264a21-4c39-42be-9392-f305d427fbd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:37:59.948439 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d264a21-4c39-42be-9392-f305d427fbd8 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:00.015372 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509f819-d2aa-458b-88fe-d7c2cdb3f4bd None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:00.080531 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075825d7-be59-48be-a167-d9eaa7f4829d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:00.082099 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075825d7-be59-48be-a167-d9eaa7f4829d None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:00.082851 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075825d7-be59-48be-a167-d9eaa7f4829d None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:00.083702 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075825d7-be59-48be-a167-d9eaa7f4829d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:00.127079 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 99/203] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:37:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 672 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 20:38:00.134636 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d264a21-4c39-42be-9392-f305d427fbd8 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:00.262558 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075825d7-be59-48be-a167-d9eaa7f4829d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:00.266229 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075825d7-be59-48be-a167-d9eaa7f4829d None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:00.467270 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 105/204] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:37:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 20:38:00.476987 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075825d7-be59-48be-a167-d9eaa7f4829d None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:00.483527 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d264a21-4c39-42be-9392-f305d427fbd8 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:00.569143 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147d599-de6c-4d73-92c1-14addd39491f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:00.570378 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147d599-de6c-4d73-92c1-14addd39491f None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:00.571839 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147d599-de6c-4d73-92c1-14addd39491f None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:00.572330 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147d599-de6c-4d73-92c1-14addd39491f None admin] PATH_INFO: `/v3/projects/38cebd4b9d0f44b4af767a7143050e7d` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:00.575756 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2147d599-de6c-4d73-92c1-14addd39491f None admin] RBAC: Authorizing `identity:get_project(project_id=38cebd4b9d0f44b4af767a7143050e7d)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:00.577496 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2147d599-de6c-4d73-92c1-14addd39491f None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:00.581862 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 100/205] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:38:00 2022] GET /identity/v3/projects/38cebd4b9d0f44b4af767a7143050e7d => generated 302 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:00.591506 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147d599-de6c-4d73-92c1-14addd39491f None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:00.721314 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147d599-de6c-4d73-92c1-14addd39491f None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:00.735987 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075825d7-be59-48be-a167-d9eaa7f4829d None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:00.794383 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed773e49-1976-426d-9fb7-a1afe21ba521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:00.795406 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed773e49-1976-426d-9fb7-a1afe21ba521 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:00.795855 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed773e49-1976-426d-9fb7-a1afe21ba521 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:00.796286 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed773e49-1976-426d-9fb7-a1afe21ba521 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:00.797816 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed773e49-1976-426d-9fb7-a1afe21ba521 None admin] RBAC: Adding query filter params (role.id=28b8756191f44cadbdae28d1af156b6c, scope.project.id=38cebd4b9d0f44b4af767a7143050e7d, user.id=e2886346629049e9a01a3e679616bd42) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:00.798607 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed773e49-1976-426d-9fb7-a1afe21ba521 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:00.801414 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed773e49-1976-426d-9fb7-a1afe21ba521 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:00.812787 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 101/206] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:38:00 2022] GET /identity/v3/role_assignments?user.id=e2886346629049e9a01a3e679616bd42&scope.project.id=38cebd4b9d0f44b4af767a7143050e7d&role.id=28b8756191f44cadbdae28d1af156b6c => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:00.815181 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b182c36-6cce-473b-b8a4-dab34b344890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:00.817067 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b182c36-6cce-473b-b8a4-dab34b344890 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:00.818332 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b182c36-6cce-473b-b8a4-dab34b344890 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:00.819066 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b182c36-6cce-473b-b8a4-dab34b344890 None admin] PATH_INFO: `/v3/projects/7651e6b03b65497ab11181afb4e27ca6` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:00.829283 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b182c36-6cce-473b-b8a4-dab34b344890 None admin] RBAC: Authorizing `identity:get_project(project_id=7651e6b03b65497ab11181afb4e27ca6)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:00.832420 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b182c36-6cce-473b-b8a4-dab34b344890 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:00.836918 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 106/207] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:38:00 2022] GET /identity/v3/projects/7651e6b03b65497ab11181afb4e27ca6 => generated 298 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:00.846219 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed773e49-1976-426d-9fb7-a1afe21ba521 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:01.056699 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed773e49-1976-426d-9fb7-a1afe21ba521 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:01.125563 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af722bcc-81c8-4999-82d9-837c0b8c4b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:01.126558 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af722bcc-81c8-4999-82d9-837c0b8c4b77 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:01.126886 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af722bcc-81c8-4999-82d9-837c0b8c4b77 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:01.127303 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af722bcc-81c8-4999-82d9-837c0b8c4b77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:01.128802 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af722bcc-81c8-4999-82d9-837c0b8c4b77 None admin] RBAC: Adding query filter params (role.id=a5a6a249ab1f472e93ce008d03b41039, scope.project.id=7651e6b03b65497ab11181afb4e27ca6, user.id=46e5c6abf14644c180c042e458f17374) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:01.129316 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af722bcc-81c8-4999-82d9-837c0b8c4b77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:01.131995 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af722bcc-81c8-4999-82d9-837c0b8c4b77 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:01.142350 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 102/208] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:38:00 2022] GET /identity/v3/role_assignments?user.id=46e5c6abf14644c180c042e458f17374&scope.project.id=7651e6b03b65497ab11181afb4e27ca6&role.id=a5a6a249ab1f472e93ce008d03b41039 => generated 608 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:01.507068 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2231f61-ab78-4684-8edf-6804817c6ef9 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:01.508157 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2231f61-ab78-4684-8edf-6804817c6ef9 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:01.508922 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2231f61-ab78-4684-8edf-6804817c6ef9 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:01.511825 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 107/209] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:01.518726 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0cecdf-2908-4c93-910f-47bbc833faec None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:01.519204 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0cecdf-2908-4c93-910f-47bbc833faec None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:01.519675 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0cecdf-2908-4c93-910f-47bbc833faec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:01.554512 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-8b0cecdf-2908-4c93-910f-47bbc833faec None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:01.556607 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-8b0cecdf-2908-4c93-910f-47bbc833faec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:01.705428 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 103/210] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:38:01.729341 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2231f61-ab78-4684-8edf-6804817c6ef9 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:01.842208 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2231f61-ab78-4684-8edf-6804817c6ef9 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:01.883518 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de8c30-fc30-4cd0-be8d-45c561e5983e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:01.884724 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de8c30-fc30-4cd0-be8d-45c561e5983e None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:01.885195 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de8c30-fc30-4cd0-be8d-45c561e5983e None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:01.885678 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de8c30-fc30-4cd0-be8d-45c561e5983e None admin] PATH_INFO: `/v3/roles/member` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:01.898379 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de8c30-fc30-4cd0-be8d-45c561e5983e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:01.905806 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-71de8c30-fc30-4cd0-be8d-45c561e5983e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 20:38:01.907339 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 108/211] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:38:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:01.914092 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0cecdf-2908-4c93-910f-47bbc833faec None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:02.019341 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0cecdf-2908-4c93-910f-47bbc833faec None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:02.057849 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bfa27b-77b6-49ca-b452-c58d9e1e8699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:02.058899 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bfa27b-77b6-49ca-b452-c58d9e1e8699 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:02.059377 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bfa27b-77b6-49ca-b452-c58d9e1e8699 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:02.059877 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bfa27b-77b6-49ca-b452-c58d9e1e8699 None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:02.060862 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bfa27b-77b6-49ca-b452-c58d9e1e8699 None admin] RBAC: Adding query filter params (name=member) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:02.061377 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bfa27b-77b6-49ca-b452-c58d9e1e8699 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:02.062978 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bfa27b-77b6-49ca-b452-c58d9e1e8699 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:02.073584 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 104/212] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 20:38:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:02.079551 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de8c30-fc30-4cd0-be8d-45c561e5983e None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:02.192415 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de8c30-fc30-4cd0-be8d-45c561e5983e None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:02.231769 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b9bc4-175c-4497-84d7-4dc4f905a6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:02.231769 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b9bc4-175c-4497-84d7-4dc4f905a6f9 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:02.231769 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b9bc4-175c-4497-84d7-4dc4f905a6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:02.231769 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b9bc4-175c-4497-84d7-4dc4f905a6f9 None admin] PATH_INFO: `/v3/users/d4a076e3c66242b882ed6db845b84e94` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:02.247673 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b9bc4-175c-4497-84d7-4dc4f905a6f9 None admin] RBAC: Authorizing `identity:get_user(user_id=d4a076e3c66242b882ed6db845b84e94)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:02.249198 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b9bc4-175c-4497-84d7-4dc4f905a6f9 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:02.251033 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 109/213] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:38:02 2022] GET /identity/v3/users/d4a076e3c66242b882ed6db845b84e94 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:02.257364 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bfa27b-77b6-49ca-b452-c58d9e1e8699 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:02.280256 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143f3c6-ad4f-4eff-9b97-387e5bdfc7c1 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:02.280592 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143f3c6-ad4f-4eff-9b97-387e5bdfc7c1 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:02.281027 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143f3c6-ad4f-4eff-9b97-387e5bdfc7c1 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:02.283408 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 110/214] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:02.292521 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118aa7c2-b0db-46d8-bb5d-7be0076e6dca None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:02.293048 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118aa7c2-b0db-46d8-bb5d-7be0076e6dca None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:02.293507 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118aa7c2-b0db-46d8-bb5d-7be0076e6dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:02.312587 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-118aa7c2-b0db-46d8-bb5d-7be0076e6dca None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:02.314147 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-118aa7c2-b0db-46d8-bb5d-7be0076e6dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:02.396725 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 111/215] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 20:38:02.418520 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118aa7c2-b0db-46d8-bb5d-7be0076e6dca None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:02.440072 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bfa27b-77b6-49ca-b452-c58d9e1e8699 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:02.505675 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699da262-1ad9-4ac0-b05f-dc6de70b4726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:02.506783 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699da262-1ad9-4ac0-b05f-dc6de70b4726 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:02.507192 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699da262-1ad9-4ac0-b05f-dc6de70b4726 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:02.507650 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699da262-1ad9-4ac0-b05f-dc6de70b4726 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:02.540823 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118aa7c2-b0db-46d8-bb5d-7be0076e6dca None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:02.583052 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a99e4b-ce6b-432f-9ec0-2b68031fcd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:02.584357 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a99e4b-ce6b-432f-9ec0-2b68031fcd26 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:02.584897 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a99e4b-ce6b-432f-9ec0-2b68031fcd26 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:02.585390 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a99e4b-ce6b-432f-9ec0-2b68031fcd26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:02.587152 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a99e4b-ce6b-432f-9ec0-2b68031fcd26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:02.589011 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a99e4b-ce6b-432f-9ec0-2b68031fcd26 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:02.595879 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 112/216] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:38:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:02.597138 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a99e4b-ce6b-432f-9ec0-2b68031fcd26 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:02.687476 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699da262-1ad9-4ac0-b05f-dc6de70b4726 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:02.690151 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699da262-1ad9-4ac0-b05f-dc6de70b4726 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:02.719830 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a99e4b-ce6b-432f-9ec0-2b68031fcd26 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:02.772671 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79826dd4-4250-4f1e-b14b-5b3f5c8efd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:02.773726 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79826dd4-4250-4f1e-b14b-5b3f5c8efd47 None admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:02.774211 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79826dd4-4250-4f1e-b14b-5b3f5c8efd47 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:02.774925 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79826dd4-4250-4f1e-b14b-5b3f5c8efd47 None admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:02.776906 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79826dd4-4250-4f1e-b14b-5b3f5c8efd47 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:02.781057 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79826dd4-4250-4f1e-b14b-5b3f5c8efd47 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:02.823787 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 113/217] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Oct 28 20:38:02 2022] POST /identity/v3/users => generated 297 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:38:02.869323 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 105/218] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:38:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 20:38:02.875254 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79826dd4-4250-4f1e-b14b-5b3f5c8efd47 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:03.003458 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79826dd4-4250-4f1e-b14b-5b3f5c8efd47 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:03.045371 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7be450-ab6d-4688-9caa-b1854269b5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:03.046153 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7be450-ab6d-4688-9caa-b1854269b5cd None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:03.046428 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7be450-ab6d-4688-9caa-b1854269b5cd None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:03.046700 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7be450-ab6d-4688-9caa-b1854269b5cd None admin] PATH_INFO: `/v3/projects/38cebd4b9d0f44b4af767a7143050e7d` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:03.048098 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7be450-ab6d-4688-9caa-b1854269b5cd None admin] RBAC: Authorizing `identity:get_project(project_id=38cebd4b9d0f44b4af767a7143050e7d)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:03.049738 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7be450-ab6d-4688-9caa-b1854269b5cd None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:03.051612 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 114/219] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:38:02 2022] GET /identity/v3/projects/38cebd4b9d0f44b4af767a7143050e7d => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:03.058820 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699da262-1ad9-4ac0-b05f-dc6de70b4726 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:03.184440 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699da262-1ad9-4ac0-b05f-dc6de70b4726 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:03.227726 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478bb4f-0e4c-416c-8ae1-0295c578d8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:03.227726 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478bb4f-0e4c-416c-8ae1-0295c578d8e0 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:03.227726 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478bb4f-0e4c-416c-8ae1-0295c578d8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:03.227726 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478bb4f-0e4c-416c-8ae1-0295c578d8e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:03.228278 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0478bb4f-0e4c-416c-8ae1-0295c578d8e0 None admin] RBAC: Adding query filter params (role.id=aaafbf9fe78e46cd9f06410394fdb531, scope.project.id=38cebd4b9d0f44b4af767a7143050e7d, user.id=d4a076e3c66242b882ed6db845b84e94) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:03.228594 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0478bb4f-0e4c-416c-8ae1-0295c578d8e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:03.230124 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0478bb4f-0e4c-416c-8ae1-0295c578d8e0 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:03.236806 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 106/220] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:38:03 2022] GET /identity/v3/role_assignments?user.id=d4a076e3c66242b882ed6db845b84e94&scope.project.id=38cebd4b9d0f44b4af767a7143050e7d&role.id=aaafbf9fe78e46cd9f06410394fdb531 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:03.563028 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6310421-cc52-4806-8116-3e708f0cd365 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:03.563416 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6310421-cc52-4806-8116-3e708f0cd365 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:03.563585 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6310421-cc52-4806-8116-3e708f0cd365 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:03.565800 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 115/221] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:03.572524 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68346b-c2fb-43a2-a393-53b306c7a05d None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:03.573333 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68346b-c2fb-43a2-a393-53b306c7a05d None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:03.573724 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68346b-c2fb-43a2-a393-53b306c7a05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:03.607014 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-2d68346b-c2fb-43a2-a393-53b306c7a05d None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:03.609144 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-2d68346b-c2fb-43a2-a393-53b306c7a05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:03.709489 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90961717-5c67-43b1-8111-eeb214568eae None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:03.709771 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90961717-5c67-43b1-8111-eeb214568eae None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:03.710048 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90961717-5c67-43b1-8111-eeb214568eae None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:03.712170 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 116/222] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:03.721289 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adca673-ac60-49b2-b05e-330f882ac42c None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:03.721576 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adca673-ac60-49b2-b05e-330f882ac42c None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:03.721853 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adca673-ac60-49b2-b05e-330f882ac42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:03.761242 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-5adca673-ac60-49b2-b05e-330f882ac42c None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:03.762453 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-5adca673-ac60-49b2-b05e-330f882ac42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:03.769351 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 107/223] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:38:03.832450 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68346b-c2fb-43a2-a393-53b306c7a05d None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:03.861822 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 117/224] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:38:03.968967 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68346b-c2fb-43a2-a393-53b306c7a05d None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:03.972028 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adca673-ac60-49b2-b05e-330f882ac42c None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:04.038209 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0a4f5-d1d3-43ad-b742-a4cacbfd45fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:04.038981 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0a4f5-d1d3-43ad-b742-a4cacbfd45fd None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:04.039255 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0a4f5-d1d3-43ad-b742-a4cacbfd45fd None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:04.039521 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0a4f5-d1d3-43ad-b742-a4cacbfd45fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:04.062151 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0a4f5-d1d3-43ad-b742-a4cacbfd45fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:04.069252 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-94b0a4f5-d1d3-43ad-b742-a4cacbfd45fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 20:38:04.076213 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 108/225] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 20:38:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:04.079209 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adca673-ac60-49b2-b05e-330f882ac42c None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:04.081634 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0a4f5-d1d3-43ad-b742-a4cacbfd45fd None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:04.124994 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0e5a4-fdb0-4b02-a374-1d6b36df8567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:04.126181 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0e5a4-fdb0-4b02-a374-1d6b36df8567 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:04.126678 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0e5a4-fdb0-4b02-a374-1d6b36df8567 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:04.127162 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0e5a4-fdb0-4b02-a374-1d6b36df8567 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:04.147324 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0e5a4-fdb0-4b02-a374-1d6b36df8567 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:04.163767 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-97d0e5a4-fdb0-4b02-a374-1d6b36df8567 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 20:38:04.165698 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 118/226] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 20:38:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:38:04.171977 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0e5a4-fdb0-4b02-a374-1d6b36df8567 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:04.199587 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0a4f5-d1d3-43ad-b742-a4cacbfd45fd None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:04.265836 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed8679-e0c7-4a42-a20b-4ae220252c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:04.266516 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed8679-e0c7-4a42-a20b-4ae220252c3f None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:04.266789 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed8679-e0c7-4a42-a20b-4ae220252c3f None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:04.267060 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed8679-e0c7-4a42-a20b-4ae220252c3f None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:04.273685 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed8679-e0c7-4a42-a20b-4ae220252c3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:04.273996 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed8679-e0c7-4a42-a20b-4ae220252c3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:04.275435 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed8679-e0c7-4a42-a20b-4ae220252c3f None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:04.293762 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 109/227] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:38:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:04.299678 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed8679-e0c7-4a42-a20b-4ae220252c3f None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:04.360021 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0e5a4-fdb0-4b02-a374-1d6b36df8567 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:04.407076 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2246bd-b062-4f3e-a1f9-c24a89578403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:04.407676 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2246bd-b062-4f3e-a1f9-c24a89578403 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:04.407980 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2246bd-b062-4f3e-a1f9-c24a89578403 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:04.408255 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2246bd-b062-4f3e-a1f9-c24a89578403 None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:04.409015 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2246bd-b062-4f3e-a1f9-c24a89578403 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:04.409330 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2246bd-b062-4f3e-a1f9-c24a89578403 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:04.410732 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2246bd-b062-4f3e-a1f9-c24a89578403 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:04.427643 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 119/228] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:38:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:04.433703 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2246bd-b062-4f3e-a1f9-c24a89578403 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:04.464550 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed8679-e0c7-4a42-a20b-4ae220252c3f None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:04.511614 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab554ecc-a0af-4f6d-afa3-f1aa37d36c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:04.512541 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab554ecc-a0af-4f6d-afa3-f1aa37d36c6c None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:04.512819 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab554ecc-a0af-4f6d-afa3-f1aa37d36c6c None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:04.513088 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab554ecc-a0af-4f6d-afa3-f1aa37d36c6c None admin] PATH_INFO: `/v3/users/e2886346629049e9a01a3e679616bd42` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:04.514351 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab554ecc-a0af-4f6d-afa3-f1aa37d36c6c None admin] RBAC: Authorizing `identity:get_user(user_id=e2886346629049e9a01a3e679616bd42)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:04.515834 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab554ecc-a0af-4f6d-afa3-f1aa37d36c6c None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:04.517548 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 110/229] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:38:04 2022] GET /identity/v3/users/e2886346629049e9a01a3e679616bd42 => generated 283 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:04.524601 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab554ecc-a0af-4f6d-afa3-f1aa37d36c6c None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:04.602271 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2246bd-b062-4f3e-a1f9-c24a89578403 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:04.641855 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7e09f-44a6-4ed3-81de-2b6405d504e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:04.643427 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7e09f-44a6-4ed3-81de-2b6405d504e6 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:04.644746 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7e09f-44a6-4ed3-81de-2b6405d504e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:04.646149 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7e09f-44a6-4ed3-81de-2b6405d504e6 None admin] PATH_INFO: `/v3/users/e2886346629049e9a01a3e679616bd42` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:04.647998 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7e09f-44a6-4ed3-81de-2b6405d504e6 None admin] RBAC: Authorizing `identity:get_user(user_id=e2886346629049e9a01a3e679616bd42)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:04.649769 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7e09f-44a6-4ed3-81de-2b6405d504e6 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:04.655942 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 120/230] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:38:04 2022] GET /identity/v3/users/e2886346629049e9a01a3e679616bd42 => generated 283 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:04.657970 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7e09f-44a6-4ed3-81de-2b6405d504e6 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:04.787929 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab554ecc-a0af-4f6d-afa3-f1aa37d36c6c None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:04.807554 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7e09f-44a6-4ed3-81de-2b6405d504e6 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:04.853028 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f39d75-fe27-4266-9885-3c1ec7672faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:04.853897 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f39d75-fe27-4266-9885-3c1ec7672faa None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:04.854170 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f39d75-fe27-4266-9885-3c1ec7672faa None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:04.854439 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f39d75-fe27-4266-9885-3c1ec7672faa None admin] PATH_INFO: `/v3/projects/38cebd4b9d0f44b4af767a7143050e7d` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:04.856887 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f39d75-fe27-4266-9885-3c1ec7672faa None admin] RBAC: Authorizing `identity:get_project(project_id=38cebd4b9d0f44b4af767a7143050e7d)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:04.858379 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f39d75-fe27-4266-9885-3c1ec7672faa None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:04.863238 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 121/231] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:38:04 2022] GET /identity/v3/projects/38cebd4b9d0f44b4af767a7143050e7d => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:04.872490 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f39d75-fe27-4266-9885-3c1ec7672faa None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:04.891678 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599b5c7-0b73-4b16-846d-dc181491f062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:04.892581 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599b5c7-0b73-4b16-846d-dc181491f062 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:04.892861 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599b5c7-0b73-4b16-846d-dc181491f062 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:04.893134 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599b5c7-0b73-4b16-846d-dc181491f062 None admin] PATH_INFO: `/v3/projects/38cebd4b9d0f44b4af767a7143050e7d` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:04.894643 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9599b5c7-0b73-4b16-846d-dc181491f062 None admin] RBAC: Authorizing `identity:get_project(project_id=38cebd4b9d0f44b4af767a7143050e7d)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:04.896948 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9599b5c7-0b73-4b16-846d-dc181491f062 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:04.898890 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 111/232] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:38:04 2022] GET /identity/v3/projects/38cebd4b9d0f44b4af767a7143050e7d => generated 302 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:04.921721 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599b5c7-0b73-4b16-846d-dc181491f062 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:05.040950 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f39d75-fe27-4266-9885-3c1ec7672faa None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:05.087845 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cfa4b-e69b-4cfb-ace6-6881cf052c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:05.088751 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cfa4b-e69b-4cfb-ace6-6881cf052c68 None admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:05.089024 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cfa4b-e69b-4cfb-ace6-6881cf052c68 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:05.089293 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cfa4b-e69b-4cfb-ace6-6881cf052c68 None admin] PATH_INFO: `/v3/projects/38cebd4b9d0f44b4af767a7143050e7d/users/e2886346629049e9a01a3e679616bd42/roles/28b8756191f44cadbdae28d1af156b6c` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:05.097130 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44cfa4b-e69b-4cfb-ace6-6881cf052c68 None admin] RBAC: Authorizing `identity:create_grant(project_id=38cebd4b9d0f44b4af767a7143050e7d, user_id=e2886346629049e9a01a3e679616bd42, role_id=28b8756191f44cadbdae28d1af156b6c)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:05.098644 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44cfa4b-e69b-4cfb-ace6-6881cf052c68 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:05.138194 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599b5c7-0b73-4b16-846d-dc181491f062 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:05.139661 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 122/233] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 20:38:04 2022] PUT /identity/v3/projects/38cebd4b9d0f44b4af767a7143050e7d/users/e2886346629049e9a01a3e679616bd42/roles/28b8756191f44cadbdae28d1af156b6c => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:38:05.187380 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16851b1f-4c5a-47a7-867e-e58cf1c5b3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:05.188264 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16851b1f-4c5a-47a7-867e-e58cf1c5b3f9 None admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:05.188545 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16851b1f-4c5a-47a7-867e-e58cf1c5b3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:05.188821 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16851b1f-4c5a-47a7-867e-e58cf1c5b3f9 None admin] PATH_INFO: `/v3/projects/38cebd4b9d0f44b4af767a7143050e7d/users/e2886346629049e9a01a3e679616bd42/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:05.197516 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16851b1f-4c5a-47a7-867e-e58cf1c5b3f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=38cebd4b9d0f44b4af767a7143050e7d, user_id=e2886346629049e9a01a3e679616bd42, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:05.199004 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16851b1f-4c5a-47a7-867e-e58cf1c5b3f9 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:05.226895 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 112/234] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 20:38:04 2022] PUT /identity/v3/projects/38cebd4b9d0f44b4af767a7143050e7d/users/e2886346629049e9a01a3e679616bd42/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:38:06.274821 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39a24b-8e49-4dc9-aa5a-1b65be663807 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:06.275800 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39a24b-8e49-4dc9-aa5a-1b65be663807 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:06.276281 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39a24b-8e49-4dc9-aa5a-1b65be663807 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:06.278596 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 123/235] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:06.284484 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a2db9-9edf-44d9-8d4c-0f2d45e96fc7 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:06.284981 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a2db9-9edf-44d9-8d4c-0f2d45e96fc7 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:06.285059 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a2db9-9edf-44d9-8d4c-0f2d45e96fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:06.312813 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-2a1a2db9-9edf-44d9-8d4c-0f2d45e96fc7 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:06.314022 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-2a1a2db9-9edf-44d9-8d4c-0f2d45e96fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:06.414452 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 113/236] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:38:06.454069 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39a24b-8e49-4dc9-aa5a-1b65be663807 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:06.597538 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39a24b-8e49-4dc9-aa5a-1b65be663807 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:06.650427 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0967d-a945-435d-a465-9ed692145484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:06.651241 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0967d-a945-435d-a465-9ed692145484 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:06.651517 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0967d-a945-435d-a465-9ed692145484 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:06.651813 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0967d-a945-435d-a465-9ed692145484 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:06.655151 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5ce52-d1b6-434a-8ab7-3c2c9630abea None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:06.655440 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5ce52-d1b6-434a-8ab7-3c2c9630abea None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:06.655718 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5ce52-d1b6-434a-8ab7-3c2c9630abea None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:06.657723 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 114/237] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:06.665694 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687df3d-4371-4bf8-ac1c-1eb3c1eeb90d None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:06.665981 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687df3d-4371-4bf8-ac1c-1eb3c1eeb90d None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:06.666274 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687df3d-4371-4bf8-ac1c-1eb3c1eeb90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:06.666389 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0967d-a945-435d-a465-9ed692145484 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:06.673382 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-eaf0967d-a945-435d-a465-9ed692145484 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 20:38:06.674731 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 124/238] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:38:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:06.681758 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0967d-a945-435d-a465-9ed692145484 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:06.708862 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-8687df3d-4371-4bf8-ac1c-1eb3c1eeb90d None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:06.710071 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-8687df3d-4371-4bf8-ac1c-1eb3c1eeb90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:06.790772 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0967d-a945-435d-a465-9ed692145484 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:06.821748 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 115/239] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 20:38:06.833398 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5e487-f6cd-40c4-ac6e-0dccaa885618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:06.834659 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5e487-f6cd-40c4-ac6e-0dccaa885618 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:06.835189 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5e487-f6cd-40c4-ac6e-0dccaa885618 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:06.835701 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5e487-f6cd-40c4-ac6e-0dccaa885618 None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:06.836712 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd5e487-f6cd-40c4-ac6e-0dccaa885618 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:06.837223 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd5e487-f6cd-40c4-ac6e-0dccaa885618 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:06.838958 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd5e487-f6cd-40c4-ac6e-0dccaa885618 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:06.865709 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687df3d-4371-4bf8-ac1c-1eb3c1eeb90d None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:06.866804 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 125/240] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 20:38:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:06.874904 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5e487-f6cd-40c4-ac6e-0dccaa885618 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:07.023962 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687df3d-4371-4bf8-ac1c-1eb3c1eeb90d None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:07.032945 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5e487-f6cd-40c4-ac6e-0dccaa885618 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:07.063777 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839c460-a521-4cf1-bbe2-7f6d31b3bd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:07.064596 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839c460-a521-4cf1-bbe2-7f6d31b3bd4d None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:07.064874 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839c460-a521-4cf1-bbe2-7f6d31b3bd4d None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:07.065149 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839c460-a521-4cf1-bbe2-7f6d31b3bd4d None admin] PATH_INFO: `/v3/domains/default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:07.066476 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6839c460-a521-4cf1-bbe2-7f6d31b3bd4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:07.068328 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6839c460-a521-4cf1-bbe2-7f6d31b3bd4d None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:07.070554 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 116/241] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:38:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:07.076531 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839c460-a521-4cf1-bbe2-7f6d31b3bd4d None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:07.122907 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d2fd4-7989-45cf-b033-4c382667507b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:07.123714 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d2fd4-7989-45cf-b033-4c382667507b None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:07.124020 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d2fd4-7989-45cf-b033-4c382667507b None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:07.124290 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d2fd4-7989-45cf-b033-4c382667507b None admin] PATH_INFO: `/v3/users/438f1b8ecaa24aeebd224aff8c42fb20` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:07.156063 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d2fd4-7989-45cf-b033-4c382667507b None admin] RBAC: Authorizing `identity:get_user(user_id=438f1b8ecaa24aeebd224aff8c42fb20)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:07.157581 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d2fd4-7989-45cf-b033-4c382667507b None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:07.159319 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 126/242] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:38:06 2022] GET /identity/v3/users/438f1b8ecaa24aeebd224aff8c42fb20 => generated 297 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:07.166384 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d2fd4-7989-45cf-b033-4c382667507b None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:07.243231 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839c460-a521-4cf1-bbe2-7f6d31b3bd4d None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:07.288624 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a2407-e91b-4321-b220-252dc318b233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:07.289285 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a2407-e91b-4321-b220-252dc318b233 None admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:07.289561 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a2407-e91b-4321-b220-252dc318b233 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:07.289837 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a2407-e91b-4321-b220-252dc318b233 None admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:07.290553 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4a2407-e91b-4321-b220-252dc318b233 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:07.292036 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4a2407-e91b-4321-b220-252dc318b233 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:07.332383 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 117/243] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Oct 28 20:38:07 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:38:07.371347 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d2fd4-7989-45cf-b033-4c382667507b None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:07.415764 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2107b9-ced9-423a-9f86-8b5d33a850d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:07.416349 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2107b9-ced9-423a-9f86-8b5d33a850d7 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:07.416627 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2107b9-ced9-423a-9f86-8b5d33a850d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:07.416900 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2107b9-ced9-423a-9f86-8b5d33a850d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:07.496036 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2107b9-ced9-423a-9f86-8b5d33a850d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:07.497468 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2107b9-ced9-423a-9f86-8b5d33a850d7 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:07.610561 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 127/244] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:38:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 20:38:07.618535 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a2407-e91b-4321-b220-252dc318b233 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:07.625139 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a7b26-a2d3-497a-8815-9c0c82e7c27e None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:07.625783 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a7b26-a2d3-497a-8815-9c0c82e7c27e None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:07.626259 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a7b26-a2d3-497a-8815-9c0c82e7c27e None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:07.628791 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 128/245] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:38:07.635172 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5eab7-5572-4b25-8ebe-1b47058b082a None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:07.635836 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5eab7-5572-4b25-8ebe-1b47058b082a None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:07.636311 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5eab7-5572-4b25-8ebe-1b47058b082a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:07.665865 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-08c5eab7-5572-4b25-8ebe-1b47058b082a None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:07.668929 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-08c5eab7-5572-4b25-8ebe-1b47058b082a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:07.781736 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 129/246] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 20:38:07.810168 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5eab7-5572-4b25-8ebe-1b47058b082a None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:07.820157 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a2407-e91b-4321-b220-252dc318b233 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:07.858505 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992e462-0464-495e-9305-85a65f09d754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:07.859695 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992e462-0464-495e-9305-85a65f09d754 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:07.860217 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992e462-0464-495e-9305-85a65f09d754 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:07.860659 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992e462-0464-495e-9305-85a65f09d754 None admin] PATH_INFO: `/v3/projects/38cebd4b9d0f44b4af767a7143050e7d` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:07.862184 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f992e462-0464-495e-9305-85a65f09d754 None admin] RBAC: Authorizing `identity:get_project(project_id=38cebd4b9d0f44b4af767a7143050e7d)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:07.863970 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f992e462-0464-495e-9305-85a65f09d754 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:07.867110 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 118/247] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:38:07 2022] GET /identity/v3/projects/38cebd4b9d0f44b4af767a7143050e7d => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:07.874435 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992e462-0464-495e-9305-85a65f09d754 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:07.995662 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5eab7-5572-4b25-8ebe-1b47058b082a None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:08.038779 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d582d-178e-4159-a787-0e9560970f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:08.039596 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d582d-178e-4159-a787-0e9560970f0c None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:08.039916 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d582d-178e-4159-a787-0e9560970f0c None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:08.040226 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d582d-178e-4159-a787-0e9560970f0c None admin] PATH_INFO: `/v3/roles/member` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:08.047106 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992e462-0464-495e-9305-85a65f09d754 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:08.053952 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d582d-178e-4159-a787-0e9560970f0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:08.061732 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-9f5d582d-178e-4159-a787-0e9560970f0c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 20:38:08.063350 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 130/248] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:38:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:38:08.073046 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d582d-178e-4159-a787-0e9560970f0c None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:08.110128 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30c358-f998-452a-9a51-5038c09303ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:08.111275 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30c358-f998-452a-9a51-5038c09303ee None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:08.111799 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30c358-f998-452a-9a51-5038c09303ee None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:08.112267 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30c358-f998-452a-9a51-5038c09303ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:08.113908 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30c358-f998-452a-9a51-5038c09303ee None admin] RBAC: Adding query filter params (role.id=a5a6a249ab1f472e93ce008d03b41039, scope.project.id=38cebd4b9d0f44b4af767a7143050e7d, user.id=438f1b8ecaa24aeebd224aff8c42fb20) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:08.114322 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30c358-f998-452a-9a51-5038c09303ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:08.117393 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30c358-f998-452a-9a51-5038c09303ee None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:08.133618 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 119/249] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:38:07 2022] GET /identity/v3/role_assignments?user.id=438f1b8ecaa24aeebd224aff8c42fb20&scope.project.id=38cebd4b9d0f44b4af767a7143050e7d&role.id=a5a6a249ab1f472e93ce008d03b41039 => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:08.207594 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d582d-178e-4159-a787-0e9560970f0c None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:08.264870 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c13852b-4c61-4838-8c08-f23511e63bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:08.265482 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13852b-4c61-4838-8c08-f23511e63bcb None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:08.265759 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13852b-4c61-4838-8c08-f23511e63bcb None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:08.266026 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13852b-4c61-4838-8c08-f23511e63bcb None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:08.266801 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c13852b-4c61-4838-8c08-f23511e63bcb None admin] RBAC: Adding query filter params (name=member) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:08.267106 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c13852b-4c61-4838-8c08-f23511e63bcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:08.270304 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c13852b-4c61-4838-8c08-f23511e63bcb None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:08.279285 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 131/250] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 20:38:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:08.285072 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30c358-f998-452a-9a51-5038c09303ee None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:08.410177 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30c358-f998-452a-9a51-5038c09303ee None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:08.448195 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40488be5-f929-460c-988a-50dee20c3871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:08.449082 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40488be5-f929-460c-988a-50dee20c3871 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:08.449357 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40488be5-f929-460c-988a-50dee20c3871 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:08.449632 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40488be5-f929-460c-988a-50dee20c3871 None admin] PATH_INFO: `/v3/users/d4a076e3c66242b882ed6db845b84e94` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:08.450896 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40488be5-f929-460c-988a-50dee20c3871 None admin] RBAC: Authorizing `identity:get_user(user_id=d4a076e3c66242b882ed6db845b84e94)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:08.452431 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40488be5-f929-460c-988a-50dee20c3871 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:08.454138 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 120/251] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:38:08 2022] GET /identity/v3/users/d4a076e3c66242b882ed6db845b84e94 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:08.460566 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c13852b-4c61-4838-8c08-f23511e63bcb None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:08.571168 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c13852b-4c61-4838-8c08-f23511e63bcb None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:08.608122 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004b315-9d43-49c4-be40-6fd6d1ba38b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:08.608997 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004b315-9d43-49c4-be40-6fd6d1ba38b6 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:08.609273 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004b315-9d43-49c4-be40-6fd6d1ba38b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:08.609649 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004b315-9d43-49c4-be40-6fd6d1ba38b6 None admin] PATH_INFO: `/v3/projects/38cebd4b9d0f44b4af767a7143050e7d` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:08.611026 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004b315-9d43-49c4-be40-6fd6d1ba38b6 None admin] RBAC: Authorizing `identity:get_project(project_id=38cebd4b9d0f44b4af767a7143050e7d)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:08.612594 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004b315-9d43-49c4-be40-6fd6d1ba38b6 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:08.614908 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 132/252] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:38:08 2022] GET /identity/v3/projects/38cebd4b9d0f44b4af767a7143050e7d => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:08.621081 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40488be5-f929-460c-988a-50dee20c3871 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:08.735513 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40488be5-f929-460c-988a-50dee20c3871 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:08.772423 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e7414-2441-49cb-8c01-7645c86af65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:08.773453 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e7414-2441-49cb-8c01-7645c86af65f None admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:08.773782 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e7414-2441-49cb-8c01-7645c86af65f None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:08.774059 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e7414-2441-49cb-8c01-7645c86af65f None admin] PATH_INFO: `/v3/projects/38cebd4b9d0f44b4af767a7143050e7d/users/d4a076e3c66242b882ed6db845b84e94/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:08.776284 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e7414-2441-49cb-8c01-7645c86af65f None admin] RBAC: Authorizing `identity:create_grant(project_id=38cebd4b9d0f44b4af767a7143050e7d, user_id=d4a076e3c66242b882ed6db845b84e94, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:08.777765 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e7414-2441-49cb-8c01-7645c86af65f None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:08.800447 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 121/253] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 20:38:08 2022] PUT /identity/v3/projects/38cebd4b9d0f44b4af767a7143050e7d/users/d4a076e3c66242b882ed6db845b84e94/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:38:08.999547 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690844c0-ddfc-441e-a239-febd28f6db7c None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:08.999952 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690844c0-ddfc-441e-a239-febd28f6db7c None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:09.000180 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690844c0-ddfc-441e-a239-febd28f6db7c None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:09.002017 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 133/254] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:09.008484 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599f8be-0f8a-41df-8a2b-0dc31bf71174 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:09.008785 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599f8be-0f8a-41df-8a2b-0dc31bf71174 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:09.009035 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599f8be-0f8a-41df-8a2b-0dc31bf71174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:09.034858 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-b599f8be-0f8a-41df-8a2b-0dc31bf71174 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:09.036629 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-b599f8be-0f8a-41df-8a2b-0dc31bf71174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:09.138306 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 122/255] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:38:09.174349 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996f425-f215-49a0-baf7-842d01b9f9ee None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:09.174818 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996f425-f215-49a0-baf7-842d01b9f9ee None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:09.175278 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996f425-f215-49a0-baf7-842d01b9f9ee None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:09.185198 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599f8be-0f8a-41df-8a2b-0dc31bf71174 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:09.185497 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 134/256] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:09 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:09.201247 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6a791-e52d-4440-bef1-a512a76461ad None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:09.201726 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6a791-e52d-4440-bef1-a512a76461ad None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:09.202205 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6a791-e52d-4440-bef1-a512a76461ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:09.231774 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-4ac6a791-e52d-4440-bef1-a512a76461ad None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:09.231774 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-4ac6a791-e52d-4440-bef1-a512a76461ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:09.324093 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 135/257] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 20:38:09.351170 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6a791-e52d-4440-bef1-a512a76461ad None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:09.465348 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6a791-e52d-4440-bef1-a512a76461ad None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:09.475229 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599f8be-0f8a-41df-8a2b-0dc31bf71174 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:09.510725 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f8e80c-3635-4173-9ef2-215f10629b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:09.511677 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8e80c-3635-4173-9ef2-215f10629b4b None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:09.512059 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8e80c-3635-4173-9ef2-215f10629b4b None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:09.512402 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8e80c-3635-4173-9ef2-215f10629b4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:09.518033 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a8144-eb63-428f-bbf3-9fbae79df644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:09.518869 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a8144-eb63-428f-bbf3-9fbae79df644 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:09.519143 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a8144-eb63-428f-bbf3-9fbae79df644 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:09.519600 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a8144-eb63-428f-bbf3-9fbae79df644 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:09.525884 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f8e80c-3635-4173-9ef2-215f10629b4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:09.533315 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-e3f8e80c-3635-4173-9ef2-215f10629b4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 20:38:09.533585 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a8144-eb63-428f-bbf3-9fbae79df644 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:09.534904 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 136/258] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 20:38:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:38:09.542128 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f8e80c-3635-4173-9ef2-215f10629b4b None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:09.542448 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-ff1a8144-eb63-428f-bbf3-9fbae79df644 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 20:38:09.544079 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 123/259] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 20:38:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:38:09.550543 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a8144-eb63-428f-bbf3-9fbae79df644 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:09.663594 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f8e80c-3635-4173-9ef2-215f10629b4b None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:09.703217 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539aec5-3d08-4e0f-9fa6-e0f04f13492c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:09.703987 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539aec5-3d08-4e0f-9fa6-e0f04f13492c None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:09.704271 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539aec5-3d08-4e0f-9fa6-e0f04f13492c None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:09.704520 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539aec5-3d08-4e0f-9fa6-e0f04f13492c None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:09.705305 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539aec5-3d08-4e0f-9fa6-e0f04f13492c None admin] RBAC: Adding query filter params (name=admin) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:09.705618 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539aec5-3d08-4e0f-9fa6-e0f04f13492c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:09.707088 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539aec5-3d08-4e0f-9fa6-e0f04f13492c None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:09.717180 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 137/260] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:38:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:09.722918 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539aec5-3d08-4e0f-9fa6-e0f04f13492c None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:09.791610 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a8144-eb63-428f-bbf3-9fbae79df644 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:09.834489 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539aec5-3d08-4e0f-9fa6-e0f04f13492c None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:09.857435 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b64e5-0aab-46b7-8a47-8f94577b8d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:09.858119 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b64e5-0aab-46b7-8a47-8f94577b8d44 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:09.858396 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b64e5-0aab-46b7-8a47-8f94577b8d44 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:09.858629 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b64e5-0aab-46b7-8a47-8f94577b8d44 None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:09.859400 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b64e5-0aab-46b7-8a47-8f94577b8d44 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:09.859708 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b64e5-0aab-46b7-8a47-8f94577b8d44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:09.861218 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b64e5-0aab-46b7-8a47-8f94577b8d44 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:09.884184 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 124/261] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:38:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:09.889811 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b64e5-0aab-46b7-8a47-8f94577b8d44 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:09.906387 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5770b45-0a4f-454c-9955-e5d937381e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:09.907331 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5770b45-0a4f-454c-9955-e5d937381e76 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:09.907610 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5770b45-0a4f-454c-9955-e5d937381e76 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:09.907908 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5770b45-0a4f-454c-9955-e5d937381e76 None admin] PATH_INFO: `/v3/users/e2886346629049e9a01a3e679616bd42` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:09.909715 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5770b45-0a4f-454c-9955-e5d937381e76 None admin] RBAC: Authorizing `identity:get_user(user_id=e2886346629049e9a01a3e679616bd42)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:09.913104 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5770b45-0a4f-454c-9955-e5d937381e76 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:09.915453 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 138/262] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:38:09 2022] GET /identity/v3/users/e2886346629049e9a01a3e679616bd42 => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:09.923601 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5770b45-0a4f-454c-9955-e5d937381e76 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:10.037050 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5770b45-0a4f-454c-9955-e5d937381e76 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:10.051958 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b64e5-0aab-46b7-8a47-8f94577b8d44 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:10.073808 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780c20d-5064-4fb5-9fb5-13e68bf7f62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:10.074468 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780c20d-5064-4fb5-9fb5-13e68bf7f62f None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:10.074747 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780c20d-5064-4fb5-9fb5-13e68bf7f62f None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:10.075023 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780c20d-5064-4fb5-9fb5-13e68bf7f62f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:10.091364 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd354bf-a3e0-4831-bab7-e7e2aaca4bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:10.092314 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd354bf-a3e0-4831-bab7-e7e2aaca4bbc None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:10.092645 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd354bf-a3e0-4831-bab7-e7e2aaca4bbc None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:10.092924 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd354bf-a3e0-4831-bab7-e7e2aaca4bbc None admin] PATH_INFO: `/v3/users/e2886346629049e9a01a3e679616bd42` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:10.094105 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd354bf-a3e0-4831-bab7-e7e2aaca4bbc None admin] RBAC: Authorizing `identity:get_user(user_id=e2886346629049e9a01a3e679616bd42)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:10.095566 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd354bf-a3e0-4831-bab7-e7e2aaca4bbc None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:10.097655 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 125/263] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:38:09 2022] GET /identity/v3/users/e2886346629049e9a01a3e679616bd42 => generated 283 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:10.112181 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd354bf-a3e0-4831-bab7-e7e2aaca4bbc None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:10.234267 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780c20d-5064-4fb5-9fb5-13e68bf7f62f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:10.235808 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780c20d-5064-4fb5-9fb5-13e68bf7f62f None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:10.369161 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd354bf-a3e0-4831-bab7-e7e2aaca4bbc None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:10.438893 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e06e5d-e7cc-4fd0-85b9-30c62d1e17af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:10.439570 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e06e5d-e7cc-4fd0-85b9-30c62d1e17af None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:10.439876 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e06e5d-e7cc-4fd0-85b9-30c62d1e17af None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:10.440153 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e06e5d-e7cc-4fd0-85b9-30c62d1e17af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:10.572888 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 139/264] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:38:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 20:38:10.579907 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780c20d-5064-4fb5-9fb5-13e68bf7f62f None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:10.582066 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e06e5d-e7cc-4fd0-85b9-30c62d1e17af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:10.584282 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e06e5d-e7cc-4fd0-85b9-30c62d1e17af None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:10.792963 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 126/265] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:38:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 20:38:10.803492 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e06e5d-e7cc-4fd0-85b9-30c62d1e17af None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:10.844654 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780c20d-5064-4fb5-9fb5-13e68bf7f62f None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:10.904260 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f21a4-c607-463b-b3b0-745240f351f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:10.905310 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f21a4-c607-463b-b3b0-745240f351f5 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:10.905717 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f21a4-c607-463b-b3b0-745240f351f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:10.905993 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f21a4-c607-463b-b3b0-745240f351f5 None admin] PATH_INFO: `/v3/projects/38cebd4b9d0f44b4af767a7143050e7d` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:10.907289 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78f21a4-c607-463b-b3b0-745240f351f5 None admin] RBAC: Authorizing `identity:get_project(project_id=38cebd4b9d0f44b4af767a7143050e7d)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:10.908789 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78f21a4-c607-463b-b3b0-745240f351f5 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:10.911665 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 140/266] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:38:10 2022] GET /identity/v3/projects/38cebd4b9d0f44b4af767a7143050e7d => generated 302 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:10.921053 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f21a4-c607-463b-b3b0-745240f351f5 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:11.094035 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e06e5d-e7cc-4fd0-85b9-30c62d1e17af None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:11.178639 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f21a4-c607-463b-b3b0-745240f351f5 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:11.182836 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0931a03-7f1a-42ac-ba34-4ac7017e07c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:11.183734 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0931a03-7f1a-42ac-ba34-4ac7017e07c0 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:11.184040 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0931a03-7f1a-42ac-ba34-4ac7017e07c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:11.184303 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0931a03-7f1a-42ac-ba34-4ac7017e07c0 None admin] PATH_INFO: `/v3/projects/38cebd4b9d0f44b4af767a7143050e7d` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:11.186528 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0931a03-7f1a-42ac-ba34-4ac7017e07c0 None admin] RBAC: Authorizing `identity:get_project(project_id=38cebd4b9d0f44b4af767a7143050e7d)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:11.193001 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0931a03-7f1a-42ac-ba34-4ac7017e07c0 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:11.195159 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 127/267] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:38:10 2022] GET /identity/v3/projects/38cebd4b9d0f44b4af767a7143050e7d => generated 302 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:11.209656 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0931a03-7f1a-42ac-ba34-4ac7017e07c0 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:11.290216 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df128c09-2459-469a-a0ed-c0e815cecfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:11.290893 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df128c09-2459-469a-a0ed-c0e815cecfd7 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:11.291165 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df128c09-2459-469a-a0ed-c0e815cecfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:11.291427 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df128c09-2459-469a-a0ed-c0e815cecfd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:11.292312 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df128c09-2459-469a-a0ed-c0e815cecfd7 None admin] RBAC: Adding query filter params (role.id=8fe105eeb7bf4856a94b0633bd781414, scope.project.id=38cebd4b9d0f44b4af767a7143050e7d, user.id=e2886346629049e9a01a3e679616bd42) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:11.292619 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df128c09-2459-469a-a0ed-c0e815cecfd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:11.294140 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df128c09-2459-469a-a0ed-c0e815cecfd7 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:11.322139 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 141/268] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:38:10 2022] GET /identity/v3/role_assignments?user.id=e2886346629049e9a01a3e679616bd42&scope.project.id=38cebd4b9d0f44b4af767a7143050e7d&role.id=8fe105eeb7bf4856a94b0633bd781414 => generated 608 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:11.415581 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0931a03-7f1a-42ac-ba34-4ac7017e07c0 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:11.463919 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843d441-d766-4810-9930-e74eb6ed77e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:11.464622 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843d441-d766-4810-9930-e74eb6ed77e1 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:11.465087 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843d441-d766-4810-9930-e74eb6ed77e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:11.465229 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843d441-d766-4810-9930-e74eb6ed77e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:11.466083 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843d441-d766-4810-9930-e74eb6ed77e1 None admin] RBAC: Adding query filter params (role.id=28b8756191f44cadbdae28d1af156b6c, scope.project.id=38cebd4b9d0f44b4af767a7143050e7d, user.id=e2886346629049e9a01a3e679616bd42) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:11.466386 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843d441-d766-4810-9930-e74eb6ed77e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:11.467937 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843d441-d766-4810-9930-e74eb6ed77e1 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:11.478605 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 128/269] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:38:11 2022] GET /identity/v3/role_assignments?user.id=e2886346629049e9a01a3e679616bd42&scope.project.id=38cebd4b9d0f44b4af767a7143050e7d&role.id=28b8756191f44cadbdae28d1af156b6c => generated 608 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:12.128985 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f933838-cd53-4a68-a508-294297b3471f None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:12.130283 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f933838-cd53-4a68-a508-294297b3471f None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:12.130283 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f933838-cd53-4a68-a508-294297b3471f None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:12.132514 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 142/270] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:38:12.137905 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9042e-eb1f-4a45-a6fc-ad28cc51a89b None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:12.138653 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9042e-eb1f-4a45-a6fc-ad28cc51a89b None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:12.138653 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9042e-eb1f-4a45-a6fc-ad28cc51a89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:12.158061 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-88c9042e-eb1f-4a45-a6fc-ad28cc51a89b None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:12.159219 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-88c9042e-eb1f-4a45-a6fc-ad28cc51a89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:12.289303 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 129/271] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:38:12.308339 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbbace-c23b-48ad-a7a0-a4fa14fe2c85 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:12.308745 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbbace-c23b-48ad-a7a0-a4fa14fe2c85 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:12.308982 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbbace-c23b-48ad-a7a0-a4fa14fe2c85 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:12.311141 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 143/272] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:12.318212 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fe87c-ac07-494f-8a57-64d04e0d083d None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:12.319127 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fe87c-ac07-494f-8a57-64d04e0d083d None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:12.319968 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fe87c-ac07-494f-8a57-64d04e0d083d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:12.324008 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbbace-c23b-48ad-a7a0-a4fa14fe2c85 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:12.357419 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-287fe87c-ac07-494f-8a57-64d04e0d083d None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:12.359889 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-287fe87c-ac07-494f-8a57-64d04e0d083d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:12.440409 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbbace-c23b-48ad-a7a0-a4fa14fe2c85 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:12.477842 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9016c8-0d92-4d85-9d54-05adbd0a519d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:12.478722 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9016c8-0d92-4d85-9d54-05adbd0a519d None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:12.478990 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9016c8-0d92-4d85-9d54-05adbd0a519d None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:12.479424 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9016c8-0d92-4d85-9d54-05adbd0a519d None admin] PATH_INFO: `/v3/domains/default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:12.480825 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9016c8-0d92-4d85-9d54-05adbd0a519d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:12.482484 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9016c8-0d92-4d85-9d54-05adbd0a519d None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:12.484653 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 144/273] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:38:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:12.485117 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 130/274] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:38:12.493352 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9016c8-0d92-4d85-9d54-05adbd0a519d None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:12.526419 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287fe87c-ac07-494f-8a57-64d04e0d083d None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:12.606417 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9016c8-0d92-4d85-9d54-05adbd0a519d None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:12.644761 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf25d80-d103-48f3-9723-f50dc485f53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:12.645877 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf25d80-d103-48f3-9723-f50dc485f53d None admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:12.646366 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf25d80-d103-48f3-9723-f50dc485f53d None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:12.646822 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf25d80-d103-48f3-9723-f50dc485f53d None admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:12.647765 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf25d80-d103-48f3-9723-f50dc485f53d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:12.649689 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf25d80-d103-48f3-9723-f50dc485f53d None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:12.683773 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 145/275] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Oct 28 20:38:12 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:38:12.683773 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075be07-23a3-408c-98c1-464021b0e5bc None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:12.683773 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075be07-23a3-408c-98c1-464021b0e5bc None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:12.683773 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075be07-23a3-408c-98c1-464021b0e5bc None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:12.683773 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 146/276] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:12.683773 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e7d34-03c8-4727-92c5-82b60d40f5b9 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:12.683773 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e7d34-03c8-4727-92c5-82b60d40f5b9 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:12.684310 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e7d34-03c8-4727-92c5-82b60d40f5b9 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:12.684644 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 147/277] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:12.690689 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22838925-2560-4d00-b6af-09f37d7a8a9c None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:12.690916 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22838925-2560-4d00-b6af-09f37d7a8a9c None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:12.691126 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22838925-2560-4d00-b6af-09f37d7a8a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:12.695979 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287fe87c-ac07-494f-8a57-64d04e0d083d None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:12.711298 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-22838925-2560-4d00-b6af-09f37d7a8a9c None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:12.712582 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-22838925-2560-4d00-b6af-09f37d7a8a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:12.736750 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3891f4-2a30-46c7-b31c-d75e5f00e0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:12.737806 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3891f4-2a30-46c7-b31c-d75e5f00e0c4 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:12.738086 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3891f4-2a30-46c7-b31c-d75e5f00e0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:12.738349 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3891f4-2a30-46c7-b31c-d75e5f00e0c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:12.751127 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3891f4-2a30-46c7-b31c-d75e5f00e0c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:12.758472 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-0c3891f4-2a30-46c7-b31c-d75e5f00e0c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 20:38:12.759779 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 131/278] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:38:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:12.761071 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426730d-8eeb-4680-b1c6-2fd32234f24e None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:12.761354 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426730d-8eeb-4680-b1c6-2fd32234f24e None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:12.761625 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426730d-8eeb-4680-b1c6-2fd32234f24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:12.780463 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-5426730d-8eeb-4680-b1c6-2fd32234f24e None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:12.781720 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-5426730d-8eeb-4680-b1c6-2fd32234f24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:12.821521 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 148/279] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 20:38:12.822819 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22838925-2560-4d00-b6af-09f37d7a8a9c None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:12.896065 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 132/280] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:38:12.897006 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426730d-8eeb-4680-b1c6-2fd32234f24e None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:12.967796 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22838925-2560-4d00-b6af-09f37d7a8a9c None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:13.012866 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426730d-8eeb-4680-b1c6-2fd32234f24e None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:13.016065 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca4eb6-f471-4463-a447-0b78a4d05e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:13.016975 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca4eb6-f471-4463-a447-0b78a4d05e2a None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:13.017284 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca4eb6-f471-4463-a447-0b78a4d05e2a None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:13.017528 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca4eb6-f471-4463-a447-0b78a4d05e2a None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:13.018689 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca4eb6-f471-4463-a447-0b78a4d05e2a None admin] RBAC: Adding query filter params (name=member) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:13.018689 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca4eb6-f471-4463-a447-0b78a4d05e2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:13.020028 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca4eb6-f471-4463-a447-0b78a4d05e2a None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:13.031414 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 149/281] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 20:38:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:13.032293 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca4eb6-f471-4463-a447-0b78a4d05e2a None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:13.072744 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e86aeea-8dc5-46ca-aec2-102c0a112ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:13.073841 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86aeea-8dc5-46ca-aec2-102c0a112ddf None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:13.074116 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86aeea-8dc5-46ca-aec2-102c0a112ddf None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:13.074385 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86aeea-8dc5-46ca-aec2-102c0a112ddf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:13.095251 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e86aeea-8dc5-46ca-aec2-102c0a112ddf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:13.101502 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-8e86aeea-8dc5-46ca-aec2-102c0a112ddf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 20:38:13.102944 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 133/282] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:38:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:13.103590 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e86aeea-8dc5-46ca-aec2-102c0a112ddf None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:13.177595 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca4eb6-f471-4463-a447-0b78a4d05e2a None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:13.214741 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e86aeea-8dc5-46ca-aec2-102c0a112ddf None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:13.226345 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07773b-d440-447d-9066-2fd22df30fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:13.227148 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07773b-d440-447d-9066-2fd22df30fdf None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:13.227424 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07773b-d440-447d-9066-2fd22df30fdf None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:13.227693 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07773b-d440-447d-9066-2fd22df30fdf None admin] PATH_INFO: `/v3/roles/member` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:13.242509 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07773b-d440-447d-9066-2fd22df30fdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:13.252789 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-9c07773b-d440-447d-9066-2fd22df30fdf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 20:38:13.254311 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 150/283] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:38:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:13.259033 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07773b-d440-447d-9066-2fd22df30fdf None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:13.263366 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede47327-725a-463d-a19b-a7f18caec99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:13.264534 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede47327-725a-463d-a19b-a7f18caec99d None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:13.264979 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede47327-725a-463d-a19b-a7f18caec99d None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:13.265446 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede47327-725a-463d-a19b-a7f18caec99d None admin] PATH_INFO: `/v3/users/ce991129851446da9d8eb63ead00781f` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:13.288373 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede47327-725a-463d-a19b-a7f18caec99d None admin] RBAC: Authorizing `identity:get_user(user_id=ce991129851446da9d8eb63ead00781f)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:13.290133 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede47327-725a-463d-a19b-a7f18caec99d None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:13.292206 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 134/284] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:38:13 2022] GET /identity/v3/users/ce991129851446da9d8eb63ead00781f => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:13.293157 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede47327-725a-463d-a19b-a7f18caec99d None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:13.376386 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07773b-d440-447d-9066-2fd22df30fdf None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:13.410493 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676dde2d-9a33-4312-b467-00401e0ab051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:13.412288 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dde2d-9a33-4312-b467-00401e0ab051 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:13.412760 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dde2d-9a33-4312-b467-00401e0ab051 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:13.413198 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dde2d-9a33-4312-b467-00401e0ab051 None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:13.414124 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676dde2d-9a33-4312-b467-00401e0ab051 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:13.414596 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676dde2d-9a33-4312-b467-00401e0ab051 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:13.415124 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede47327-725a-463d-a19b-a7f18caec99d None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:13.416375 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676dde2d-9a33-4312-b467-00401e0ab051 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:13.425253 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 151/285] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 20:38:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:13.426416 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676dde2d-9a33-4312-b467-00401e0ab051 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:13.458543 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5a8a5-ae2e-464d-ab40-37db10539cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:13.459230 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5a8a5-ae2e-464d-ab40-37db10539cf2 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:13.459510 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5a8a5-ae2e-464d-ab40-37db10539cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:13.459804 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5a8a5-ae2e-464d-ab40-37db10539cf2 None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:13.461032 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5a8a5-ae2e-464d-ab40-37db10539cf2 None admin] RBAC: Adding query filter params (name=member) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:13.461280 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5a8a5-ae2e-464d-ab40-37db10539cf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:13.462986 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5a8a5-ae2e-464d-ab40-37db10539cf2 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:13.473473 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 135/286] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 20:38:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:13.478166 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5a8a5-ae2e-464d-ab40-37db10539cf2 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:13.538782 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676dde2d-9a33-4312-b467-00401e0ab051 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:13.576794 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d14ad-2f9e-477e-95b1-98bbccb99d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:13.577464 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d14ad-2f9e-477e-95b1-98bbccb99d90 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:13.577742 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d14ad-2f9e-477e-95b1-98bbccb99d90 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:13.578013 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d14ad-2f9e-477e-95b1-98bbccb99d90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:13.578859 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d14ad-2f9e-477e-95b1-98bbccb99d90 None admin] RBAC: Adding query filter params (role.id=aaafbf9fe78e46cd9f06410394fdb531, user.id=ce991129851446da9d8eb63ead00781f, scope.system=all) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:13.579166 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d14ad-2f9e-477e-95b1-98bbccb99d90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:13.581372 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d14ad-2f9e-477e-95b1-98bbccb99d90 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:13.588484 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 152/287] 10.222.0.49 () {56 vars in 1308 bytes} [Fri Oct 28 20:38:13 2022] GET /identity/v3/role_assignments?user.id=ce991129851446da9d8eb63ead00781f&scope.system=all&role.id=aaafbf9fe78e46cd9f06410394fdb531 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:13.589615 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d14ad-2f9e-477e-95b1-98bbccb99d90 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:13.613611 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5a8a5-ae2e-464d-ab40-37db10539cf2 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:13.658449 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef8b70-7552-45ea-be63-df83c289d692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:13.659843 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef8b70-7552-45ea-be63-df83c289d692 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:13.660364 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef8b70-7552-45ea-be63-df83c289d692 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:13.661742 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef8b70-7552-45ea-be63-df83c289d692 None admin] PATH_INFO: `/v3/users/438f1b8ecaa24aeebd224aff8c42fb20` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:13.663888 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef8b70-7552-45ea-be63-df83c289d692 None admin] RBAC: Authorizing `identity:get_user(user_id=438f1b8ecaa24aeebd224aff8c42fb20)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:13.665756 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef8b70-7552-45ea-be63-df83c289d692 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:13.667965 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 136/288] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:38:13 2022] GET /identity/v3/users/438f1b8ecaa24aeebd224aff8c42fb20 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:13.678581 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef8b70-7552-45ea-be63-df83c289d692 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:13.769616 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d14ad-2f9e-477e-95b1-98bbccb99d90 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:13.865464 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d44b3-fa04-49f0-b02e-cda71ea4f611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:13.866369 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d44b3-fa04-49f0-b02e-cda71ea4f611 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:13.866647 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d44b3-fa04-49f0-b02e-cda71ea4f611 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:13.866918 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d44b3-fa04-49f0-b02e-cda71ea4f611 None admin] PATH_INFO: `/v3/users/d4a076e3c66242b882ed6db845b84e94` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:13.869299 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d44b3-fa04-49f0-b02e-cda71ea4f611 None admin] RBAC: Authorizing `identity:get_user(user_id=d4a076e3c66242b882ed6db845b84e94)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:13.870821 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d44b3-fa04-49f0-b02e-cda71ea4f611 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:13.877318 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 153/289] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:38:13 2022] GET /identity/v3/users/d4a076e3c66242b882ed6db845b84e94 => generated 297 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:13.878285 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d44b3-fa04-49f0-b02e-cda71ea4f611 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:13.912405 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef8b70-7552-45ea-be63-df83c289d692 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:13.982647 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8915d-ddda-4008-b0b5-53d0a7027514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:13.984361 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8915d-ddda-4008-b0b5-53d0a7027514 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:13.984832 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8915d-ddda-4008-b0b5-53d0a7027514 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:13.985649 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8915d-ddda-4008-b0b5-53d0a7027514 None admin] PATH_INFO: `/v3/projects/38cebd4b9d0f44b4af767a7143050e7d` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:13.993218 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8915d-ddda-4008-b0b5-53d0a7027514 None admin] RBAC: Authorizing `identity:get_project(project_id=38cebd4b9d0f44b4af767a7143050e7d)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:13.995976 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8915d-ddda-4008-b0b5-53d0a7027514 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:14.004293 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 137/290] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:38:13 2022] GET /identity/v3/projects/38cebd4b9d0f44b4af767a7143050e7d => generated 302 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:14.008942 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8915d-ddda-4008-b0b5-53d0a7027514 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:14.013639 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d44b3-fa04-49f0-b02e-cda71ea4f611 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:14.063504 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c086f-8318-4abe-bafe-d7fc8de56b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:14.064586 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c086f-8318-4abe-bafe-d7fc8de56b86 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:14.065078 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c086f-8318-4abe-bafe-d7fc8de56b86 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:14.065580 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c086f-8318-4abe-bafe-d7fc8de56b86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:14.233787 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c086f-8318-4abe-bafe-d7fc8de56b86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:14.236781 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c086f-8318-4abe-bafe-d7fc8de56b86 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:14.309613 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8915d-ddda-4008-b0b5-53d0a7027514 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:14.354723 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f57433-3f50-4f61-9a0a-3cec306e8202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:14.356041 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f57433-3f50-4f61-9a0a-3cec306e8202 None admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:14.356540 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f57433-3f50-4f61-9a0a-3cec306e8202 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:14.357011 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f57433-3f50-4f61-9a0a-3cec306e8202 None admin] PATH_INFO: `/v3/projects/38cebd4b9d0f44b4af767a7143050e7d/users/438f1b8ecaa24aeebd224aff8c42fb20/roles/a5a6a249ab1f472e93ce008d03b41039` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:14.359842 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f57433-3f50-4f61-9a0a-3cec306e8202 None admin] RBAC: Authorizing `identity:create_grant(project_id=38cebd4b9d0f44b4af767a7143050e7d, user_id=438f1b8ecaa24aeebd224aff8c42fb20, role_id=a5a6a249ab1f472e93ce008d03b41039)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:14.362739 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f57433-3f50-4f61-9a0a-3cec306e8202 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:14.382005 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 138/291] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 20:38:14 2022] PUT /identity/v3/projects/38cebd4b9d0f44b4af767a7143050e7d/users/438f1b8ecaa24aeebd224aff8c42fb20/roles/a5a6a249ab1f472e93ce008d03b41039 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:38:14.524702 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 154/292] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:38:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 20:38:14.532973 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f57433-3f50-4f61-9a0a-3cec306e8202 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:14.713341 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f57433-3f50-4f61-9a0a-3cec306e8202 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:14.752297 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96030a23-b174-418c-8f0b-787ddcec3084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:14.753199 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96030a23-b174-418c-8f0b-787ddcec3084 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:14.753477 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96030a23-b174-418c-8f0b-787ddcec3084 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:14.753750 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96030a23-b174-418c-8f0b-787ddcec3084 None admin] PATH_INFO: `/v3/projects/38cebd4b9d0f44b4af767a7143050e7d` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:14.755477 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96030a23-b174-418c-8f0b-787ddcec3084 None admin] RBAC: Authorizing `identity:get_project(project_id=38cebd4b9d0f44b4af767a7143050e7d)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:14.757070 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96030a23-b174-418c-8f0b-787ddcec3084 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:14.759453 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 139/293] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:38:14 2022] GET /identity/v3/projects/38cebd4b9d0f44b4af767a7143050e7d => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:14.768349 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c086f-8318-4abe-bafe-d7fc8de56b86 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:14.933090 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c086f-8318-4abe-bafe-d7fc8de56b86 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:14.990818 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd638c-5c28-45e0-a153-918c02b22315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:14.991410 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd638c-5c28-45e0-a153-918c02b22315 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:14.991683 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd638c-5c28-45e0-a153-918c02b22315 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:14.991976 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd638c-5c28-45e0-a153-918c02b22315 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:14.992825 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd638c-5c28-45e0-a153-918c02b22315 None admin] RBAC: Adding query filter params (role.id=aaafbf9fe78e46cd9f06410394fdb531, scope.project.id=38cebd4b9d0f44b4af767a7143050e7d, user.id=d4a076e3c66242b882ed6db845b84e94) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:14.993134 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd638c-5c28-45e0-a153-918c02b22315 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:14.994617 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd638c-5c28-45e0-a153-918c02b22315 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:15.005554 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 155/294] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:38:14 2022] GET /identity/v3/role_assignments?user.id=d4a076e3c66242b882ed6db845b84e94&scope.project.id=38cebd4b9d0f44b4af767a7143050e7d&role.id=aaafbf9fe78e46cd9f06410394fdb531 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:15.941749 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db6dde-7995-4952-873f-05a5e879ec5c None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:15.942877 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db6dde-7995-4952-873f-05a5e879ec5c None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:15.942877 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db6dde-7995-4952-873f-05a5e879ec5c None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:15.945706 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 140/295] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:15.951659 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb4f59-dec3-4555-b447-0e3e7c539636 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:15.952237 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb4f59-dec3-4555-b447-0e3e7c539636 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:15.952237 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb4f59-dec3-4555-b447-0e3e7c539636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:15.972274 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-adcb4f59-dec3-4555-b447-0e3e7c539636 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:15.973566 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-adcb4f59-dec3-4555-b447-0e3e7c539636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:16.054461 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 156/296] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:38:16.078709 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db6dde-7995-4952-873f-05a5e879ec5c None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:16.195294 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db6dde-7995-4952-873f-05a5e879ec5c None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:16.234977 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf0dfa-39b5-4959-bcb4-01500cfaf5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:16.235837 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf0dfa-39b5-4959-bcb4-01500cfaf5b4 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:16.236115 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf0dfa-39b5-4959-bcb4-01500cfaf5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:16.236384 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf0dfa-39b5-4959-bcb4-01500cfaf5b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:16.237695 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf0dfa-39b5-4959-bcb4-01500cfaf5b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:16.239778 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf0dfa-39b5-4959-bcb4-01500cfaf5b4 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:16.242252 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 141/297] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:38:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:16.246583 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f9c62-29f5-48f9-a730-e35b997d93ee None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:16.246583 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f9c62-29f5-48f9-a730-e35b997d93ee None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:16.247120 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f9c62-29f5-48f9-a730-e35b997d93ee None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:16.247924 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf0dfa-39b5-4959-bcb4-01500cfaf5b4 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:16.249505 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 157/298] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:16.256270 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d850d35-f4b7-47f3-9846-a182e8acb9e3 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:16.256887 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d850d35-f4b7-47f3-9846-a182e8acb9e3 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:16.257357 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d850d35-f4b7-47f3-9846-a182e8acb9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:16.276388 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-2d850d35-f4b7-47f3-9846-a182e8acb9e3 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:16.278048 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-2d850d35-f4b7-47f3-9846-a182e8acb9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:16.372163 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 158/299] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 20:38:16.385999 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf0dfa-39b5-4959-bcb4-01500cfaf5b4 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:16.398464 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d850d35-f4b7-47f3-9846-a182e8acb9e3 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:16.433471 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991f779-df8f-456e-8fc7-9b5c4c436772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:16.434155 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991f779-df8f-456e-8fc7-9b5c4c436772 None admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:16.434428 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991f779-df8f-456e-8fc7-9b5c4c436772 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:16.434688 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991f779-df8f-456e-8fc7-9b5c4c436772 None admin] PATH_INFO: `/v3/groups` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:16.435714 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991f779-df8f-456e-8fc7-9b5c4c436772 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:16.437278 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991f779-df8f-456e-8fc7-9b5c4c436772 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:16.457535 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 142/300] 10.222.0.49 () {60 vars in 1134 bytes} [Fri Oct 28 20:38:16 2022] POST /identity/v3/groups => generated 229 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:38:16.546529 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d850d35-f4b7-47f3-9846-a182e8acb9e3 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:16.591627 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b007322-8b30-42a1-9287-c832adb13c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:16.592524 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b007322-8b30-42a1-9287-c832adb13c58 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:16.592799 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b007322-8b30-42a1-9287-c832adb13c58 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:16.593077 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b007322-8b30-42a1-9287-c832adb13c58 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:16.606588 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b007322-8b30-42a1-9287-c832adb13c58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:16.614891 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-6b007322-8b30-42a1-9287-c832adb13c58 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 20:38:16.616665 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 159/301] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:38:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:38:16.628746 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991f779-df8f-456e-8fc7-9b5c4c436772 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:16.748352 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991f779-df8f-456e-8fc7-9b5c4c436772 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:16.785096 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d50bb-5bfc-46f8-921a-9121e84a7bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:16.785797 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d50bb-5bfc-46f8-921a-9121e84a7bdb None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:16.786075 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d50bb-5bfc-46f8-921a-9121e84a7bdb None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:16.786758 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d50bb-5bfc-46f8-921a-9121e84a7bdb None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:16.787836 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d50bb-5bfc-46f8-921a-9121e84a7bdb None admin] RBAC: Adding query filter params (name=reader) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:16.788144 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d50bb-5bfc-46f8-921a-9121e84a7bdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:16.789536 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d50bb-5bfc-46f8-921a-9121e84a7bdb None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:16.799121 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 143/302] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 20:38:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:16.804989 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b007322-8b30-42a1-9287-c832adb13c58 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:16.873976 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77a36b-0a15-43c6-8d6b-69e66e1be397 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:16.874340 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77a36b-0a15-43c6-8d6b-69e66e1be397 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:16.874531 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77a36b-0a15-43c6-8d6b-69e66e1be397 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:16.876876 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 144/303] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:16.883135 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74686296-feb4-4334-92d4-447fd77bf0ab None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:16.883452 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74686296-feb4-4334-92d4-447fd77bf0ab None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:16.883687 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74686296-feb4-4334-92d4-447fd77bf0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:16.903037 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-74686296-feb4-4334-92d4-447fd77bf0ab None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:16.904327 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-74686296-feb4-4334-92d4-447fd77bf0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:16.982571 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 145/304] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 20:38:17.006137 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74686296-feb4-4334-92d4-447fd77bf0ab None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:17.038495 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b007322-8b30-42a1-9287-c832adb13c58 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:17.073745 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cafee1-a04a-4660-a8a1-9ce2707c4e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:17.074607 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cafee1-a04a-4660-a8a1-9ce2707c4e19 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:17.074880 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cafee1-a04a-4660-a8a1-9ce2707c4e19 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:17.075146 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cafee1-a04a-4660-a8a1-9ce2707c4e19 None admin] PATH_INFO: `/v3/users/104f7c0be3e1426db34293f0c1418cac` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:17.090343 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cafee1-a04a-4660-a8a1-9ce2707c4e19 None admin] RBAC: Authorizing `identity:get_user(user_id=104f7c0be3e1426db34293f0c1418cac)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:17.091927 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cafee1-a04a-4660-a8a1-9ce2707c4e19 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:17.099795 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 160/305] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:38:16 2022] GET /identity/v3/users/104f7c0be3e1426db34293f0c1418cac => generated 293 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:17.100835 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cafee1-a04a-4660-a8a1-9ce2707c4e19 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:17.107548 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74686296-feb4-4334-92d4-447fd77bf0ab None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:17.142087 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9993360d-f761-4888-8c73-e16d6340d6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:17.142900 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993360d-f761-4888-8c73-e16d6340d6f5 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:17.143174 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993360d-f761-4888-8c73-e16d6340d6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:17.143440 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993360d-f761-4888-8c73-e16d6340d6f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:17.158751 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9993360d-f761-4888-8c73-e16d6340d6f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:17.169470 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-9993360d-f761-4888-8c73-e16d6340d6f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 20:38:17.176004 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 146/306] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:38:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:38:17.178670 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9993360d-f761-4888-8c73-e16d6340d6f5 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:17.207850 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cafee1-a04a-4660-a8a1-9ce2707c4e19 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:17.244191 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e47ddd-e9bc-4ee9-b4a7-3b3330748ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:17.244936 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e47ddd-e9bc-4ee9-b4a7-3b3330748ca4 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:17.245277 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e47ddd-e9bc-4ee9-b4a7-3b3330748ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:17.245633 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e47ddd-e9bc-4ee9-b4a7-3b3330748ca4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:17.246527 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e47ddd-e9bc-4ee9-b4a7-3b3330748ca4 None admin] RBAC: Adding query filter params (role.id=a5a6a249ab1f472e93ce008d03b41039, user.id=104f7c0be3e1426db34293f0c1418cac, scope.system=all) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:17.246900 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e47ddd-e9bc-4ee9-b4a7-3b3330748ca4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:17.248577 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e47ddd-e9bc-4ee9-b4a7-3b3330748ca4 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:17.254062 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 161/307] 10.222.0.49 () {56 vars in 1308 bytes} [Fri Oct 28 20:38:17 2022] GET /identity/v3/role_assignments?user.id=104f7c0be3e1426db34293f0c1418cac&scope.system=all&role.id=a5a6a249ab1f472e93ce008d03b41039 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:17.298430 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9993360d-f761-4888-8c73-e16d6340d6f5 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:17.339372 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc793b-73e0-4aaa-855a-3043bae7e7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:17.340380 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc793b-73e0-4aaa-855a-3043bae7e7b6 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:17.340801 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc793b-73e0-4aaa-855a-3043bae7e7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:17.341215 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc793b-73e0-4aaa-855a-3043bae7e7b6 None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:17.342129 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc793b-73e0-4aaa-855a-3043bae7e7b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:17.342601 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc793b-73e0-4aaa-855a-3043bae7e7b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:17.344218 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc793b-73e0-4aaa-855a-3043bae7e7b6 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:17.355051 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 147/308] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 20:38:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:17.361427 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e47ddd-e9bc-4ee9-b4a7-3b3330748ca4 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:17.482742 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e47ddd-e9bc-4ee9-b4a7-3b3330748ca4 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:17.520982 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c2a49-037f-4830-9e5f-db74529d7a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:17.521876 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c2a49-037f-4830-9e5f-db74529d7a3e None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:17.522151 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c2a49-037f-4830-9e5f-db74529d7a3e None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:17.522418 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c2a49-037f-4830-9e5f-db74529d7a3e None admin] PATH_INFO: `/v3/users/ce991129851446da9d8eb63ead00781f` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:17.523685 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c2a49-037f-4830-9e5f-db74529d7a3e None admin] RBAC: Authorizing `identity:get_user(user_id=ce991129851446da9d8eb63ead00781f)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:17.525369 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c2a49-037f-4830-9e5f-db74529d7a3e None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:17.527328 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 162/309] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:38:17 2022] GET /identity/v3/users/ce991129851446da9d8eb63ead00781f => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:17.532923 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc793b-73e0-4aaa-855a-3043bae7e7b6 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:17.574667 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42795aa6-d1df-469c-a5e3-23ee97f6f7e5 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:17.574890 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42795aa6-d1df-469c-a5e3-23ee97f6f7e5 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:17.575206 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42795aa6-d1df-469c-a5e3-23ee97f6f7e5 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:17.577206 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 163/310] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:38:17.583499 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d83918-623d-459d-8300-25baeac6e9ad None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:17.583499 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d83918-623d-459d-8300-25baeac6e9ad None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:17.583928 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d83918-623d-459d-8300-25baeac6e9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:17.613816 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-c4d83918-623d-459d-8300-25baeac6e9ad None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:17.613816 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-c4d83918-623d-459d-8300-25baeac6e9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:17.681432 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc793b-73e0-4aaa-855a-3043bae7e7b6 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:17.726989 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1af32-e740-4adf-8ced-82e688a84687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:17.727940 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1af32-e740-4adf-8ced-82e688a84687 None admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:17.728216 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1af32-e740-4adf-8ced-82e688a84687 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:17.728537 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1af32-e740-4adf-8ced-82e688a84687 None admin] PATH_INFO: `/v3/system/users/ce991129851446da9d8eb63ead00781f/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:17.730153 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1af32-e740-4adf-8ced-82e688a84687 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ce991129851446da9d8eb63ead00781f, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:17.731539 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1af32-e740-4adf-8ced-82e688a84687 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:17.744005 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 148/311] 10.222.0.49 () {58 vars in 1334 bytes} [Fri Oct 28 20:38:17 2022] PUT /identity/v3/system/users/ce991129851446da9d8eb63ead00781f/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:38:17.756332 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 164/312] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 20:38:17.791311 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1af32-e740-4adf-8ced-82e688a84687 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:17.977463 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1af32-e740-4adf-8ced-82e688a84687 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:18.042364 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e934c-aa3d-4110-a2c2-fe2005146e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:18.043719 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e934c-aa3d-4110-a2c2-fe2005146e8c None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:18.044238 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e934c-aa3d-4110-a2c2-fe2005146e8c None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:18.044728 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e934c-aa3d-4110-a2c2-fe2005146e8c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:18.064543 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e934c-aa3d-4110-a2c2-fe2005146e8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:18.079056 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-e23e934c-aa3d-4110-a2c2-fe2005146e8c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 20:38:18.081692 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 149/313] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:38:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:18.091476 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d83918-623d-459d-8300-25baeac6e9ad None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:18.269968 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d83918-623d-459d-8300-25baeac6e9ad None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:18.332328 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8313759-5fab-4249-b2ac-fae8fec6deba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:18.334470 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8313759-5fab-4249-b2ac-fae8fec6deba None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:18.334915 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8313759-5fab-4249-b2ac-fae8fec6deba None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:18.335400 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8313759-5fab-4249-b2ac-fae8fec6deba None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:18.336861 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8313759-5fab-4249-b2ac-fae8fec6deba None admin] RBAC: Adding query filter params (name=reader) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:18.337380 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8313759-5fab-4249-b2ac-fae8fec6deba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:18.340007 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8313759-5fab-4249-b2ac-fae8fec6deba None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:18.357038 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 165/314] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 20:38:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:18.366746 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e934c-aa3d-4110-a2c2-fe2005146e8c None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:18.551898 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e934c-aa3d-4110-a2c2-fe2005146e8c None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:18.610923 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a202e7f-8ef1-4409-89c4-e2350ca58d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:18.612525 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a202e7f-8ef1-4409-89c4-e2350ca58d11 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:18.613012 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a202e7f-8ef1-4409-89c4-e2350ca58d11 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:18.614426 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a202e7f-8ef1-4409-89c4-e2350ca58d11 None admin] PATH_INFO: `/v3/users/438f1b8ecaa24aeebd224aff8c42fb20` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:18.617027 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a202e7f-8ef1-4409-89c4-e2350ca58d11 None admin] RBAC: Authorizing `identity:get_user(user_id=438f1b8ecaa24aeebd224aff8c42fb20)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:18.619601 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a202e7f-8ef1-4409-89c4-e2350ca58d11 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:18.623046 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 150/315] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:38:18 2022] GET /identity/v3/users/438f1b8ecaa24aeebd224aff8c42fb20 => generated 297 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:18.628263 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8313759-5fab-4249-b2ac-fae8fec6deba None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:18.786911 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8313759-5fab-4249-b2ac-fae8fec6deba None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:18.849241 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf94c7a1-8eb5-432b-a580-e0532bfde914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:18.850583 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94c7a1-8eb5-432b-a580-e0532bfde914 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:18.851103 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94c7a1-8eb5-432b-a580-e0532bfde914 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:18.851587 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94c7a1-8eb5-432b-a580-e0532bfde914 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:18.981319 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf94c7a1-8eb5-432b-a580-e0532bfde914 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:18.984462 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf94c7a1-8eb5-432b-a580-e0532bfde914 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:19.060665 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e38bc-90a4-4e5a-981e-a22f0a595900 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:19.061632 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e38bc-90a4-4e5a-981e-a22f0a595900 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:19.062122 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e38bc-90a4-4e5a-981e-a22f0a595900 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:19.064188 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 151/316] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:19.071009 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910f112-f7be-40c6-a43c-434a6e129133 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:19.071604 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910f112-f7be-40c6-a43c-434a6e129133 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:19.072171 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910f112-f7be-40c6-a43c-434a6e129133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:19.091235 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-b910f112-f7be-40c6-a43c-434a6e129133 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:19.092833 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-b910f112-f7be-40c6-a43c-434a6e129133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:19.173648 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 166/317] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:38:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 20:38:19.176116 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf94c7a1-8eb5-432b-a580-e0532bfde914 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:19.200098 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 152/318] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 20:38:19.219954 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910f112-f7be-40c6-a43c-434a6e129133 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:19.360638 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910f112-f7be-40c6-a43c-434a6e129133 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:19.362187 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf94c7a1-8eb5-432b-a580-e0532bfde914 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:19.405548 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0161db-a16e-4a54-8867-13bc8c832664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:19.407178 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0161db-a16e-4a54-8867-13bc8c832664 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:19.407631 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0161db-a16e-4a54-8867-13bc8c832664 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:19.408108 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0161db-a16e-4a54-8867-13bc8c832664 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:19.412066 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0161db-a16e-4a54-8867-13bc8c832664 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:19.415771 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0161db-a16e-4a54-8867-13bc8c832664 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:19.420610 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 153/319] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:38:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:19.426872 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0161db-a16e-4a54-8867-13bc8c832664 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:19.427761 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89fb88-7c69-4509-8d91-2e657b9e863a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:19.428801 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89fb88-7c69-4509-8d91-2e657b9e863a None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:19.429074 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89fb88-7c69-4509-8d91-2e657b9e863a None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:19.429341 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89fb88-7c69-4509-8d91-2e657b9e863a None admin] PATH_INFO: `/v3/projects/38cebd4b9d0f44b4af767a7143050e7d` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:19.430551 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d89fb88-7c69-4509-8d91-2e657b9e863a None admin] RBAC: Authorizing `identity:get_project(project_id=38cebd4b9d0f44b4af767a7143050e7d)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:19.432021 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d89fb88-7c69-4509-8d91-2e657b9e863a None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:19.438859 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 167/320] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:38:19 2022] GET /identity/v3/projects/38cebd4b9d0f44b4af767a7143050e7d => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:19.439819 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89fb88-7c69-4509-8d91-2e657b9e863a None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:19.584767 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89fb88-7c69-4509-8d91-2e657b9e863a None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:19.599520 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0161db-a16e-4a54-8867-13bc8c832664 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:19.646185 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140e8dd-c525-4a2d-af7a-9b2705da2bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:19.647335 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140e8dd-c525-4a2d-af7a-9b2705da2bad None admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:19.647886 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140e8dd-c525-4a2d-af7a-9b2705da2bad None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:19.648585 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140e8dd-c525-4a2d-af7a-9b2705da2bad None admin] PATH_INFO: `/v3/groups` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:19.649934 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140e8dd-c525-4a2d-af7a-9b2705da2bad None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:19.651130 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ef9db-c0dc-4e95-af14-6d2405c6c745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:19.652019 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140e8dd-c525-4a2d-af7a-9b2705da2bad None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:19.652871 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ef9db-c0dc-4e95-af14-6d2405c6c745 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:19.653809 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ef9db-c0dc-4e95-af14-6d2405c6c745 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:19.654572 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ef9db-c0dc-4e95-af14-6d2405c6c745 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:19.656509 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ef9db-c0dc-4e95-af14-6d2405c6c745 None admin] RBAC: Adding query filter params (role.id=a5a6a249ab1f472e93ce008d03b41039, scope.project.id=38cebd4b9d0f44b4af767a7143050e7d, user.id=438f1b8ecaa24aeebd224aff8c42fb20) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:19.657497 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ef9db-c0dc-4e95-af14-6d2405c6c745 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:19.664655 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ef9db-c0dc-4e95-af14-6d2405c6c745 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:19.673384 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 154/321] 10.222.0.49 () {60 vars in 1134 bytes} [Fri Oct 28 20:38:19 2022] POST /identity/v3/groups => generated 226 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:38:19.678634 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 168/322] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:38:19 2022] GET /identity/v3/role_assignments?user.id=438f1b8ecaa24aeebd224aff8c42fb20&scope.project.id=38cebd4b9d0f44b4af767a7143050e7d&role.id=a5a6a249ab1f472e93ce008d03b41039 => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:19.841927 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece174b8-7653-493b-8468-8bc13a68a08e None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:19.842339 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece174b8-7653-493b-8468-8bc13a68a08e None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:19.842510 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece174b8-7653-493b-8468-8bc13a68a08e None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:19.844407 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 155/323] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:19.852173 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58a283-4acf-4aeb-8a98-64594de38aab None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:19.852678 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58a283-4acf-4aeb-8a98-64594de38aab None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:19.853208 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58a283-4acf-4aeb-8a98-64594de38aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:19.886263 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-8d58a283-4acf-4aeb-8a98-64594de38aab None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:19.887943 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-8d58a283-4acf-4aeb-8a98-64594de38aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:19.978069 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 169/324] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:38:20.004118 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece174b8-7653-493b-8468-8bc13a68a08e None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:20.148848 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece174b8-7653-493b-8468-8bc13a68a08e None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:20.190224 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad7c34-93ef-4576-bbe1-22cfdce930a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:20.191030 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad7c34-93ef-4576-bbe1-22cfdce930a0 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:20.191301 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad7c34-93ef-4576-bbe1-22cfdce930a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:20.191574 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad7c34-93ef-4576-bbe1-22cfdce930a0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:20.204391 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad7c34-93ef-4576-bbe1-22cfdce930a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:20.212153 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-b5ad7c34-93ef-4576-bbe1-22cfdce930a0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 20:38:20.213784 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 156/325] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:38:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:38:20.219548 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58a283-4acf-4aeb-8a98-64594de38aab None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:20.327079 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17857ecd-1c7f-46b4-b528-dbbbf6efbab0 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:20.328103 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17857ecd-1c7f-46b4-b528-dbbbf6efbab0 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:20.328927 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17857ecd-1c7f-46b4-b528-dbbbf6efbab0 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:20.334522 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 157/326] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:20.339478 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58a283-4acf-4aeb-8a98-64594de38aab None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:20.341393 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60008f36-3474-4e75-a59f-a9fcad358fef None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:20.341906 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60008f36-3474-4e75-a59f-a9fcad358fef None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:20.342407 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60008f36-3474-4e75-a59f-a9fcad358fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:20.383092 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-60008f36-3474-4e75-a59f-a9fcad358fef None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:20.384475 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2b47c-4094-4bf6-945c-a9dcade0e221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:20.384955 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-60008f36-3474-4e75-a59f-a9fcad358fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:20.385619 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2b47c-4094-4bf6-945c-a9dcade0e221 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:20.386119 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2b47c-4094-4bf6-945c-a9dcade0e221 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:20.386567 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2b47c-4094-4bf6-945c-a9dcade0e221 None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:20.388074 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2b47c-4094-4bf6-945c-a9dcade0e221 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:20.388612 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2b47c-4094-4bf6-945c-a9dcade0e221 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:20.391184 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2b47c-4094-4bf6-945c-a9dcade0e221 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:20.407966 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 170/327] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 20:38:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:20.415201 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2b47c-4094-4bf6-945c-a9dcade0e221 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:20.483928 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 158/328] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 20:38:20.513233 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60008f36-3474-4e75-a59f-a9fcad358fef None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:20.551332 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2b47c-4094-4bf6-945c-a9dcade0e221 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:20.594583 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2ee38-e64a-498c-b199-48e693596d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:20.595386 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2ee38-e64a-498c-b199-48e693596d8a None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:20.595675 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2ee38-e64a-498c-b199-48e693596d8a None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:20.595981 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2ee38-e64a-498c-b199-48e693596d8a None admin] PATH_INFO: `/v3/users/104f7c0be3e1426db34293f0c1418cac` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:20.597242 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2ee38-e64a-498c-b199-48e693596d8a None admin] RBAC: Authorizing `identity:get_user(user_id=104f7c0be3e1426db34293f0c1418cac)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:20.598946 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2ee38-e64a-498c-b199-48e693596d8a None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:20.601234 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 171/329] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:38:20 2022] GET /identity/v3/users/104f7c0be3e1426db34293f0c1418cac => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:20.607088 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2ee38-e64a-498c-b199-48e693596d8a None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:20.649747 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60008f36-3474-4e75-a59f-a9fcad358fef None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:20.696871 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57564631-837e-4949-ae51-815e6a69e5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:20.698229 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57564631-837e-4949-ae51-815e6a69e5af None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:20.698683 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57564631-837e-4949-ae51-815e6a69e5af None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:20.699132 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57564631-837e-4949-ae51-815e6a69e5af None admin] PATH_INFO: `/v3/roles/member` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:20.714735 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57564631-837e-4949-ae51-815e6a69e5af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:20.724225 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-57564631-837e-4949-ae51-815e6a69e5af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 20:38:20.731444 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 159/330] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:38:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:38:20.733443 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57564631-837e-4949-ae51-815e6a69e5af None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:20.739367 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2ee38-e64a-498c-b199-48e693596d8a None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:20.797524 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cb12b-8521-42b9-b3b2-6a22e281e47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:20.798821 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cb12b-8521-42b9-b3b2-6a22e281e47f None admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:20.799057 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cb12b-8521-42b9-b3b2-6a22e281e47f None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:20.799330 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cb12b-8521-42b9-b3b2-6a22e281e47f None admin] PATH_INFO: `/v3/system/users/104f7c0be3e1426db34293f0c1418cac/roles/a5a6a249ab1f472e93ce008d03b41039` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:20.801127 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4cb12b-8521-42b9-b3b2-6a22e281e47f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=104f7c0be3e1426db34293f0c1418cac, role_id=a5a6a249ab1f472e93ce008d03b41039)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:20.803494 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4cb12b-8521-42b9-b3b2-6a22e281e47f None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:20.827776 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 172/331] 10.222.0.49 () {58 vars in 1334 bytes} [Fri Oct 28 20:38:20 2022] PUT /identity/v3/system/users/104f7c0be3e1426db34293f0c1418cac/roles/a5a6a249ab1f472e93ce008d03b41039 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:38:20.878831 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57564631-837e-4949-ae51-815e6a69e5af None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:20.923929 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5107b-c759-4ee8-a2d6-bf62f02ef1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:20.924713 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5107b-c759-4ee8-a2d6-bf62f02ef1a0 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:20.924996 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5107b-c759-4ee8-a2d6-bf62f02ef1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:20.925268 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5107b-c759-4ee8-a2d6-bf62f02ef1a0 None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:20.926115 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5107b-c759-4ee8-a2d6-bf62f02ef1a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:20.926459 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5107b-c759-4ee8-a2d6-bf62f02ef1a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:20.928409 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5107b-c759-4ee8-a2d6-bf62f02ef1a0 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:20.938749 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 160/332] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 20:38:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:20.944873 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cb12b-8521-42b9-b3b2-6a22e281e47f None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:21.088848 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cb12b-8521-42b9-b3b2-6a22e281e47f None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:21.136078 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1fdcc-76a0-4fcc-b002-bc0e4b5d6d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:21.136934 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1fdcc-76a0-4fcc-b002-bc0e4b5d6d44 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:21.137214 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1fdcc-76a0-4fcc-b002-bc0e4b5d6d44 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:21.137480 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1fdcc-76a0-4fcc-b002-bc0e4b5d6d44 None admin] PATH_INFO: `/v3/users/ce991129851446da9d8eb63ead00781f` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:21.138776 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f1fdcc-76a0-4fcc-b002-bc0e4b5d6d44 None admin] RBAC: Authorizing `identity:get_user(user_id=ce991129851446da9d8eb63ead00781f)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:21.140342 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f1fdcc-76a0-4fcc-b002-bc0e4b5d6d44 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:21.142093 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 173/333] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:38:20 2022] GET /identity/v3/users/ce991129851446da9d8eb63ead00781f => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:21.149306 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5107b-c759-4ee8-a2d6-bf62f02ef1a0 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:21.268351 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5107b-c759-4ee8-a2d6-bf62f02ef1a0 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:21.306707 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c87fd8-4997-429c-88f9-0abe2977e2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:21.307377 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c87fd8-4997-429c-88f9-0abe2977e2b5 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:21.307651 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c87fd8-4997-429c-88f9-0abe2977e2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:21.307950 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c87fd8-4997-429c-88f9-0abe2977e2b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:21.308787 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c87fd8-4997-429c-88f9-0abe2977e2b5 None admin] RBAC: Adding query filter params (role.id=aaafbf9fe78e46cd9f06410394fdb531, user.id=ce991129851446da9d8eb63ead00781f, scope.system=all) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:21.309090 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c87fd8-4997-429c-88f9-0abe2977e2b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:21.310580 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c87fd8-4997-429c-88f9-0abe2977e2b5 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:21.325535 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 161/334] 10.222.0.49 () {56 vars in 1308 bytes} [Fri Oct 28 20:38:21 2022] GET /identity/v3/role_assignments?user.id=ce991129851446da9d8eb63ead00781f&scope.system=all&role.id=aaafbf9fe78e46cd9f06410394fdb531 => generated 510 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:22.897301 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedb14f-f5b1-467f-8423-224cf7c5ea45 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:22.898017 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedb14f-f5b1-467f-8423-224cf7c5ea45 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:22.898017 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedb14f-f5b1-467f-8423-224cf7c5ea45 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:22.900011 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 174/335] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:22.905987 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434a93d-a2ef-4d1f-a2b1-d4ae097851a9 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:22.906607 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434a93d-a2ef-4d1f-a2b1-d4ae097851a9 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:22.906607 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434a93d-a2ef-4d1f-a2b1-d4ae097851a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:22.936767 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-c434a93d-a2ef-4d1f-a2b1-d4ae097851a9 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:22.937973 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-c434a93d-a2ef-4d1f-a2b1-d4ae097851a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:23.070613 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 162/336] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 20:38:23.096136 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbedb14f-f5b1-467f-8423-224cf7c5ea45 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:23.261145 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbedb14f-f5b1-467f-8423-224cf7c5ea45 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:23.308593 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba888e-84e0-4b27-957e-434690c3c4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:23.309409 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba888e-84e0-4b27-957e-434690c3c4cc None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:23.309679 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba888e-84e0-4b27-957e-434690c3c4cc None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:23.309943 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba888e-84e0-4b27-957e-434690c3c4cc None admin] PATH_INFO: `/v3/roles/member` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:23.328666 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba888e-84e0-4b27-957e-434690c3c4cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:23.336597 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-23ba888e-84e0-4b27-957e-434690c3c4cc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 20:38:23.338207 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 175/337] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:38:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:23.344292 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434a93d-a2ef-4d1f-a2b1-d4ae097851a9 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:23.509853 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434a93d-a2ef-4d1f-a2b1-d4ae097851a9 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:23.551424 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb960c92-3411-4198-b9ec-271bb67bd37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:23.552550 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb960c92-3411-4198-b9ec-271bb67bd37a None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:23.552905 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb960c92-3411-4198-b9ec-271bb67bd37a None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:23.553179 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb960c92-3411-4198-b9ec-271bb67bd37a None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:23.553969 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb960c92-3411-4198-b9ec-271bb67bd37a None admin] RBAC: Adding query filter params (name=member) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:23.554277 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb960c92-3411-4198-b9ec-271bb67bd37a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:23.555728 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb960c92-3411-4198-b9ec-271bb67bd37a None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:23.571685 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 163/338] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 20:38:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:23.577237 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba888e-84e0-4b27-957e-434690c3c4cc None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:23.738179 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba888e-84e0-4b27-957e-434690c3c4cc None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:23.784095 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3c48d-cfc6-4b1c-8524-a508c8f420a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:23.784653 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3c48d-cfc6-4b1c-8524-a508c8f420a4 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:23.784919 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3c48d-cfc6-4b1c-8524-a508c8f420a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:23.785190 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3c48d-cfc6-4b1c-8524-a508c8f420a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:23.884431 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3c48d-cfc6-4b1c-8524-a508c8f420a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:23.885916 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3c48d-cfc6-4b1c-8524-a508c8f420a4 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:24.000798 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 176/339] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:38:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 20:38:24.007244 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb960c92-3411-4198-b9ec-271bb67bd37a None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:24.166109 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb960c92-3411-4198-b9ec-271bb67bd37a None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:24.207019 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583fa9e-b4fc-4bec-8287-17ad8a2e7fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:24.208816 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583fa9e-b4fc-4bec-8287-17ad8a2e7fcf None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:24.209235 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583fa9e-b4fc-4bec-8287-17ad8a2e7fcf None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:24.209513 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583fa9e-b4fc-4bec-8287-17ad8a2e7fcf None admin] PATH_INFO: `/v3/projects/7651e6b03b65497ab11181afb4e27ca6` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:24.216691 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3583fa9e-b4fc-4bec-8287-17ad8a2e7fcf None admin] RBAC: Authorizing `identity:get_project(project_id=7651e6b03b65497ab11181afb4e27ca6)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:24.218204 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3583fa9e-b4fc-4bec-8287-17ad8a2e7fcf None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:24.220413 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 164/340] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:38:24 2022] GET /identity/v3/projects/7651e6b03b65497ab11181afb4e27ca6 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:24.234173 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3c48d-cfc6-4b1c-8524-a508c8f420a4 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:24.352774 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8f479-3af2-4901-8b54-094de49bcff0 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:24.353437 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8f479-3af2-4901-8b54-094de49bcff0 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:24.353908 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8f479-3af2-4901-8b54-094de49bcff0 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:24.356133 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 165/341] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:24.363647 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4e375-329e-4d83-84ed-6f3c017dd082 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:24.365056 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4e375-329e-4d83-84ed-6f3c017dd082 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:24.365574 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4e375-329e-4d83-84ed-6f3c017dd082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:24.398107 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-24a4e375-329e-4d83-84ed-6f3c017dd082 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:24.399666 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-24a4e375-329e-4d83-84ed-6f3c017dd082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:24.543045 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3c48d-cfc6-4b1c-8524-a508c8f420a4 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:24.558133 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 166/342] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 20:38:24.637695 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953eb03-57f9-42a0-aa27-2ea297cbe586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:24.639167 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953eb03-57f9-42a0-aa27-2ea297cbe586 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:24.639654 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953eb03-57f9-42a0-aa27-2ea297cbe586 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:24.640145 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953eb03-57f9-42a0-aa27-2ea297cbe586 None admin] PATH_INFO: `/v3/groups/8efc1769522143babf54186b64258349` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:24.646454 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4e375-329e-4d83-84ed-6f3c017dd082 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:24.655954 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953eb03-57f9-42a0-aa27-2ea297cbe586 None admin] RBAC: Authorizing `identity:get_group(group_id=8efc1769522143babf54186b64258349)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:24.658521 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953eb03-57f9-42a0-aa27-2ea297cbe586 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:24.662253 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 177/343] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Oct 28 20:38:24 2022] GET /identity/v3/groups/8efc1769522143babf54186b64258349 => generated 226 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:24.669799 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953eb03-57f9-42a0-aa27-2ea297cbe586 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:24.892211 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4e375-329e-4d83-84ed-6f3c017dd082 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:24.955922 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e60d5-4175-4a90-8406-cc95a3ac02d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:24.956803 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e60d5-4175-4a90-8406-cc95a3ac02d1 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:24.957071 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e60d5-4175-4a90-8406-cc95a3ac02d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:24.957344 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e60d5-4175-4a90-8406-cc95a3ac02d1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:24.972145 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953eb03-57f9-42a0-aa27-2ea297cbe586 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:24.984734 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e60d5-4175-4a90-8406-cc95a3ac02d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:24.992424 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-179e60d5-4175-4a90-8406-cc95a3ac02d1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 20:38:24.994001 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 167/344] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:38:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:38:24.999671 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e60d5-4175-4a90-8406-cc95a3ac02d1 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:25.051289 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781f7c1-5751-4bf1-9304-9421069fed32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:25.052494 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781f7c1-5751-4bf1-9304-9421069fed32 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:25.052985 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781f7c1-5751-4bf1-9304-9421069fed32 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:25.053486 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781f7c1-5751-4bf1-9304-9421069fed32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:25.055205 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781f7c1-5751-4bf1-9304-9421069fed32 None admin] RBAC: Adding query filter params (group.id=8efc1769522143babf54186b64258349, role.id=aaafbf9fe78e46cd9f06410394fdb531, scope.project.id=7651e6b03b65497ab11181afb4e27ca6) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:25.055774 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781f7c1-5751-4bf1-9304-9421069fed32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:25.058636 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781f7c1-5751-4bf1-9304-9421069fed32 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:25.079941 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 178/345] 10.222.0.49 () {56 vars in 1376 bytes} [Fri Oct 28 20:38:24 2022] GET /identity/v3/role_assignments?group.id=8efc1769522143babf54186b64258349&scope.project.id=7651e6b03b65497ab11181afb4e27ca6&role.id=aaafbf9fe78e46cd9f06410394fdb531 => generated 260 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:25.128199 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e60d5-4175-4a90-8406-cc95a3ac02d1 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:25.171136 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c974909-3fab-4b00-9a82-52ae292fc24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:25.171718 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c974909-3fab-4b00-9a82-52ae292fc24f None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:25.172001 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c974909-3fab-4b00-9a82-52ae292fc24f None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:25.172274 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c974909-3fab-4b00-9a82-52ae292fc24f None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:25.173061 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c974909-3fab-4b00-9a82-52ae292fc24f None admin] RBAC: Adding query filter params (name=reader) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:25.173339 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c974909-3fab-4b00-9a82-52ae292fc24f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:25.174799 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c974909-3fab-4b00-9a82-52ae292fc24f None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:25.186145 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 168/346] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 20:38:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:25.194522 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781f7c1-5751-4bf1-9304-9421069fed32 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:25.305743 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55c372-7680-4666-ab75-a9a58d69913d None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:25.306283 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55c372-7680-4666-ab75-a9a58d69913d None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:25.306730 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55c372-7680-4666-ab75-a9a58d69913d None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:25.308879 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 169/347] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:38:25.321979 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684c5a5-b444-4988-b4df-4857ba1175c4 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:25.322602 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684c5a5-b444-4988-b4df-4857ba1175c4 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:25.323093 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684c5a5-b444-4988-b4df-4857ba1175c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:25.368149 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-0684c5a5-b444-4988-b4df-4857ba1175c4 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:25.370122 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-0684c5a5-b444-4988-b4df-4857ba1175c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:25.450078 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781f7c1-5751-4bf1-9304-9421069fed32 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:25.525180 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a0bb8-6209-4e92-98be-0f81533bb5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:25.526743 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a0bb8-6209-4e92-98be-0f81533bb5e6 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:25.527192 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a0bb8-6209-4e92-98be-0f81533bb5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:25.527707 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a0bb8-6209-4e92-98be-0f81533bb5e6 None admin] PATH_INFO: `/v3/users/104f7c0be3e1426db34293f0c1418cac` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:25.530378 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a0bb8-6209-4e92-98be-0f81533bb5e6 None admin] RBAC: Authorizing `identity:get_user(user_id=104f7c0be3e1426db34293f0c1418cac)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:25.533709 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a0bb8-6209-4e92-98be-0f81533bb5e6 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:25.538728 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 179/348] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:38:25 2022] GET /identity/v3/users/104f7c0be3e1426db34293f0c1418cac => generated 293 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:25.544871 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a0bb8-6209-4e92-98be-0f81533bb5e6 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:25.615878 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 170/349] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:38:25.662302 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684c5a5-b444-4988-b4df-4857ba1175c4 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:25.748076 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a0bb8-6209-4e92-98be-0f81533bb5e6 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:25.824336 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6ee30-75e6-420e-b1bc-d01adffb74cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:25.825475 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6ee30-75e6-420e-b1bc-d01adffb74cb None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:25.825974 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6ee30-75e6-420e-b1bc-d01adffb74cb None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:25.826461 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6ee30-75e6-420e-b1bc-d01adffb74cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:25.828184 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb6ee30-75e6-420e-b1bc-d01adffb74cb None admin] RBAC: Adding query filter params (role.id=a5a6a249ab1f472e93ce008d03b41039, user.id=104f7c0be3e1426db34293f0c1418cac, scope.system=all) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:25.828751 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb6ee30-75e6-420e-b1bc-d01adffb74cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:25.831557 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb6ee30-75e6-420e-b1bc-d01adffb74cb None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:25.871046 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 180/350] 10.222.0.49 () {56 vars in 1308 bytes} [Fri Oct 28 20:38:25 2022] GET /identity/v3/role_assignments?user.id=104f7c0be3e1426db34293f0c1418cac&scope.system=all&role.id=a5a6a249ab1f472e93ce008d03b41039 => generated 510 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:25.998974 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684c5a5-b444-4988-b4df-4857ba1175c4 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:26.089175 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233b294-ea8c-48e7-ab39-c18936f6dd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:26.090026 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233b294-ea8c-48e7-ab39-c18936f6dd5f None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:26.090310 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233b294-ea8c-48e7-ab39-c18936f6dd5f None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:26.090614 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233b294-ea8c-48e7-ab39-c18936f6dd5f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:26.116385 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233b294-ea8c-48e7-ab39-c18936f6dd5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:26.127811 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-f233b294-ea8c-48e7-ab39-c18936f6dd5f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 20:38:26.134753 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 171/351] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 20:38:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 474 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:26.145742 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6ee30-75e6-420e-b1bc-d01adffb74cb None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:26.177724 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02fe25d-c456-45b9-814f-1668169de93b None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:26.178338 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02fe25d-c456-45b9-814f-1668169de93b None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:26.178867 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02fe25d-c456-45b9-814f-1668169de93b None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:26.186359 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 172/352] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:26.189284 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9305b2-3118-43ee-a838-57aaa4a62103 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:26.189775 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9305b2-3118-43ee-a838-57aaa4a62103 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:26.190303 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9305b2-3118-43ee-a838-57aaa4a62103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:26.229262 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-5a9305b2-3118-43ee-a838-57aaa4a62103 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:26.231572 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-5a9305b2-3118-43ee-a838-57aaa4a62103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:26.364396 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6ee30-75e6-420e-b1bc-d01adffb74cb None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:26.374915 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 173/353] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:38:26.414845 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9305b2-3118-43ee-a838-57aaa4a62103 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:26.438807 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979da08d-5386-4c58-8808-ead17e1b0b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:26.439908 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979da08d-5386-4c58-8808-ead17e1b0b86 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:26.440345 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979da08d-5386-4c58-8808-ead17e1b0b86 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:26.440768 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979da08d-5386-4c58-8808-ead17e1b0b86 None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:26.442055 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979da08d-5386-4c58-8808-ead17e1b0b86 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:26.442605 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979da08d-5386-4c58-8808-ead17e1b0b86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:26.445085 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979da08d-5386-4c58-8808-ead17e1b0b86 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:26.460263 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 181/354] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:38:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:26.466729 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979da08d-5386-4c58-8808-ead17e1b0b86 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:26.640986 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9305b2-3118-43ee-a838-57aaa4a62103 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:26.665137 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979da08d-5386-4c58-8808-ead17e1b0b86 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:26.715298 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0130f-7bd9-4d7d-a4dc-e25d84f2a8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:26.716692 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0130f-7bd9-4d7d-a4dc-e25d84f2a8aa None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:26.717179 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0130f-7bd9-4d7d-a4dc-e25d84f2a8aa None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:26.717649 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0130f-7bd9-4d7d-a4dc-e25d84f2a8aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:26.729120 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af86ba0-e9d8-4343-800f-863b9d030a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:26.730181 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af86ba0-e9d8-4343-800f-863b9d030a1c None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:26.730654 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af86ba0-e9d8-4343-800f-863b9d030a1c None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:26.731165 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af86ba0-e9d8-4343-800f-863b9d030a1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:26.737499 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f0130f-7bd9-4d7d-a4dc-e25d84f2a8aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:26.751615 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-68f0130f-7bd9-4d7d-a4dc-e25d84f2a8aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 20:38:26.754359 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 174/355] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:38:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:38:26.760591 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b1ec4-b329-4d8f-a206-278e408c21fd None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:26.760591 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b1ec4-b329-4d8f-a206-278e408c21fd None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:26.760591 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b1ec4-b329-4d8f-a206-278e408c21fd None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:26.761385 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 175/356] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:26.769023 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b1ec4-b329-4d8f-a206-278e408c21fd None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:26.816001 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af86ba0-e9d8-4343-800f-863b9d030a1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:26.818074 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af86ba0-e9d8-4343-800f-863b9d030a1c None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:26.937023 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 182/357] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:38:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 20:38:26.938728 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176001a-3e28-41c8-a3d2-2f7049604b00 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:26.939212 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176001a-3e28-41c8-a3d2-2f7049604b00 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:26.939682 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176001a-3e28-41c8-a3d2-2f7049604b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:26.963058 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-d176001a-3e28-41c8-a3d2-2f7049604b00 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:26.964625 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-d176001a-3e28-41c8-a3d2-2f7049604b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:26.972740 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b1ec4-b329-4d8f-a206-278e408c21fd None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:27.043053 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 183/358] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:38:27.043725 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fe447-584d-432d-9e71-997126ddddfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:27.044479 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176001a-3e28-41c8-a3d2-2f7049604b00 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:27.044925 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fe447-584d-432d-9e71-997126ddddfd None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:27.045426 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fe447-584d-432d-9e71-997126ddddfd None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:27.045921 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fe447-584d-432d-9e71-997126ddddfd None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:27.047364 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fe447-584d-432d-9e71-997126ddddfd None admin] RBAC: Adding query filter params (name=member) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:27.056067 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fe447-584d-432d-9e71-997126ddddfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:27.058882 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fe447-584d-432d-9e71-997126ddddfd None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:27.086587 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 176/359] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 20:38:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:27.106267 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fe447-584d-432d-9e71-997126ddddfd None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:27.162678 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176001a-3e28-41c8-a3d2-2f7049604b00 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:27.201271 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3209a99-36fe-42e7-8836-5dc235be8e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:27.202543 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3209a99-36fe-42e7-8836-5dc235be8e6e None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:27.203077 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3209a99-36fe-42e7-8836-5dc235be8e6e None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:27.203536 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3209a99-36fe-42e7-8836-5dc235be8e6e None admin] PATH_INFO: `/v3/projects/7651e6b03b65497ab11181afb4e27ca6` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:27.205326 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3209a99-36fe-42e7-8836-5dc235be8e6e None admin] RBAC: Authorizing `identity:get_project(project_id=7651e6b03b65497ab11181afb4e27ca6)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:27.206988 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3209a99-36fe-42e7-8836-5dc235be8e6e None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:27.209908 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 184/360] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:38:27 2022] GET /identity/v3/projects/7651e6b03b65497ab11181afb4e27ca6 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:27.210931 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3209a99-36fe-42e7-8836-5dc235be8e6e None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:27.306562 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fe447-584d-432d-9e71-997126ddddfd None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:27.356544 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9a576-700d-4eb6-9eaf-e825b42b494d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:27.357788 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9a576-700d-4eb6-9eaf-e825b42b494d None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:27.358702 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9a576-700d-4eb6-9eaf-e825b42b494d None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:27.359186 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9a576-700d-4eb6-9eaf-e825b42b494d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:27.372172 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3209a99-36fe-42e7-8836-5dc235be8e6e None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:27.446267 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4204140-9a75-4823-8459-79790c1e2ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:27.447591 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4204140-9a75-4823-8459-79790c1e2ec5 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:27.448361 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4204140-9a75-4823-8459-79790c1e2ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:27.448863 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4204140-9a75-4823-8459-79790c1e2ec5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:27.466769 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4204140-9a75-4823-8459-79790c1e2ec5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:27.471800 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c9a576-700d-4eb6-9eaf-e825b42b494d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:27.474157 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c9a576-700d-4eb6-9eaf-e825b42b494d None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:27.474952 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-c4204140-9a75-4823-8459-79790c1e2ec5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 20:38:27.476618 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 185/361] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 20:38:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:27.478002 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c4c93-a22e-449c-9573-1bc64b543ccf None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:27.478271 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c4c93-a22e-449c-9573-1bc64b543ccf None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:27.478547 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c4c93-a22e-449c-9573-1bc64b543ccf None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:27.480654 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 186/362] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:27.481203 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c4c93-a22e-449c-9573-1bc64b543ccf None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:27.643987 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c4c93-a22e-449c-9573-1bc64b543ccf None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:27.668200 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 177/363] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:38:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 20:38:27.670146 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9a576-700d-4eb6-9eaf-e825b42b494d None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:27.687492 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbe3e6-7038-4a1b-8338-2eca8c23e57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:27.688400 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbe3e6-7038-4a1b-8338-2eca8c23e57b None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:27.688675 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbe3e6-7038-4a1b-8338-2eca8c23e57b None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:27.689090 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbe3e6-7038-4a1b-8338-2eca8c23e57b None admin] PATH_INFO: `/v3/groups/8efc1769522143babf54186b64258349` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:27.691021 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cbe3e6-7038-4a1b-8338-2eca8c23e57b None admin] RBAC: Authorizing `identity:get_group(group_id=8efc1769522143babf54186b64258349)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:27.693400 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cbe3e6-7038-4a1b-8338-2eca8c23e57b None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:27.695313 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 187/364] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Oct 28 20:38:27 2022] GET /identity/v3/groups/8efc1769522143babf54186b64258349 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:27.696433 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b96a6d-b7c1-461f-831e-52c3331792b1 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:27.696711 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b96a6d-b7c1-461f-831e-52c3331792b1 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:27.696981 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b96a6d-b7c1-461f-831e-52c3331792b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:27.722035 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-82b96a6d-b7c1-461f-831e-52c3331792b1 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:27.724192 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-82b96a6d-b7c1-461f-831e-52c3331792b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:27.855043 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9a576-700d-4eb6-9eaf-e825b42b494d None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:27.860631 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 188/365] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:38:27.862265 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b96a6d-b7c1-461f-831e-52c3331792b1 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:27.919118 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42647f-7d8a-4ca9-880c-d87b02e66a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:27.921316 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42647f-7d8a-4ca9-880c-d87b02e66a42 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:27.921810 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42647f-7d8a-4ca9-880c-d87b02e66a42 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:27.922305 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42647f-7d8a-4ca9-880c-d87b02e66a42 None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:27.927169 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42647f-7d8a-4ca9-880c-d87b02e66a42 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:27.927169 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42647f-7d8a-4ca9-880c-d87b02e66a42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:27.931143 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42647f-7d8a-4ca9-880c-d87b02e66a42 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:27.945680 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 178/366] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:38:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:27.946979 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42647f-7d8a-4ca9-880c-d87b02e66a42 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:28.040504 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b96a6d-b7c1-461f-831e-52c3331792b1 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:28.090744 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0049802-17f0-47f0-b95c-5db58abcfe1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:28.092168 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0049802-17f0-47f0-b95c-5db58abcfe1c None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:28.092647 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0049802-17f0-47f0-b95c-5db58abcfe1c None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:28.093106 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0049802-17f0-47f0-b95c-5db58abcfe1c None admin] PATH_INFO: `/v3/projects/38cebd4b9d0f44b4af767a7143050e7d` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:28.094637 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0049802-17f0-47f0-b95c-5db58abcfe1c None admin] RBAC: Authorizing `identity:get_project(project_id=38cebd4b9d0f44b4af767a7143050e7d)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:28.096368 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0049802-17f0-47f0-b95c-5db58abcfe1c None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:28.103083 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 189/367] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:38:27 2022] GET /identity/v3/projects/38cebd4b9d0f44b4af767a7143050e7d => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:28.103083 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0049802-17f0-47f0-b95c-5db58abcfe1c None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:28.126523 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42647f-7d8a-4ca9-880c-d87b02e66a42 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:28.191176 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a2242-f56f-45d9-a3de-709dddb28c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:28.193134 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a2242-f56f-45d9-a3de-709dddb28c68 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:28.193863 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a2242-f56f-45d9-a3de-709dddb28c68 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:28.194365 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a2242-f56f-45d9-a3de-709dddb28c68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:28.196041 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a2242-f56f-45d9-a3de-709dddb28c68 None admin] RBAC: Adding query filter params (group.id=8efc1769522143babf54186b64258349, role.id=28b8756191f44cadbdae28d1af156b6c, scope.project.id=7651e6b03b65497ab11181afb4e27ca6) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:28.196753 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a2242-f56f-45d9-a3de-709dddb28c68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:28.199307 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a2242-f56f-45d9-a3de-709dddb28c68 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:28.210718 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 179/368] 10.222.0.49 () {56 vars in 1376 bytes} [Fri Oct 28 20:38:27 2022] GET /identity/v3/role_assignments?group.id=8efc1769522143babf54186b64258349&scope.project.id=7651e6b03b65497ab11181afb4e27ca6&role.id=28b8756191f44cadbdae28d1af156b6c => generated 260 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:28.211975 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a2242-f56f-45d9-a3de-709dddb28c68 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:28.252339 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0049802-17f0-47f0-b95c-5db58abcfe1c None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:28.298641 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf37db4-c7e0-444b-b297-c94e74f758ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:28.299830 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf37db4-c7e0-444b-b297-c94e74f758ed None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:28.300333 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf37db4-c7e0-444b-b297-c94e74f758ed None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:28.300864 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf37db4-c7e0-444b-b297-c94e74f758ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:28.314337 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf37db4-c7e0-444b-b297-c94e74f758ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:28.323094 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-9bf37db4-c7e0-444b-b297-c94e74f758ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 20:38:28.325538 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 190/369] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 20:38:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:28.326747 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf37db4-c7e0-444b-b297-c94e74f758ed None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:28.429230 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a2242-f56f-45d9-a3de-709dddb28c68 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:28.462928 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf37db4-c7e0-444b-b297-c94e74f758ed None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:28.500805 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e26f5-7809-4f55-8497-091fbf4bf5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:28.501981 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e26f5-7809-4f55-8497-091fbf4bf5f1 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:28.502324 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e26f5-7809-4f55-8497-091fbf4bf5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:28.502733 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e26f5-7809-4f55-8497-091fbf4bf5f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:28.519552 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b3ff8-de9a-40f6-be2f-bf427cda9ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:28.519552 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b3ff8-de9a-40f6-be2f-bf427cda9ba6 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:28.519552 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b3ff8-de9a-40f6-be2f-bf427cda9ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:28.519552 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b3ff8-de9a-40f6-be2f-bf427cda9ba6 None admin] PATH_INFO: `/v3/groups/8efc1769522143babf54186b64258349` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:28.521291 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b3ff8-de9a-40f6-be2f-bf427cda9ba6 None admin] RBAC: Authorizing `identity:get_group(group_id=8efc1769522143babf54186b64258349)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:28.523047 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b3ff8-de9a-40f6-be2f-bf427cda9ba6 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:28.530120 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 191/370] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Oct 28 20:38:28 2022] GET /identity/v3/groups/8efc1769522143babf54186b64258349 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:28.531336 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b3ff8-de9a-40f6-be2f-bf427cda9ba6 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:28.655241 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e26f5-7809-4f55-8497-091fbf4bf5f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:28.656777 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e26f5-7809-4f55-8497-091fbf4bf5f1 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:28.684746 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b3ff8-de9a-40f6-be2f-bf427cda9ba6 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:28.731570 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895647c7-0450-4f49-ac25-b710367b8970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:28.732626 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895647c7-0450-4f49-ac25-b710367b8970 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:28.733104 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895647c7-0450-4f49-ac25-b710367b8970 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:28.733607 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895647c7-0450-4f49-ac25-b710367b8970 None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:28.734559 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895647c7-0450-4f49-ac25-b710367b8970 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:28.735061 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895647c7-0450-4f49-ac25-b710367b8970 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:28.736780 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895647c7-0450-4f49-ac25-b710367b8970 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:28.747477 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 192/371] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:38:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:28.756057 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388bbca-3f92-4263-9624-7a072387cb3e None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:28.756686 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388bbca-3f92-4263-9624-7a072387cb3e None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:28.758053 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388bbca-3f92-4263-9624-7a072387cb3e None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:28.760913 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 193/372] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:28 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:28.762760 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388bbca-3f92-4263-9624-7a072387cb3e None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:28.867843 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 180/373] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:38:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 20:38:28.871133 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e26f5-7809-4f55-8497-091fbf4bf5f1 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:28.953454 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388bbca-3f92-4263-9624-7a072387cb3e None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:29.016596 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814efbf-0354-4a4e-b8ee-45f2e7b8dc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:29.017621 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814efbf-0354-4a4e-b8ee-45f2e7b8dc4b None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:29.017892 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814efbf-0354-4a4e-b8ee-45f2e7b8dc4b None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:29.018161 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814efbf-0354-4a4e-b8ee-45f2e7b8dc4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:29.019095 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7814efbf-0354-4a4e-b8ee-45f2e7b8dc4b None admin] RBAC: Adding query filter params (group.id=8efc1769522143babf54186b64258349, role.id=aaafbf9fe78e46cd9f06410394fdb531, scope.project.id=38cebd4b9d0f44b4af767a7143050e7d) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:29.019406 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7814efbf-0354-4a4e-b8ee-45f2e7b8dc4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:29.022232 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7814efbf-0354-4a4e-b8ee-45f2e7b8dc4b None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:29.032933 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 194/374] 10.222.0.49 () {56 vars in 1376 bytes} [Fri Oct 28 20:38:28 2022] GET /identity/v3/role_assignments?group.id=8efc1769522143babf54186b64258349&scope.project.id=38cebd4b9d0f44b4af767a7143050e7d&role.id=aaafbf9fe78e46cd9f06410394fdb531 => generated 260 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:29.039783 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c5548-1543-4729-8a2a-0ec44d30a531 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:29.039783 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c5548-1543-4729-8a2a-0ec44d30a531 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:29.039783 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c5548-1543-4729-8a2a-0ec44d30a531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:29.074898 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-3b4c5548-1543-4729-8a2a-0ec44d30a531 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:29.076173 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-3b4c5548-1543-4729-8a2a-0ec44d30a531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:29.097093 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e26f5-7809-4f55-8497-091fbf4bf5f1 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:29.179987 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 195/375] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:38:29.180956 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c5548-1543-4729-8a2a-0ec44d30a531 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:29.202969 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4a305-a42c-4dfd-ad22-6f96dbdf7d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:29.204389 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4a305-a42c-4dfd-ad22-6f96dbdf7d88 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:29.204885 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4a305-a42c-4dfd-ad22-6f96dbdf7d88 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:29.205362 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4a305-a42c-4dfd-ad22-6f96dbdf7d88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:29.355246 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c5548-1543-4729-8a2a-0ec44d30a531 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:29.396795 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4a305-a42c-4dfd-ad22-6f96dbdf7d88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:29.401455 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4a305-a42c-4dfd-ad22-6f96dbdf7d88 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:29.416435 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82472fb9-815b-4433-9b05-49fa2c548ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:29.417811 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82472fb9-815b-4433-9b05-49fa2c548ee2 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:29.418278 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82472fb9-815b-4433-9b05-49fa2c548ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:29.418762 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82472fb9-815b-4433-9b05-49fa2c548ee2 None admin] PATH_INFO: `/v3/projects/38cebd4b9d0f44b4af767a7143050e7d` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:29.420966 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82472fb9-815b-4433-9b05-49fa2c548ee2 None admin] RBAC: Authorizing `identity:get_project(project_id=38cebd4b9d0f44b4af767a7143050e7d)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:29.423497 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82472fb9-815b-4433-9b05-49fa2c548ee2 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:29.427660 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 196/376] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:38:29 2022] GET /identity/v3/projects/38cebd4b9d0f44b4af767a7143050e7d => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:29.429187 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82472fb9-815b-4433-9b05-49fa2c548ee2 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:29.585903 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 181/377] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:38:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 717 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 20:38:29.587625 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4a305-a42c-4dfd-ad22-6f96dbdf7d88 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:29.597401 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82472fb9-815b-4433-9b05-49fa2c548ee2 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:29.674062 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463626a6-9348-4150-bfd4-af9d3d441678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:29.675677 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463626a6-9348-4150-bfd4-af9d3d441678 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:29.676236 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463626a6-9348-4150-bfd4-af9d3d441678 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:29.676708 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463626a6-9348-4150-bfd4-af9d3d441678 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:29.702885 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463626a6-9348-4150-bfd4-af9d3d441678 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:29.722002 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-463626a6-9348-4150-bfd4-af9d3d441678 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 20:38:29.726314 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 197/378] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:38:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:29.728471 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463626a6-9348-4150-bfd4-af9d3d441678 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:29.793649 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4a305-a42c-4dfd-ad22-6f96dbdf7d88 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:29.860727 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ffd6b-7c72-444b-9097-f529e49fbe56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:29.862094 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ffd6b-7c72-444b-9097-f529e49fbe56 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:29.862570 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ffd6b-7c72-444b-9097-f529e49fbe56 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:29.863048 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ffd6b-7c72-444b-9097-f529e49fbe56 None admin] PATH_INFO: `/v3/groups/8efc1769522143babf54186b64258349` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:29.867236 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ffd6b-7c72-444b-9097-f529e49fbe56 None admin] RBAC: Authorizing `identity:get_group(group_id=8efc1769522143babf54186b64258349)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:29.869922 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ffd6b-7c72-444b-9097-f529e49fbe56 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:29.873684 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 182/379] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Oct 28 20:38:29 2022] GET /identity/v3/groups/8efc1769522143babf54186b64258349 => generated 226 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:29.874896 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ffd6b-7c72-444b-9097-f529e49fbe56 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:29.973887 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463626a6-9348-4150-bfd4-af9d3d441678 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:30.055641 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281332a-70c2-41fc-a930-7edc038e1973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:30.057029 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281332a-70c2-41fc-a930-7edc038e1973 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:30.057960 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281332a-70c2-41fc-a930-7edc038e1973 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:30.057960 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281332a-70c2-41fc-a930-7edc038e1973 None admin] PATH_INFO: `/v3/projects/3ac39942cf3a45f18781d7210d0aa25e` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:30.059706 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e281332a-70c2-41fc-a930-7edc038e1973 None admin] RBAC: Authorizing `identity:get_project(project_id=3ac39942cf3a45f18781d7210d0aa25e)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:30.062185 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e281332a-70c2-41fc-a930-7edc038e1973 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:30.066062 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 198/380] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:38:29 2022] GET /identity/v3/projects/3ac39942cf3a45f18781d7210d0aa25e => generated 344 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:30.067769 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281332a-70c2-41fc-a930-7edc038e1973 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:30.101250 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ffd6b-7c72-444b-9097-f529e49fbe56 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:30.171807 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bf595-9eeb-44e3-9182-534e8928fd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:30.173234 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bf595-9eeb-44e3-9182-534e8928fd8a None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:30.173912 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bf595-9eeb-44e3-9182-534e8928fd8a None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:30.174582 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bf595-9eeb-44e3-9182-534e8928fd8a None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:30.176027 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809bf595-9eeb-44e3-9182-534e8928fd8a None admin] RBAC: Adding query filter params (name=member) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:30.177324 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809bf595-9eeb-44e3-9182-534e8928fd8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:30.180073 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809bf595-9eeb-44e3-9182-534e8928fd8a None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:30.196339 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 183/381] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 20:38:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:30.198250 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bf595-9eeb-44e3-9182-534e8928fd8a None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:30.261112 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281332a-70c2-41fc-a930-7edc038e1973 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:30.325810 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f2cea-538f-4fdc-b7bf-e185f8ecd3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:30.327170 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f2cea-538f-4fdc-b7bf-e185f8ecd3fe None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:30.327350 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f2cea-538f-4fdc-b7bf-e185f8ecd3fe None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:30.327663 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f2cea-538f-4fdc-b7bf-e185f8ecd3fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:30.329290 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f2cea-538f-4fdc-b7bf-e185f8ecd3fe None admin] RBAC: Adding query filter params (group.id=8efc1769522143babf54186b64258349, role.id=28b8756191f44cadbdae28d1af156b6c, scope.project.id=38cebd4b9d0f44b4af767a7143050e7d) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:30.329808 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f2cea-538f-4fdc-b7bf-e185f8ecd3fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:30.333291 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f2cea-538f-4fdc-b7bf-e185f8ecd3fe None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:30.344873 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 199/382] 10.222.0.49 () {56 vars in 1376 bytes} [Fri Oct 28 20:38:30 2022] GET /identity/v3/role_assignments?group.id=8efc1769522143babf54186b64258349&scope.project.id=38cebd4b9d0f44b4af767a7143050e7d&role.id=28b8756191f44cadbdae28d1af156b6c => generated 260 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:30.346488 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f2cea-538f-4fdc-b7bf-e185f8ecd3fe None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:30.394193 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bf595-9eeb-44e3-9182-534e8928fd8a None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:30.462693 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1ec45-ed56-456f-84a5-06bc58ddab6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:30.464884 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1ec45-ed56-456f-84a5-06bc58ddab6f None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:30.465579 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1ec45-ed56-456f-84a5-06bc58ddab6f None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:30.466255 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1ec45-ed56-456f-84a5-06bc58ddab6f None admin] PATH_INFO: `/v3/groups/460103a749b041b5ad8f6812e62f1ae6` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:30.479560 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1ec45-ed56-456f-84a5-06bc58ddab6f None admin] RBAC: Authorizing `identity:get_group(group_id=460103a749b041b5ad8f6812e62f1ae6)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:30.482753 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1ec45-ed56-456f-84a5-06bc58ddab6f None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:30.486433 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 184/383] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Oct 28 20:38:30 2022] GET /identity/v3/groups/460103a749b041b5ad8f6812e62f1ae6 => generated 229 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:30.496294 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1ec45-ed56-456f-84a5-06bc58ddab6f None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:30.534361 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f2cea-538f-4fdc-b7bf-e185f8ecd3fe None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:30.601578 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b6ee4-4c50-48af-b5d6-aa0ab968e1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:30.602310 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b6ee4-4c50-48af-b5d6-aa0ab968e1dc None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:30.602822 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b6ee4-4c50-48af-b5d6-aa0ab968e1dc None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:30.603303 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b6ee4-4c50-48af-b5d6-aa0ab968e1dc None admin] PATH_INFO: `/v3/groups/8efc1769522143babf54186b64258349` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:30.610988 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b6ee4-4c50-48af-b5d6-aa0ab968e1dc None admin] RBAC: Authorizing `identity:get_group(group_id=8efc1769522143babf54186b64258349)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:30.615823 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b6ee4-4c50-48af-b5d6-aa0ab968e1dc None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:30.621150 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 200/384] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Oct 28 20:38:30 2022] GET /identity/v3/groups/8efc1769522143babf54186b64258349 => generated 226 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:30.627825 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b6ee4-4c50-48af-b5d6-aa0ab968e1dc None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:30.798867 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1ec45-ed56-456f-84a5-06bc58ddab6f None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:30.905935 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476dd1a-85b4-45b1-9440-9bfca5c0d6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:30.907116 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476dd1a-85b4-45b1-9440-9bfca5c0d6a3 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:30.907522 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476dd1a-85b4-45b1-9440-9bfca5c0d6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:30.908299 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476dd1a-85b4-45b1-9440-9bfca5c0d6a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:30.909981 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c476dd1a-85b4-45b1-9440-9bfca5c0d6a3 None admin] RBAC: Adding query filter params (group.id=460103a749b041b5ad8f6812e62f1ae6, role.id=8fe105eeb7bf4856a94b0633bd781414, scope.project.id=3ac39942cf3a45f18781d7210d0aa25e) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:30.920084 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c476dd1a-85b4-45b1-9440-9bfca5c0d6a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:30.922531 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b6ee4-4c50-48af-b5d6-aa0ab968e1dc None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:30.922978 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c476dd1a-85b4-45b1-9440-9bfca5c0d6a3 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:30.943824 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 185/385] 10.222.0.49 () {56 vars in 1376 bytes} [Fri Oct 28 20:38:30 2022] GET /identity/v3/role_assignments?group.id=460103a749b041b5ad8f6812e62f1ae6&scope.project.id=3ac39942cf3a45f18781d7210d0aa25e&role.id=8fe105eeb7bf4856a94b0633bd781414 => generated 260 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:30.995514 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c91636-9f4f-48c3-ae16-510109f380c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:30.997845 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c91636-9f4f-48c3-ae16-510109f380c4 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:30.998786 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c91636-9f4f-48c3-ae16-510109f380c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:30.999562 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c91636-9f4f-48c3-ae16-510109f380c4 None admin] PATH_INFO: `/v3/projects/7651e6b03b65497ab11181afb4e27ca6` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:31.002371 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c91636-9f4f-48c3-ae16-510109f380c4 None admin] RBAC: Authorizing `identity:get_project(project_id=7651e6b03b65497ab11181afb4e27ca6)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:31.006281 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c91636-9f4f-48c3-ae16-510109f380c4 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:31.010750 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 201/386] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:38:30 2022] GET /identity/v3/projects/7651e6b03b65497ab11181afb4e27ca6 => generated 298 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:31.016947 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476dd1a-85b4-45b1-9440-9bfca5c0d6a3 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:31.262801 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476dd1a-85b4-45b1-9440-9bfca5c0d6a3 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:31.327301 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d7724-8fb7-4270-ad60-6262c3c8f632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:31.328869 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d7724-8fb7-4270-ad60-6262c3c8f632 None admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:31.329421 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d7724-8fb7-4270-ad60-6262c3c8f632 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:31.329914 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d7724-8fb7-4270-ad60-6262c3c8f632 None admin] PATH_INFO: `/v3/projects/7651e6b03b65497ab11181afb4e27ca6/groups/8efc1769522143babf54186b64258349/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:31.334067 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d7724-8fb7-4270-ad60-6262c3c8f632 None admin] RBAC: Authorizing `identity:create_grant(project_id=7651e6b03b65497ab11181afb4e27ca6, group_id=8efc1769522143babf54186b64258349, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:31.336936 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d7724-8fb7-4270-ad60-6262c3c8f632 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:31.363643 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 186/387] 10.222.0.49 () {58 vars in 1442 bytes} [Fri Oct 28 20:38:31 2022] PUT /identity/v3/projects/7651e6b03b65497ab11181afb4e27ca6/groups/8efc1769522143babf54186b64258349/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:38:32.285025 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8981c7c-1fe0-4a9a-bcbf-9d86dbecd743 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:32.287351 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8981c7c-1fe0-4a9a-bcbf-9d86dbecd743 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:32.288107 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8981c7c-1fe0-4a9a-bcbf-9d86dbecd743 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:32.296305 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 202/388] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:32 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:32.303286 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a170330-d14e-49d9-a5bf-3a26fd9af7b3 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:32.304704 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a170330-d14e-49d9-a5bf-3a26fd9af7b3 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:32.305442 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a170330-d14e-49d9-a5bf-3a26fd9af7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:32.341690 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-4a170330-d14e-49d9-a5bf-3a26fd9af7b3 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:32.344083 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-4a170330-d14e-49d9-a5bf-3a26fd9af7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:32.478790 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 187/389] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:38:32.516031 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8981c7c-1fe0-4a9a-bcbf-9d86dbecd743 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:32.767592 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8981c7c-1fe0-4a9a-bcbf-9d86dbecd743 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:32.806154 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8f55e-9247-41c2-826c-9bb5156d6d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:32.807027 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8f55e-9247-41c2-826c-9bb5156d6d48 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:32.807308 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8f55e-9247-41c2-826c-9bb5156d6d48 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:32.807576 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8f55e-9247-41c2-826c-9bb5156d6d48 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:32.819844 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8f55e-9247-41c2-826c-9bb5156d6d48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:32.823795 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c288c2-26fe-4e30-8892-006932376404 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:32.824179 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c288c2-26fe-4e30-8892-006932376404 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:32.824411 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c288c2-26fe-4e30-8892-006932376404 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:32.826439 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 188/390] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:38:32.831570 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-82d8f55e-9247-41c2-826c-9bb5156d6d48 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 20:38:32.833532 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbeed4c-3357-48b8-b49c-70b557c7b6fd None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:32.833723 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 203/391] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:38:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:32.834416 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbeed4c-3357-48b8-b49c-70b557c7b6fd None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:32.834956 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbeed4c-3357-48b8-b49c-70b557c7b6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:32.840386 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8f55e-9247-41c2-826c-9bb5156d6d48 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:32.869707 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-bcbeed4c-3357-48b8-b49c-70b557c7b6fd None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:32.870963 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-bcbeed4c-3357-48b8-b49c-70b557c7b6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:33.018925 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 189/392] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:38:33.043819 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbeed4c-3357-48b8-b49c-70b557c7b6fd None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:33.059098 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8f55e-9247-41c2-826c-9bb5156d6d48 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:33.097088 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38fb64-0027-42ef-83d7-f977c552eaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:33.099284 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38fb64-0027-42ef-83d7-f977c552eaa8 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:33.099591 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38fb64-0027-42ef-83d7-f977c552eaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:33.099923 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38fb64-0027-42ef-83d7-f977c552eaa8 None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:33.101210 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d38fb64-0027-42ef-83d7-f977c552eaa8 None admin] RBAC: Adding query filter params (name=member) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:33.101520 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d38fb64-0027-42ef-83d7-f977c552eaa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:33.102925 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d38fb64-0027-42ef-83d7-f977c552eaa8 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:33.113013 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 204/393] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 20:38:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:33.120882 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38fb64-0027-42ef-83d7-f977c552eaa8 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:33.284472 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbeed4c-3357-48b8-b49c-70b557c7b6fd None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:33.323940 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8bcf6d-658f-450b-8990-ac8e16070721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:33.324759 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bcf6d-658f-450b-8990-ac8e16070721 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:33.325035 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bcf6d-658f-450b-8990-ac8e16070721 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:33.325301 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bcf6d-658f-450b-8990-ac8e16070721 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:33.338696 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8bcf6d-658f-450b-8990-ac8e16070721 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:33.346340 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-1c8bcf6d-658f-450b-8990-ac8e16070721 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 20:38:33.348076 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 190/394] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 20:38:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:33.354175 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38fb64-0027-42ef-83d7-f977c552eaa8 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:33.354960 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8bcf6d-658f-450b-8990-ac8e16070721 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:33.481349 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8bcf6d-658f-450b-8990-ac8e16070721 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:33.482347 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b4bf3-6b50-475f-8f49-dda4a45dea03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:33.483903 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b4bf3-6b50-475f-8f49-dda4a45dea03 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:33.484390 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b4bf3-6b50-475f-8f49-dda4a45dea03 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:33.484865 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b4bf3-6b50-475f-8f49-dda4a45dea03 None admin] PATH_INFO: `/v3/groups/8efc1769522143babf54186b64258349` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:33.487142 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b4bf3-6b50-475f-8f49-dda4a45dea03 None admin] RBAC: Authorizing `identity:get_group(group_id=8efc1769522143babf54186b64258349)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:33.490060 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b4bf3-6b50-475f-8f49-dda4a45dea03 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:33.501736 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 205/395] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Oct 28 20:38:33 2022] GET /identity/v3/groups/8efc1769522143babf54186b64258349 => generated 226 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:33.524378 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b4bf3-6b50-475f-8f49-dda4a45dea03 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:33.536321 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c2c58-9b82-435a-81e2-8aaea7d99de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:33.536321 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c2c58-9b82-435a-81e2-8aaea7d99de9 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:33.536321 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c2c58-9b82-435a-81e2-8aaea7d99de9 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:33.536321 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c2c58-9b82-435a-81e2-8aaea7d99de9 None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:33.536931 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c2c58-9b82-435a-81e2-8aaea7d99de9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:33.536931 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c2c58-9b82-435a-81e2-8aaea7d99de9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:33.536931 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c2c58-9b82-435a-81e2-8aaea7d99de9 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:33.555778 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 191/396] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:38:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:33.557958 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c2c58-9b82-435a-81e2-8aaea7d99de9 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:33.677266 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c2c58-9b82-435a-81e2-8aaea7d99de9 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:33.716288 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438f46e-a303-44fb-8e12-835aab9d22b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:33.717465 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438f46e-a303-44fb-8e12-835aab9d22b0 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:33.717948 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438f46e-a303-44fb-8e12-835aab9d22b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:33.718394 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438f46e-a303-44fb-8e12-835aab9d22b0 None admin] PATH_INFO: `/v3/groups/8efc1769522143babf54186b64258349` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:33.719928 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438f46e-a303-44fb-8e12-835aab9d22b0 None admin] RBAC: Authorizing `identity:get_group(group_id=8efc1769522143babf54186b64258349)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:33.721591 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438f46e-a303-44fb-8e12-835aab9d22b0 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:33.725119 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 192/397] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Oct 28 20:38:33 2022] GET /identity/v3/groups/8efc1769522143babf54186b64258349 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:33.731056 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438f46e-a303-44fb-8e12-835aab9d22b0 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:33.907317 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b4bf3-6b50-475f-8f49-dda4a45dea03 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:33.954741 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438f46e-a303-44fb-8e12-835aab9d22b0 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:34.022054 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a58f15-ca01-484c-8d35-90c2a5148e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:34.024281 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a58f15-ca01-484c-8d35-90c2a5148e4f None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:34.024759 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a58f15-ca01-484c-8d35-90c2a5148e4f None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:34.025239 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a58f15-ca01-484c-8d35-90c2a5148e4f None admin] PATH_INFO: `/v3/projects/7651e6b03b65497ab11181afb4e27ca6` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:34.027353 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a58f15-ca01-484c-8d35-90c2a5148e4f None admin] RBAC: Authorizing `identity:get_project(project_id=7651e6b03b65497ab11181afb4e27ca6)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:34.030190 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a58f15-ca01-484c-8d35-90c2a5148e4f None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:34.033626 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 193/398] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:38:33 2022] GET /identity/v3/projects/7651e6b03b65497ab11181afb4e27ca6 => generated 298 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:34.039194 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0650a-48d9-44df-bbb8-f59dc0749519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:34.041621 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a58f15-ca01-484c-8d35-90c2a5148e4f None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:34.043337 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0650a-48d9-44df-bbb8-f59dc0749519 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:34.044595 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0650a-48d9-44df-bbb8-f59dc0749519 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:34.048542 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0650a-48d9-44df-bbb8-f59dc0749519 None admin] PATH_INFO: `/v3/projects/38cebd4b9d0f44b4af767a7143050e7d` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:34.064896 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0650a-48d9-44df-bbb8-f59dc0749519 None admin] RBAC: Authorizing `identity:get_project(project_id=38cebd4b9d0f44b4af767a7143050e7d)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:34.069195 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0650a-48d9-44df-bbb8-f59dc0749519 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:34.077262 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 206/399] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:38:33 2022] GET /identity/v3/projects/38cebd4b9d0f44b4af767a7143050e7d => generated 302 bytes in 554 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:34.079067 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0650a-48d9-44df-bbb8-f59dc0749519 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:34.311226 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0650a-48d9-44df-bbb8-f59dc0749519 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:34.329947 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a58f15-ca01-484c-8d35-90c2a5148e4f None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:34.397635 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7662a-c484-4fea-b4d1-8ca30071f185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:34.398686 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78169a4e-9129-42a0-b6a9-c5aa2c2c2416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:34.400336 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7662a-c484-4fea-b4d1-8ca30071f185 None admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:34.401620 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78169a4e-9129-42a0-b6a9-c5aa2c2c2416 None admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:34.402212 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7662a-c484-4fea-b4d1-8ca30071f185 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:34.402699 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78169a4e-9129-42a0-b6a9-c5aa2c2c2416 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:34.403198 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7662a-c484-4fea-b4d1-8ca30071f185 None admin] PATH_INFO: `/v3/projects/7651e6b03b65497ab11181afb4e27ca6/groups/8efc1769522143babf54186b64258349/roles/28b8756191f44cadbdae28d1af156b6c` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:34.403705 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78169a4e-9129-42a0-b6a9-c5aa2c2c2416 None admin] PATH_INFO: `/v3/projects/38cebd4b9d0f44b4af767a7143050e7d/groups/8efc1769522143babf54186b64258349/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:34.408070 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78169a4e-9129-42a0-b6a9-c5aa2c2c2416 None admin] RBAC: Authorizing `identity:create_grant(project_id=38cebd4b9d0f44b4af767a7143050e7d, group_id=8efc1769522143babf54186b64258349, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:34.409251 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d7662a-c484-4fea-b4d1-8ca30071f185 None admin] RBAC: Authorizing `identity:create_grant(project_id=7651e6b03b65497ab11181afb4e27ca6, group_id=8efc1769522143babf54186b64258349, role_id=28b8756191f44cadbdae28d1af156b6c)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:34.412909 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d7662a-c484-4fea-b4d1-8ca30071f185 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:34.416680 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78169a4e-9129-42a0-b6a9-c5aa2c2c2416 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:34.444108 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 207/400] 10.222.0.49 () {58 vars in 1442 bytes} [Fri Oct 28 20:38:34 2022] PUT /identity/v3/projects/38cebd4b9d0f44b4af767a7143050e7d/groups/8efc1769522143babf54186b64258349/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:38:34.444859 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 194/401] 10.222.0.49 () {58 vars in 1442 bytes} [Fri Oct 28 20:38:34 2022] PUT /identity/v3/projects/7651e6b03b65497ab11181afb4e27ca6/groups/8efc1769522143babf54186b64258349/roles/28b8756191f44cadbdae28d1af156b6c => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:38:34.785321 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200d45e-0376-499d-967f-bbf25f528fe5 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:34.786623 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200d45e-0376-499d-967f-bbf25f528fe5 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:34.787377 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200d45e-0376-499d-967f-bbf25f528fe5 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:34.791586 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 208/402] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:34.797080 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc25430-2b5e-40f8-9219-fc03fc16e01d None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:34.797353 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc25430-2b5e-40f8-9219-fc03fc16e01d None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:34.797826 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc25430-2b5e-40f8-9219-fc03fc16e01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:34.821442 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-3dc25430-2b5e-40f8-9219-fc03fc16e01d None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:34.823523 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-3dc25430-2b5e-40f8-9219-fc03fc16e01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:34.964629 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 195/403] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 20:38:35.001228 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200d45e-0376-499d-967f-bbf25f528fe5 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:35.030526 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f9506-2b4e-4c93-aba4-c76fbf3d162b None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:35.030809 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f9506-2b4e-4c93-aba4-c76fbf3d162b None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:35.031367 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f9506-2b4e-4c93-aba4-c76fbf3d162b None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:35.033567 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 196/404] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:38:35.040085 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176163d3-a994-47c4-8e7f-6c1dcbfcd97f None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:35.040674 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176163d3-a994-47c4-8e7f-6c1dcbfcd97f None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:35.041148 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176163d3-a994-47c4-8e7f-6c1dcbfcd97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:35.072756 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-176163d3-a994-47c4-8e7f-6c1dcbfcd97f None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:35.072756 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-176163d3-a994-47c4-8e7f-6c1dcbfcd97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:35.172547 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 197/405] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 20:38:35.176887 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f1f25-7243-48ca-945a-2440a895c510 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:35.176887 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f1f25-7243-48ca-945a-2440a895c510 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:35.176887 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f1f25-7243-48ca-945a-2440a895c510 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:35.180066 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 198/406] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:35.188777 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843f531-0409-4bf8-9569-389abf3a6af0 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:35.189280 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843f531-0409-4bf8-9569-389abf3a6af0 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:35.189721 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843f531-0409-4bf8-9569-389abf3a6af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:35.216750 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200d45e-0376-499d-967f-bbf25f528fe5 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:35.221118 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-4843f531-0409-4bf8-9569-389abf3a6af0 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:35.223087 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-4843f531-0409-4bf8-9569-389abf3a6af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:35.289713 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf715de-e86c-4e97-9536-cfe6ce0aad78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:35.290936 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf715de-e86c-4e97-9536-cfe6ce0aad78 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:35.291320 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf715de-e86c-4e97-9536-cfe6ce0aad78 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:35.291827 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf715de-e86c-4e97-9536-cfe6ce0aad78 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:35.311036 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf715de-e86c-4e97-9536-cfe6ce0aad78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:35.320646 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 199/407] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:38:35.322001 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843f531-0409-4bf8-9569-389abf3a6af0 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:35.338764 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-baf715de-e86c-4e97-9536-cfe6ce0aad78 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 20:38:35.341418 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 209/408] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 20:38:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:35.347595 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf715de-e86c-4e97-9536-cfe6ce0aad78 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:35.447823 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843f531-0409-4bf8-9569-389abf3a6af0 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:35.494672 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43666a1b-d38e-4bb6-a34e-1d27f51cfcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:35.495932 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43666a1b-d38e-4bb6-a34e-1d27f51cfcef None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:35.496412 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43666a1b-d38e-4bb6-a34e-1d27f51cfcef None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:35.496881 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43666a1b-d38e-4bb6-a34e-1d27f51cfcef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:35.511114 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43666a1b-d38e-4bb6-a34e-1d27f51cfcef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:35.522520 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-43666a1b-d38e-4bb6-a34e-1d27f51cfcef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 20:38:35.526075 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 200/409] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 20:38:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:35.526595 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43666a1b-d38e-4bb6-a34e-1d27f51cfcef None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:35.548117 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf715de-e86c-4e97-9536-cfe6ce0aad78 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:35.592509 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ebc04-8cab-47cc-8773-b952a01cc210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:35.593826 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ebc04-8cab-47cc-8773-b952a01cc210 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:35.595297 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ebc04-8cab-47cc-8773-b952a01cc210 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:35.595849 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ebc04-8cab-47cc-8773-b952a01cc210 None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:35.596841 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ebc04-8cab-47cc-8773-b952a01cc210 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:35.597360 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ebc04-8cab-47cc-8773-b952a01cc210 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:35.599519 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ebc04-8cab-47cc-8773-b952a01cc210 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:35.610567 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 210/410] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:38:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:35.612139 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ebc04-8cab-47cc-8773-b952a01cc210 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:35.718496 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43666a1b-d38e-4bb6-a34e-1d27f51cfcef None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:35.742561 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ebc04-8cab-47cc-8773-b952a01cc210 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:35.784500 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56646f3f-2a50-4861-a2eb-e519d534ea5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:35.785501 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56646f3f-2a50-4861-a2eb-e519d534ea5f None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:35.786231 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56646f3f-2a50-4861-a2eb-e519d534ea5f None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:35.787310 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56646f3f-2a50-4861-a2eb-e519d534ea5f None admin] PATH_INFO: `/v3/roles/member` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:35.793435 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9f540-fd36-482a-87fe-d07999bfe89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:35.794931 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9f540-fd36-482a-87fe-d07999bfe89f None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:35.795466 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9f540-fd36-482a-87fe-d07999bfe89f None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:35.795972 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9f540-fd36-482a-87fe-d07999bfe89f None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:35.797060 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9f540-fd36-482a-87fe-d07999bfe89f None admin] RBAC: Adding query filter params (name=admin) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:35.797586 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9f540-fd36-482a-87fe-d07999bfe89f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:35.799716 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9f540-fd36-482a-87fe-d07999bfe89f None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:35.806200 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56646f3f-2a50-4861-a2eb-e519d534ea5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:35.810177 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 211/411] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:38:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:35.811366 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9f540-fd36-482a-87fe-d07999bfe89f None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:35.821038 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-56646f3f-2a50-4861-a2eb-e519d534ea5f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 20:38:35.822671 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 201/412] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:38:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:35.827963 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56646f3f-2a50-4861-a2eb-e519d534ea5f None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:35.961983 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56646f3f-2a50-4861-a2eb-e519d534ea5f None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:35.977683 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9f540-fd36-482a-87fe-d07999bfe89f None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:36.001541 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bc75b-9002-4475-80ab-a95063426dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:36.002811 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bc75b-9002-4475-80ab-a95063426dab None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:36.003322 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bc75b-9002-4475-80ab-a95063426dab None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:36.003837 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bc75b-9002-4475-80ab-a95063426dab None admin] PATH_INFO: `/v3/groups/460103a749b041b5ad8f6812e62f1ae6` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:36.006186 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18bc75b-9002-4475-80ab-a95063426dab None admin] RBAC: Authorizing `identity:get_group(group_id=460103a749b041b5ad8f6812e62f1ae6)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:36.007906 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18bc75b-9002-4475-80ab-a95063426dab None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:36.009941 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 202/413] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Oct 28 20:38:35 2022] GET /identity/v3/groups/460103a749b041b5ad8f6812e62f1ae6 => generated 229 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:36.011042 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bc75b-9002-4475-80ab-a95063426dab None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:36.040083 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4b007-e75c-4130-83d8-7aaad80f8e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:36.041555 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4b007-e75c-4130-83d8-7aaad80f8e8e None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:36.042053 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4b007-e75c-4130-83d8-7aaad80f8e8e None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:36.042919 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4b007-e75c-4130-83d8-7aaad80f8e8e None admin] PATH_INFO: `/v3/groups/8efc1769522143babf54186b64258349` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:36.044808 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4b007-e75c-4130-83d8-7aaad80f8e8e None admin] RBAC: Authorizing `identity:get_group(group_id=8efc1769522143babf54186b64258349)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:36.047672 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4b007-e75c-4130-83d8-7aaad80f8e8e None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:36.051994 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 212/414] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Oct 28 20:38:35 2022] GET /identity/v3/groups/8efc1769522143babf54186b64258349 => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:36.053260 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4b007-e75c-4130-83d8-7aaad80f8e8e None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:36.123590 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bc75b-9002-4475-80ab-a95063426dab None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:36.162746 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a4f48-8950-407f-bed7-75e669484671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:36.163854 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a4f48-8950-407f-bed7-75e669484671 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:36.164372 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a4f48-8950-407f-bed7-75e669484671 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:36.164856 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a4f48-8950-407f-bed7-75e669484671 None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:36.165843 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a4f48-8950-407f-bed7-75e669484671 None admin] RBAC: Adding query filter params (name=member) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:36.166361 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a4f48-8950-407f-bed7-75e669484671 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:36.168024 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a4f48-8950-407f-bed7-75e669484671 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:36.178628 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 203/415] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 20:38:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:36.179946 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a4f48-8950-407f-bed7-75e669484671 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:36.255477 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4b007-e75c-4130-83d8-7aaad80f8e8e None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:36.308482 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a4f48-8950-407f-bed7-75e669484671 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:36.324177 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d540ef-f3d7-4593-a7d5-873078645f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:36.325707 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d540ef-f3d7-4593-a7d5-873078645f5e None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:36.326204 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d540ef-f3d7-4593-a7d5-873078645f5e None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:36.326720 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d540ef-f3d7-4593-a7d5-873078645f5e None admin] PATH_INFO: `/v3/projects/3ac39942cf3a45f18781d7210d0aa25e` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:36.328968 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d540ef-f3d7-4593-a7d5-873078645f5e None admin] RBAC: Authorizing `identity:get_project(project_id=3ac39942cf3a45f18781d7210d0aa25e)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:36.331773 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d540ef-f3d7-4593-a7d5-873078645f5e None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:36.336296 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 213/416] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:38:36 2022] GET /identity/v3/projects/3ac39942cf3a45f18781d7210d0aa25e => generated 344 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:36.337794 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d540ef-f3d7-4593-a7d5-873078645f5e None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:36.352354 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99d2e8-a167-4836-9e0b-d45faa04d9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:36.353730 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99d2e8-a167-4836-9e0b-d45faa04d9fe None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:36.354242 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99d2e8-a167-4836-9e0b-d45faa04d9fe None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:36.354886 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99d2e8-a167-4836-9e0b-d45faa04d9fe None admin] PATH_INFO: `/v3/projects/38cebd4b9d0f44b4af767a7143050e7d` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:36.356584 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99d2e8-a167-4836-9e0b-d45faa04d9fe None admin] RBAC: Authorizing `identity:get_project(project_id=38cebd4b9d0f44b4af767a7143050e7d)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:36.358339 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99d2e8-a167-4836-9e0b-d45faa04d9fe None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:36.360439 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 204/417] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:38:36 2022] GET /identity/v3/projects/38cebd4b9d0f44b4af767a7143050e7d => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:36.361627 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99d2e8-a167-4836-9e0b-d45faa04d9fe None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:36.476224 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d540ef-f3d7-4593-a7d5-873078645f5e None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:36.513413 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b4e94-e3d3-468d-b0ef-deccbd90087a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:36.514194 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b4e94-e3d3-468d-b0ef-deccbd90087a None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:36.514450 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b4e94-e3d3-468d-b0ef-deccbd90087a None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:36.514719 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b4e94-e3d3-468d-b0ef-deccbd90087a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:36.534421 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99d2e8-a167-4836-9e0b-d45faa04d9fe None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:36.589595 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b4e94-e3d3-468d-b0ef-deccbd90087a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:36.591170 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b4e94-e3d3-468d-b0ef-deccbd90087a None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:36.599302 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277f3a6-61c2-4d0e-98c3-3a31d5e697b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:36.601390 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277f3a6-61c2-4d0e-98c3-3a31d5e697b7 None admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:36.602211 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277f3a6-61c2-4d0e-98c3-3a31d5e697b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:36.602999 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277f3a6-61c2-4d0e-98c3-3a31d5e697b7 None admin] PATH_INFO: `/v3/projects/3ac39942cf3a45f18781d7210d0aa25e/groups/460103a749b041b5ad8f6812e62f1ae6/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:36.606986 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277f3a6-61c2-4d0e-98c3-3a31d5e697b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ac39942cf3a45f18781d7210d0aa25e, group_id=460103a749b041b5ad8f6812e62f1ae6, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:36.610132 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277f3a6-61c2-4d0e-98c3-3a31d5e697b7 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:36.635607 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 205/418] 10.222.0.49 () {58 vars in 1442 bytes} [Fri Oct 28 20:38:36 2022] PUT /identity/v3/projects/3ac39942cf3a45f18781d7210d0aa25e/groups/460103a749b041b5ad8f6812e62f1ae6/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:38:36.637737 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277f3a6-61c2-4d0e-98c3-3a31d5e697b7 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:36.704975 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 214/419] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:38:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 20:38:36.712347 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b4e94-e3d3-468d-b0ef-deccbd90087a None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:36.791266 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277f3a6-61c2-4d0e-98c3-3a31d5e697b7 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:36.839126 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc227f1-2500-44e3-b666-70af91063b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:36.840113 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc227f1-2500-44e3-b666-70af91063b9a None admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:36.840336 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc227f1-2500-44e3-b666-70af91063b9a None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:36.840609 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc227f1-2500-44e3-b666-70af91063b9a None admin] PATH_INFO: `/v3/projects/38cebd4b9d0f44b4af767a7143050e7d/groups/8efc1769522143babf54186b64258349/roles/28b8756191f44cadbdae28d1af156b6c` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:36.850290 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc227f1-2500-44e3-b666-70af91063b9a None admin] RBAC: Authorizing `identity:create_grant(project_id=38cebd4b9d0f44b4af767a7143050e7d, group_id=8efc1769522143babf54186b64258349, role_id=28b8756191f44cadbdae28d1af156b6c)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:36.851804 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc227f1-2500-44e3-b666-70af91063b9a None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:36.876786 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 206/420] 10.222.0.49 () {58 vars in 1442 bytes} [Fri Oct 28 20:38:36 2022] PUT /identity/v3/projects/38cebd4b9d0f44b4af767a7143050e7d/groups/8efc1769522143babf54186b64258349/roles/28b8756191f44cadbdae28d1af156b6c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:38:36.940202 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b4e94-e3d3-468d-b0ef-deccbd90087a None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:36.984884 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575dc1e0-e7d1-440a-8e8c-91d4daa474c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:36.985765 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575dc1e0-e7d1-440a-8e8c-91d4daa474c2 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:36.986040 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575dc1e0-e7d1-440a-8e8c-91d4daa474c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:36.986310 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575dc1e0-e7d1-440a-8e8c-91d4daa474c2 None admin] PATH_INFO: `/v3/projects/7651e6b03b65497ab11181afb4e27ca6` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:36.987544 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575dc1e0-e7d1-440a-8e8c-91d4daa474c2 None admin] RBAC: Authorizing `identity:get_project(project_id=7651e6b03b65497ab11181afb4e27ca6)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:36.989777 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575dc1e0-e7d1-440a-8e8c-91d4daa474c2 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:36.991934 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 215/421] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:38:36 2022] GET /identity/v3/projects/7651e6b03b65497ab11181afb4e27ca6 => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:37.000438 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc227f1-2500-44e3-b666-70af91063b9a None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:37.136321 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc227f1-2500-44e3-b666-70af91063b9a None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:37.193745 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75330ac2-9db1-47fc-929d-3896d1163d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:37.194619 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75330ac2-9db1-47fc-929d-3896d1163d6d None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:37.194963 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75330ac2-9db1-47fc-929d-3896d1163d6d None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:37.195234 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75330ac2-9db1-47fc-929d-3896d1163d6d None admin] PATH_INFO: `/v3/groups/8efc1769522143babf54186b64258349` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:37.196507 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75330ac2-9db1-47fc-929d-3896d1163d6d None admin] RBAC: Authorizing `identity:get_group(group_id=8efc1769522143babf54186b64258349)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:37.197972 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75330ac2-9db1-47fc-929d-3896d1163d6d None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:37.199785 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 207/422] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Oct 28 20:38:36 2022] GET /identity/v3/groups/8efc1769522143babf54186b64258349 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:37.210144 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575dc1e0-e7d1-440a-8e8c-91d4daa474c2 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:37.341303 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eef7d9-5f81-42c0-a9a6-38dff51dbb3c None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:37.341585 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eef7d9-5f81-42c0-a9a6-38dff51dbb3c None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:37.341851 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eef7d9-5f81-42c0-a9a6-38dff51dbb3c None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:37.343905 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 208/423] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:37.349990 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd89043-670b-46ca-9a98-946563fdfcee None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:37.350282 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd89043-670b-46ca-9a98-946563fdfcee None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:37.350560 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd89043-670b-46ca-9a98-946563fdfcee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:37.387952 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-9cd89043-670b-46ca-9a98-946563fdfcee None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:37.389097 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-9cd89043-670b-46ca-9a98-946563fdfcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:37.423103 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575dc1e0-e7d1-440a-8e8c-91d4daa474c2 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:37.466295 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7538aa-05b8-419c-8239-37927a4f075e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:37.466979 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7538aa-05b8-419c-8239-37927a4f075e None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:37.467257 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7538aa-05b8-419c-8239-37927a4f075e None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:37.467527 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7538aa-05b8-419c-8239-37927a4f075e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:37.468448 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7538aa-05b8-419c-8239-37927a4f075e None admin] RBAC: Adding query filter params (group.id=8efc1769522143babf54186b64258349, role.id=aaafbf9fe78e46cd9f06410394fdb531, scope.project.id=7651e6b03b65497ab11181afb4e27ca6) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:37.468764 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7538aa-05b8-419c-8239-37927a4f075e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:37.470304 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7538aa-05b8-419c-8239-37927a4f075e None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:37.482773 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 216/424] 10.222.0.49 () {56 vars in 1376 bytes} [Fri Oct 28 20:38:37 2022] GET /identity/v3/role_assignments?group.id=8efc1769522143babf54186b64258349&scope.project.id=7651e6b03b65497ab11181afb4e27ca6&role.id=aaafbf9fe78e46cd9f06410394fdb531 => generated 611 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:37.539296 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 209/425] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 20:38:37.582847 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7538aa-05b8-419c-8239-37927a4f075e None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:37.714345 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7538aa-05b8-419c-8239-37927a4f075e None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:37.759118 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a2e8d-f70f-4071-92a2-5e17a1f0791d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:37.759979 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a2e8d-f70f-4071-92a2-5e17a1f0791d None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:37.760256 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a2e8d-f70f-4071-92a2-5e17a1f0791d None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:37.760523 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a2e8d-f70f-4071-92a2-5e17a1f0791d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:37.780175 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a2e8d-f70f-4071-92a2-5e17a1f0791d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:37.788559 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-829a2e8d-f70f-4071-92a2-5e17a1f0791d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 20:38:37.790127 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 217/426] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 20:38:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:37.796344 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd89043-670b-46ca-9a98-946563fdfcee None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:37.895014 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af1a7d-f600-4ac5-b0a6-b02fbb377ec9 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:37.895359 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af1a7d-f600-4ac5-b0a6-b02fbb377ec9 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:37.895782 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af1a7d-f600-4ac5-b0a6-b02fbb377ec9 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:37.897985 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 218/427] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:38:37.905323 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da993af3-8fde-4f57-93be-d6209688b08a None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:37.905617 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da993af3-8fde-4f57-93be-d6209688b08a None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:37.905872 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da993af3-8fde-4f57-93be-d6209688b08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:37.932195 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-da993af3-8fde-4f57-93be-d6209688b08a None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:37.933739 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-da993af3-8fde-4f57-93be-d6209688b08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:37.947806 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd89043-670b-46ca-9a98-946563fdfcee None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:37.977547 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b81133-fb3a-47af-a9bb-1d839cbef1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:37.978185 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b81133-fb3a-47af-a9bb-1d839cbef1a3 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:37.978461 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b81133-fb3a-47af-a9bb-1d839cbef1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:37.978728 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b81133-fb3a-47af-a9bb-1d839cbef1a3 None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:37.979482 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b81133-fb3a-47af-a9bb-1d839cbef1a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:37.979804 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b81133-fb3a-47af-a9bb-1d839cbef1a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:37.981210 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b81133-fb3a-47af-a9bb-1d839cbef1a3 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:37.991389 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 210/428] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:38:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:37.999884 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b81133-fb3a-47af-a9bb-1d839cbef1a3 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:38.046723 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 219/429] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:38:38.081204 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da993af3-8fde-4f57-93be-d6209688b08a None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:38.109434 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b81133-fb3a-47af-a9bb-1d839cbef1a3 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:38.164310 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf8098-34af-4e61-b429-b73085f96bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:38.165110 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf8098-34af-4e61-b429-b73085f96bcf None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:38.165394 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf8098-34af-4e61-b429-b73085f96bcf None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:38.165664 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf8098-34af-4e61-b429-b73085f96bcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:38.225855 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da993af3-8fde-4f57-93be-d6209688b08a None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:38.254910 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf8098-34af-4e61-b429-b73085f96bcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:38.256774 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf8098-34af-4e61-b429-b73085f96bcf None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:38.271115 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835f8f7-0bfb-476f-958d-51f25b892d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:38.271944 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835f8f7-0bfb-476f-958d-51f25b892d1d None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:38.272222 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835f8f7-0bfb-476f-958d-51f25b892d1d None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:38.272486 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835f8f7-0bfb-476f-958d-51f25b892d1d None admin] PATH_INFO: `/v3/roles/member` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:38.285586 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835f8f7-0bfb-476f-958d-51f25b892d1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:38.293559 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-a835f8f7-0bfb-476f-958d-51f25b892d1d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 20:38:38.295092 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 220/430] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:38:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:38:38.300535 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835f8f7-0bfb-476f-958d-51f25b892d1d None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:38.390613 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 211/431] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:38:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 20:38:38.396397 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf8098-34af-4e61-b429-b73085f96bcf None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:38.420298 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835f8f7-0bfb-476f-958d-51f25b892d1d None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:38.459361 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975be49-3252-411c-a3d0-6543335ef522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:38.460319 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975be49-3252-411c-a3d0-6543335ef522 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:38.460755 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975be49-3252-411c-a3d0-6543335ef522 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:38.461237 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975be49-3252-411c-a3d0-6543335ef522 None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:38.462118 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975be49-3252-411c-a3d0-6543335ef522 None admin] RBAC: Adding query filter params (name=member) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:38.462607 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975be49-3252-411c-a3d0-6543335ef522 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:38.464360 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975be49-3252-411c-a3d0-6543335ef522 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:38.474118 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 221/432] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 20:38:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:38.480699 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975be49-3252-411c-a3d0-6543335ef522 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:38.511786 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf8098-34af-4e61-b429-b73085f96bcf None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:38.552090 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e4dc0-9aae-4443-b5f8-d638de961bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:38.553077 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e4dc0-9aae-4443-b5f8-d638de961bba None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:38.553355 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e4dc0-9aae-4443-b5f8-d638de961bba None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:38.553623 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e4dc0-9aae-4443-b5f8-d638de961bba None admin] PATH_INFO: `/v3/projects/7651e6b03b65497ab11181afb4e27ca6` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:38.554844 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e4dc0-9aae-4443-b5f8-d638de961bba None admin] RBAC: Authorizing `identity:get_project(project_id=7651e6b03b65497ab11181afb4e27ca6)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:38.556923 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e4dc0-9aae-4443-b5f8-d638de961bba None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:38.558917 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 212/433] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:38:38 2022] GET /identity/v3/projects/7651e6b03b65497ab11181afb4e27ca6 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:38.564356 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e4dc0-9aae-4443-b5f8-d638de961bba None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:38.606351 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975be49-3252-411c-a3d0-6543335ef522 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:38.643973 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824c226-3e3c-407e-be95-162ff35830dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:38.645940 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824c226-3e3c-407e-be95-162ff35830dd None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:38.646423 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824c226-3e3c-407e-be95-162ff35830dd None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:38.646903 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824c226-3e3c-407e-be95-162ff35830dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:38.673294 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e4dc0-9aae-4443-b5f8-d638de961bba None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:38.712294 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce86cf-5fe6-4e92-a776-4765b0e5d037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:38.713173 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce86cf-5fe6-4e92-a776-4765b0e5d037 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:38.713499 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce86cf-5fe6-4e92-a776-4765b0e5d037 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:38.713783 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce86cf-5fe6-4e92-a776-4765b0e5d037 None admin] PATH_INFO: `/v3/groups/8efc1769522143babf54186b64258349` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:38.715226 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce86cf-5fe6-4e92-a776-4765b0e5d037 None admin] RBAC: Authorizing `identity:get_group(group_id=8efc1769522143babf54186b64258349)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:38.716649 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce86cf-5fe6-4e92-a776-4765b0e5d037 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:38.723904 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 213/434] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Oct 28 20:38:38 2022] GET /identity/v3/groups/8efc1769522143babf54186b64258349 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:38.724745 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824c226-3e3c-407e-be95-162ff35830dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:38.725186 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce86cf-5fe6-4e92-a776-4765b0e5d037 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:38.726881 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824c226-3e3c-407e-be95-162ff35830dd None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:38.839815 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce86cf-5fe6-4e92-a776-4765b0e5d037 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:38.841129 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 222/435] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:38:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 20:38:38.849086 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824c226-3e3c-407e-be95-162ff35830dd None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:38.881805 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a3591-2e96-43c1-aede-41b437479957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:38.882738 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a3591-2e96-43c1-aede-41b437479957 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:38.883237 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a3591-2e96-43c1-aede-41b437479957 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:38.883653 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a3591-2e96-43c1-aede-41b437479957 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:38.884641 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a3591-2e96-43c1-aede-41b437479957 None admin] RBAC: Adding query filter params (group.id=8efc1769522143babf54186b64258349, role.id=28b8756191f44cadbdae28d1af156b6c, scope.project.id=7651e6b03b65497ab11181afb4e27ca6) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:38.885143 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a3591-2e96-43c1-aede-41b437479957 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:38.886751 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a3591-2e96-43c1-aede-41b437479957 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:38.903145 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 214/436] 10.222.0.49 () {56 vars in 1376 bytes} [Fri Oct 28 20:38:38 2022] GET /identity/v3/role_assignments?group.id=8efc1769522143babf54186b64258349&scope.project.id=7651e6b03b65497ab11181afb4e27ca6&role.id=28b8756191f44cadbdae28d1af156b6c => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:38.959028 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824c226-3e3c-407e-be95-162ff35830dd None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:38.999249 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb952bf-ec62-42a2-bf1a-c79a41beb450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:39.000161 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb952bf-ec62-42a2-bf1a-c79a41beb450 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:39.000440 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb952bf-ec62-42a2-bf1a-c79a41beb450 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:39.000714 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb952bf-ec62-42a2-bf1a-c79a41beb450 None admin] PATH_INFO: `/v3/projects/38cebd4b9d0f44b4af767a7143050e7d` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:39.001988 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb952bf-ec62-42a2-bf1a-c79a41beb450 None admin] RBAC: Authorizing `identity:get_project(project_id=38cebd4b9d0f44b4af767a7143050e7d)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:39.003473 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb952bf-ec62-42a2-bf1a-c79a41beb450 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:39.006873 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 223/437] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:38:38 2022] GET /identity/v3/projects/38cebd4b9d0f44b4af767a7143050e7d => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:39.012596 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a3591-2e96-43c1-aede-41b437479957 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:39.130261 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a3591-2e96-43c1-aede-41b437479957 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:39.175069 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1495bb-4889-4f83-9b12-67403b2fdf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:39.176055 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1495bb-4889-4f83-9b12-67403b2fdf4d None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:39.176403 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1495bb-4889-4f83-9b12-67403b2fdf4d None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:39.176757 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1495bb-4889-4f83-9b12-67403b2fdf4d None admin] PATH_INFO: `/v3/groups/8efc1769522143babf54186b64258349` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:39.177959 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1495bb-4889-4f83-9b12-67403b2fdf4d None admin] RBAC: Authorizing `identity:get_group(group_id=8efc1769522143babf54186b64258349)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:39.179415 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1495bb-4889-4f83-9b12-67403b2fdf4d None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:39.181130 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 215/438] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Oct 28 20:38:39 2022] GET /identity/v3/groups/8efc1769522143babf54186b64258349 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:39.187046 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb952bf-ec62-42a2-bf1a-c79a41beb450 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:39.306307 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb952bf-ec62-42a2-bf1a-c79a41beb450 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:39.366386 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9a46f-6cc7-4cc8-be81-dcb0aeb3741c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:39.367496 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9a46f-6cc7-4cc8-be81-dcb0aeb3741c None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:39.368023 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9a46f-6cc7-4cc8-be81-dcb0aeb3741c None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:39.368514 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9a46f-6cc7-4cc8-be81-dcb0aeb3741c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:39.370200 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9a46f-6cc7-4cc8-be81-dcb0aeb3741c None admin] RBAC: Adding query filter params (group.id=8efc1769522143babf54186b64258349, role.id=aaafbf9fe78e46cd9f06410394fdb531, scope.project.id=38cebd4b9d0f44b4af767a7143050e7d) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:39.370749 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9a46f-6cc7-4cc8-be81-dcb0aeb3741c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:39.373416 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9a46f-6cc7-4cc8-be81-dcb0aeb3741c None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:39.384061 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 224/439] 10.222.0.49 () {56 vars in 1376 bytes} [Fri Oct 28 20:38:39 2022] GET /identity/v3/role_assignments?group.id=8efc1769522143babf54186b64258349&scope.project.id=38cebd4b9d0f44b4af767a7143050e7d&role.id=aaafbf9fe78e46cd9f06410394fdb531 => generated 611 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:39.532867 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930288b2-7994-41d8-9ed8-3f4ad63e0872 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:39.533152 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930288b2-7994-41d8-9ed8-3f4ad63e0872 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:39.533432 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930288b2-7994-41d8-9ed8-3f4ad63e0872 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:39.535380 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 216/440] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:38:39.543241 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237e613-9280-4f54-b878-c0dab97b7316 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:39.543626 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237e613-9280-4f54-b878-c0dab97b7316 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:39.543830 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237e613-9280-4f54-b878-c0dab97b7316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:39.563285 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-b237e613-9280-4f54-b878-c0dab97b7316 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:39.564549 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-b237e613-9280-4f54-b878-c0dab97b7316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:39.654543 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 225/441] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:38:39.679079 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930288b2-7994-41d8-9ed8-3f4ad63e0872 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:39.766608 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777398dc-56fb-4d37-ae1a-3cd015ddcf59 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:39.767327 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777398dc-56fb-4d37-ae1a-3cd015ddcf59 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:39.767327 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777398dc-56fb-4d37-ae1a-3cd015ddcf59 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:39.770349 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 226/442] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:38:39.779728 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d68fe-3f1a-4f3c-8cd4-c16d31c503af None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:39.780346 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d68fe-3f1a-4f3c-8cd4-c16d31c503af None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:39.780792 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d68fe-3f1a-4f3c-8cd4-c16d31c503af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:39.804147 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-559d68fe-3f1a-4f3c-8cd4-c16d31c503af None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:39.806062 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-559d68fe-3f1a-4f3c-8cd4-c16d31c503af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:39.825829 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930288b2-7994-41d8-9ed8-3f4ad63e0872 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:39.883161 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e78e1-7c31-4aaf-8455-89994c257198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:39.884493 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e78e1-7c31-4aaf-8455-89994c257198 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:39.884962 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e78e1-7c31-4aaf-8455-89994c257198 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:39.885406 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e78e1-7c31-4aaf-8455-89994c257198 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:39.901302 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e78e1-7c31-4aaf-8455-89994c257198 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:39.908569 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-617e78e1-7c31-4aaf-8455-89994c257198 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 20:38:39.909739 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 217/443] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 20:38:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:39.916414 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e78e1-7c31-4aaf-8455-89994c257198 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:39.923794 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 227/444] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:38:39.949812 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d68fe-3f1a-4f3c-8cd4-c16d31c503af None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:40.033318 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e78e1-7c31-4aaf-8455-89994c257198 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:40.073173 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d68fe-3f1a-4f3c-8cd4-c16d31c503af None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:40.074379 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f7d90-a70f-426a-8737-e28384197677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:40.075047 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f7d90-a70f-426a-8737-e28384197677 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:40.075324 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f7d90-a70f-426a-8737-e28384197677 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:40.075606 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f7d90-a70f-426a-8737-e28384197677 None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:40.076391 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f7d90-a70f-426a-8737-e28384197677 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:40.076696 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f7d90-a70f-426a-8737-e28384197677 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:40.078085 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f7d90-a70f-426a-8737-e28384197677 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:40.086643 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 218/445] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:38:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:40.092434 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f7d90-a70f-426a-8737-e28384197677 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:40.129498 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8be424-b31d-43c6-b802-514fbdf0e205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:40.130831 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8be424-b31d-43c6-b802-514fbdf0e205 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:40.131332 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8be424-b31d-43c6-b802-514fbdf0e205 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:40.131850 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8be424-b31d-43c6-b802-514fbdf0e205 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:40.150141 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8be424-b31d-43c6-b802-514fbdf0e205 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:40.165623 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-3f8be424-b31d-43c6-b802-514fbdf0e205 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 20:38:40.173081 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 228/446] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 20:38:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:38:40.174806 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8be424-b31d-43c6-b802-514fbdf0e205 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:40.197698 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f7d90-a70f-426a-8737-e28384197677 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:40.236200 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1599f5-70a2-4a42-a24f-c50fcfcaa16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:40.236966 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1599f5-70a2-4a42-a24f-c50fcfcaa16c None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:40.237355 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1599f5-70a2-4a42-a24f-c50fcfcaa16c None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:40.237716 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1599f5-70a2-4a42-a24f-c50fcfcaa16c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:40.308638 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1599f5-70a2-4a42-a24f-c50fcfcaa16c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:40.310104 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1599f5-70a2-4a42-a24f-c50fcfcaa16c None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:40.341892 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8be424-b31d-43c6-b802-514fbdf0e205 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:40.399577 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5cb52-9188-4736-b31b-3c0663e7f2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:40.400739 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5cb52-9188-4736-b31b-3c0663e7f2f9 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:40.401241 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5cb52-9188-4736-b31b-3c0663e7f2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:40.401716 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5cb52-9188-4736-b31b-3c0663e7f2f9 None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:40.403009 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5cb52-9188-4736-b31b-3c0663e7f2f9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:40.403529 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5cb52-9188-4736-b31b-3c0663e7f2f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:40.406125 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5cb52-9188-4736-b31b-3c0663e7f2f9 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:40.415394 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 219/447] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:38:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 20:38:40.427533 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 229/448] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:38:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:40.427734 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1599f5-70a2-4a42-a24f-c50fcfcaa16c None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:40.429318 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5cb52-9188-4736-b31b-3c0663e7f2f9 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:40.522189 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1599f5-70a2-4a42-a24f-c50fcfcaa16c None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:40.557434 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b4a77-b659-4509-b1f2-51228c843261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:40.558302 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b4a77-b659-4509-b1f2-51228c843261 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:40.558579 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b4a77-b659-4509-b1f2-51228c843261 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:40.558849 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b4a77-b659-4509-b1f2-51228c843261 None admin] PATH_INFO: `/v3/projects/3ac39942cf3a45f18781d7210d0aa25e` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:40.560095 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b4a77-b659-4509-b1f2-51228c843261 None admin] RBAC: Authorizing `identity:get_project(project_id=3ac39942cf3a45f18781d7210d0aa25e)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:40.561565 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b4a77-b659-4509-b1f2-51228c843261 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:40.563292 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 220/449] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:38:40 2022] GET /identity/v3/projects/3ac39942cf3a45f18781d7210d0aa25e => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:40.568790 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b4a77-b659-4509-b1f2-51228c843261 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:40.592019 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5cb52-9188-4736-b31b-3c0663e7f2f9 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:40.642915 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f5be1-f6b2-4faa-adeb-873806e3eb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:40.643730 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f5be1-f6b2-4faa-adeb-873806e3eb8f None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:40.644195 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f5be1-f6b2-4faa-adeb-873806e3eb8f None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:40.644630 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f5be1-f6b2-4faa-adeb-873806e3eb8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:40.686633 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b4a77-b659-4509-b1f2-51228c843261 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:40.725629 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c8d55-7dec-45dd-bce9-014615dba789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:40.726760 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c8d55-7dec-45dd-bce9-014615dba789 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:40.727107 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c8d55-7dec-45dd-bce9-014615dba789 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:40.727445 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c8d55-7dec-45dd-bce9-014615dba789 None admin] PATH_INFO: `/v3/groups/460103a749b041b5ad8f6812e62f1ae6` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:40.727684 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f5be1-f6b2-4faa-adeb-873806e3eb8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:40.728884 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c8d55-7dec-45dd-bce9-014615dba789 None admin] RBAC: Authorizing `identity:get_group(group_id=460103a749b041b5ad8f6812e62f1ae6)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:40.729433 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f5be1-f6b2-4faa-adeb-873806e3eb8f None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:40.730483 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c8d55-7dec-45dd-bce9-014615dba789 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:40.732590 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 221/450] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Oct 28 20:38:40 2022] GET /identity/v3/groups/460103a749b041b5ad8f6812e62f1ae6 => generated 229 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:40.741779 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c8d55-7dec-45dd-bce9-014615dba789 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:40.848671 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 230/451] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:38:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 20:38:40.855313 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f5be1-f6b2-4faa-adeb-873806e3eb8f None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:40.861054 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c8d55-7dec-45dd-bce9-014615dba789 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:40.911926 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e73ae-f649-4bc9-b8ec-9f66984b32b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:40.912724 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e73ae-f649-4bc9-b8ec-9f66984b32b1 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:40.913172 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e73ae-f649-4bc9-b8ec-9f66984b32b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:40.913561 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e73ae-f649-4bc9-b8ec-9f66984b32b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:40.914473 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e73ae-f649-4bc9-b8ec-9f66984b32b1 None admin] RBAC: Adding query filter params (group.id=460103a749b041b5ad8f6812e62f1ae6, role.id=8fe105eeb7bf4856a94b0633bd781414, scope.project.id=3ac39942cf3a45f18781d7210d0aa25e) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:40.914849 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e73ae-f649-4bc9-b8ec-9f66984b32b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:40.916739 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e73ae-f649-4bc9-b8ec-9f66984b32b1 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:40.925363 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 222/452] 10.222.0.49 () {56 vars in 1376 bytes} [Fri Oct 28 20:38:40 2022] GET /identity/v3/role_assignments?group.id=460103a749b041b5ad8f6812e62f1ae6&scope.project.id=3ac39942cf3a45f18781d7210d0aa25e&role.id=8fe105eeb7bf4856a94b0633bd781414 => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:40.988081 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f5be1-f6b2-4faa-adeb-873806e3eb8f None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:41.028727 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f515ffff-948b-4881-a552-b2911586b102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:41.029714 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515ffff-948b-4881-a552-b2911586b102 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:41.030074 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515ffff-948b-4881-a552-b2911586b102 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:41.030448 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515ffff-948b-4881-a552-b2911586b102 None admin] PATH_INFO: `/v3/projects/38cebd4b9d0f44b4af767a7143050e7d` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:41.031890 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515ffff-948b-4881-a552-b2911586b102 None admin] RBAC: Authorizing `identity:get_project(project_id=38cebd4b9d0f44b4af767a7143050e7d)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:41.033494 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515ffff-948b-4881-a552-b2911586b102 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:41.035438 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 231/453] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:38:40 2022] GET /identity/v3/projects/38cebd4b9d0f44b4af767a7143050e7d => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:41.044694 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e73ae-f649-4bc9-b8ec-9f66984b32b1 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:41.167195 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e73ae-f649-4bc9-b8ec-9f66984b32b1 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:41.204788 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6646f-9b6f-4363-bb1d-ef8f7d231cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:41.205712 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6646f-9b6f-4363-bb1d-ef8f7d231cf2 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:41.205991 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6646f-9b6f-4363-bb1d-ef8f7d231cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:41.206258 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6646f-9b6f-4363-bb1d-ef8f7d231cf2 None admin] PATH_INFO: `/v3/groups/8efc1769522143babf54186b64258349` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:41.208002 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6646f-9b6f-4363-bb1d-ef8f7d231cf2 None admin] RBAC: Authorizing `identity:get_group(group_id=8efc1769522143babf54186b64258349)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:41.209465 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6646f-9b6f-4363-bb1d-ef8f7d231cf2 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:41.211133 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 223/454] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Oct 28 20:38:41 2022] GET /identity/v3/groups/8efc1769522143babf54186b64258349 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:41.217568 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f515ffff-948b-4881-a552-b2911586b102 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:41.386014 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f515ffff-948b-4881-a552-b2911586b102 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:41.443111 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1d804-bb41-432c-8bd5-a866cd33a728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:41.444232 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1d804-bb41-432c-8bd5-a866cd33a728 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:41.444739 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1d804-bb41-432c-8bd5-a866cd33a728 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:41.445206 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1d804-bb41-432c-8bd5-a866cd33a728 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:41.446787 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1d804-bb41-432c-8bd5-a866cd33a728 None admin] RBAC: Adding query filter params (group.id=8efc1769522143babf54186b64258349, role.id=28b8756191f44cadbdae28d1af156b6c, scope.project.id=38cebd4b9d0f44b4af767a7143050e7d) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:41.447328 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1d804-bb41-432c-8bd5-a866cd33a728 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:41.449987 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1d804-bb41-432c-8bd5-a866cd33a728 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:41.460433 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 232/455] 10.222.0.49 () {56 vars in 1376 bytes} [Fri Oct 28 20:38:41 2022] GET /identity/v3/role_assignments?group.id=8efc1769522143babf54186b64258349&scope.project.id=38cebd4b9d0f44b4af767a7143050e7d&role.id=28b8756191f44cadbdae28d1af156b6c => generated 611 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:45.207381 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f700b-da77-4899-ab9e-8b9fc1dd68e4 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:45.209025 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f700b-da77-4899-ab9e-8b9fc1dd68e4 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:45.209789 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f700b-da77-4899-ab9e-8b9fc1dd68e4 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:45.213983 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 224/456] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:45.230724 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b750497-22b0-4c35-8e10-a93798c84ab9 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:45.231434 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b750497-22b0-4c35-8e10-a93798c84ab9 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:45.231434 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b750497-22b0-4c35-8e10-a93798c84ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:45.256911 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-5b750497-22b0-4c35-8e10-a93798c84ab9 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:45.258123 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-5b750497-22b0-4c35-8e10-a93798c84ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:45.354580 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 233/457] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:38:45.409323 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f700b-da77-4899-ab9e-8b9fc1dd68e4 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:45.646957 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f700b-da77-4899-ab9e-8b9fc1dd68e4 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:45.732353 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de7168-0d3a-4b1d-ab51-15227117c4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:45.733156 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de7168-0d3a-4b1d-ab51-15227117c4c1 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:45.733435 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de7168-0d3a-4b1d-ab51-15227117c4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:45.733704 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de7168-0d3a-4b1d-ab51-15227117c4c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:45.751700 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de7168-0d3a-4b1d-ab51-15227117c4c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:45.753194 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de7168-0d3a-4b1d-ab51-15227117c4c1 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:45.779540 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-76de7168-0d3a-4b1d-ab51-15227117c4c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:38:45.786468 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 225/458] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:38:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:45.792893 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b750497-22b0-4c35-8e10-a93798c84ab9 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:45.957773 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b750497-22b0-4c35-8e10-a93798c84ab9 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:45.976725 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a610e-4ae8-4ef4-9f77-1cc4292554cd None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:45.976992 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a610e-4ae8-4ef4-9f77-1cc4292554cd None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:45.977288 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a610e-4ae8-4ef4-9f77-1cc4292554cd None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:45.979344 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 226/459] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:45.985517 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fba18d-b873-41de-889e-63230a446e6c None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:45.986363 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fba18d-b873-41de-889e-63230a446e6c None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:45.987111 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fba18d-b873-41de-889e-63230a446e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:46.000337 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f318255b-b008-419a-b3bf-d4e8df0c8f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:46.001016 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f318255b-b008-419a-b3bf-d4e8df0c8f41 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:46.001289 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f318255b-b008-419a-b3bf-d4e8df0c8f41 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:46.001560 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f318255b-b008-419a-b3bf-d4e8df0c8f41 None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:46.002298 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f318255b-b008-419a-b3bf-d4e8df0c8f41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:46.008343 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f318255b-b008-419a-b3bf-d4e8df0c8f41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:46.009821 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f318255b-b008-419a-b3bf-d4e8df0c8f41 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:46.025989 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-19fba18d-b873-41de-889e-63230a446e6c None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:46.027201 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-19fba18d-b873-41de-889e-63230a446e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:46.036373 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 234/460] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:46.039004 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f318255b-b008-419a-b3bf-d4e8df0c8f41 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:46.189609 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 227/461] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:38:46.191196 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3280b1-bf9c-4b29-991b-de7e10b3d84a None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:46.191970 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3280b1-bf9c-4b29-991b-de7e10b3d84a None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:46.192243 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3280b1-bf9c-4b29-991b-de7e10b3d84a None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:46.194435 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 228/462] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:46.203799 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28161d09-eb04-4521-ad14-5f3849cea26e None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:46.203799 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28161d09-eb04-4521-ad14-5f3849cea26e None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:46.203799 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28161d09-eb04-4521-ad14-5f3849cea26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:46.228086 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-28161d09-eb04-4521-ad14-5f3849cea26e None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:46.228619 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-28161d09-eb04-4521-ad14-5f3849cea26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:46.233700 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f318255b-b008-419a-b3bf-d4e8df0c8f41 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:46.272381 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b99bb8-f88a-4365-ba67-0aa5f253747d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:46.273470 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b99bb8-f88a-4365-ba67-0aa5f253747d None admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:46.274004 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b99bb8-f88a-4365-ba67-0aa5f253747d None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:46.274478 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b99bb8-f88a-4365-ba67-0aa5f253747d None admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:46.275390 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b99bb8-f88a-4365-ba67-0aa5f253747d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:46.277251 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b99bb8-f88a-4365-ba67-0aa5f253747d None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:46.307825 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 235/463] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Oct 28 20:38:46 2022] POST /identity/v3/users => generated 248 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:38:46.309247 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b99bb8-f88a-4365-ba67-0aa5f253747d None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:46.313479 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 229/464] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 20:38:46.348170 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28161d09-eb04-4521-ad14-5f3849cea26e None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:46.526929 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b99bb8-f88a-4365-ba67-0aa5f253747d None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:46.551541 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28161d09-eb04-4521-ad14-5f3849cea26e None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:46.605293 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc537e-bc21-45da-9289-e15de56d216b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:46.607308 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc537e-bc21-45da-9289-e15de56d216b None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:46.608701 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc537e-bc21-45da-9289-e15de56d216b None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:46.611306 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc537e-bc21-45da-9289-e15de56d216b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:46.638730 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f32eb3-d05b-4ab2-86de-abd29f3f2ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:46.638730 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f32eb3-d05b-4ab2-86de-abd29f3f2ad1 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:46.638730 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f32eb3-d05b-4ab2-86de-abd29f3f2ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:46.639200 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc537e-bc21-45da-9289-e15de56d216b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:46.639356 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f32eb3-d05b-4ab2-86de-abd29f3f2ad1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:46.639827 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc537e-bc21-45da-9289-e15de56d216b None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:46.661551 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f32eb3-d05b-4ab2-86de-abd29f3f2ad1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:46.663038 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f32eb3-d05b-4ab2-86de-abd29f3f2ad1 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:46.667000 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-7bcc537e-bc21-45da-9289-e15de56d216b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:38:46.670122 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 236/465] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:38:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:46.677699 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06541aba-5ffd-4a1c-978b-1237622ccbb5 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:46.678131 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06541aba-5ffd-4a1c-978b-1237622ccbb5 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:46.678526 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06541aba-5ffd-4a1c-978b-1237622ccbb5 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:46.681175 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 237/466] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:46 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:46.682643 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06541aba-5ffd-4a1c-978b-1237622ccbb5 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:46.684196 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-18f32eb3-d05b-4ab2-86de-abd29f3f2ad1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:38:46.685675 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 230/467] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:38:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:38:46.691408 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2091da-275b-4973-94b8-927cff824da5 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:46.691795 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2091da-275b-4973-94b8-927cff824da5 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:46.692066 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2091da-275b-4973-94b8-927cff824da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:46.713109 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-cd2091da-275b-4973-94b8-927cff824da5 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:46.714321 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-cd2091da-275b-4973-94b8-927cff824da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:46.830651 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06541aba-5ffd-4a1c-978b-1237622ccbb5 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:46.838421 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 231/468] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:38:46.841023 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2091da-275b-4973-94b8-927cff824da5 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:46.892840 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72834b66-a0c6-477d-8f88-71b1adc645d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:46.893354 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72834b66-a0c6-477d-8f88-71b1adc645d9 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:46.893628 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72834b66-a0c6-477d-8f88-71b1adc645d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:46.893886 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72834b66-a0c6-477d-8f88-71b1adc645d9 None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:46.895165 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72834b66-a0c6-477d-8f88-71b1adc645d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:46.895437 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72834b66-a0c6-477d-8f88-71b1adc645d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:46.896961 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72834b66-a0c6-477d-8f88-71b1adc645d9 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:46.912650 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 238/469] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:46.913534 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72834b66-a0c6-477d-8f88-71b1adc645d9 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:47.030182 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72834b66-a0c6-477d-8f88-71b1adc645d9 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:47.039207 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2091da-275b-4973-94b8-927cff824da5 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:47.065896 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871f7fe-e4b4-47d1-815b-5ddd94c78a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:47.067587 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871f7fe-e4b4-47d1-815b-5ddd94c78a60 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:47.067953 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871f7fe-e4b4-47d1-815b-5ddd94c78a60 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:47.068243 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871f7fe-e4b4-47d1-815b-5ddd94c78a60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:47.080542 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7871f7fe-e4b4-47d1-815b-5ddd94c78a60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:47.083160 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7871f7fe-e4b4-47d1-815b-5ddd94c78a60 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:47.088764 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5b5ff-12d6-4331-9a7b-167d379a842d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:47.089442 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5b5ff-12d6-4331-9a7b-167d379a842d None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:47.089719 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5b5ff-12d6-4331-9a7b-167d379a842d None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:47.090015 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5b5ff-12d6-4331-9a7b-167d379a842d None admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:47.090713 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5b5ff-12d6-4331-9a7b-167d379a842d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:47.091015 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5b5ff-12d6-4331-9a7b-167d379a842d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:47.092463 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5b5ff-12d6-4331-9a7b-167d379a842d None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:47.104098 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-7871f7fe-e4b4-47d1-815b-5ddd94c78a60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:38:47.112637 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 232/470] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:47.112637 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5b5ff-12d6-4331-9a7b-167d379a842d None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:47.113586 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 239/471] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:38:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:47.115300 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32025d-ff2e-45a9-aa69-533bf8e0e4bd None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:47.115839 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32025d-ff2e-45a9-aa69-533bf8e0e4bd None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:47.116293 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32025d-ff2e-45a9-aa69-533bf8e0e4bd None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:47.123849 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 240/472] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:47.123849 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32025d-ff2e-45a9-aa69-533bf8e0e4bd None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:47.234009 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5b5ff-12d6-4331-9a7b-167d379a842d None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:47.260409 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32025d-ff2e-45a9-aa69-533bf8e0e4bd None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:47.286681 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f272aee-2efc-433a-a5a5-c292f9705c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:47.287680 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f272aee-2efc-433a-a5a5-c292f9705c7c None admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:47.288126 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f272aee-2efc-433a-a5a5-c292f9705c7c None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:47.288541 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f272aee-2efc-433a-a5a5-c292f9705c7c None admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:47.289397 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f272aee-2efc-433a-a5a5-c292f9705c7c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:47.291186 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f272aee-2efc-433a-a5a5-c292f9705c7c None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:47.304203 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8f587-8bda-4ee5-bb56-000f3c99edc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:47.305044 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8f587-8bda-4ee5-bb56-000f3c99edc5 None admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:47.305334 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8f587-8bda-4ee5-bb56-000f3c99edc5 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:47.305724 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8f587-8bda-4ee5-bb56-000f3c99edc5 None admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:47.306349 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8f587-8bda-4ee5-bb56-000f3c99edc5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:47.307992 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8f587-8bda-4ee5-bb56-000f3c99edc5 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:47.317631 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 233/473] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Oct 28 20:38:47 2022] POST /identity/v3/users => generated 246 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:38:47.319070 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f272aee-2efc-433a-a5a5-c292f9705c7c None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:47.347880 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 241/474] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Oct 28 20:38:47 2022] POST /identity/v3/users => generated 248 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:38:47.347880 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a92966-cbe3-44c8-a264-44f079bba750 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:47.347880 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a92966-cbe3-44c8-a264-44f079bba750 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:47.347880 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a92966-cbe3-44c8-a264-44f079bba750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:47.373843 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-93a92966-cbe3-44c8-a264-44f079bba750 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:47.376016 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-93a92966-cbe3-44c8-a264-44f079bba750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:47.443101 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f272aee-2efc-433a-a5a5-c292f9705c7c None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:47.481872 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa064aa2-2990-43cc-bb91-5b4328e68e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:47.482551 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa064aa2-2990-43cc-bb91-5b4328e68e5c None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:47.482829 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa064aa2-2990-43cc-bb91-5b4328e68e5c None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:47.483107 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa064aa2-2990-43cc-bb91-5b4328e68e5c None admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:47.483872 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa064aa2-2990-43cc-bb91-5b4328e68e5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:47.484173 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa064aa2-2990-43cc-bb91-5b4328e68e5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:47.485613 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa064aa2-2990-43cc-bb91-5b4328e68e5c None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:47.498966 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 242/475] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:38:47.499433 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 234/476] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:47.509007 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a92966-cbe3-44c8-a264-44f079bba750 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:47.580666 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa064aa2-2990-43cc-bb91-5b4328e68e5c None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:47.716091 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a92966-cbe3-44c8-a264-44f079bba750 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:47.767330 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa064aa2-2990-43cc-bb91-5b4328e68e5c None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:47.781263 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf028f83-4f84-4d0f-ac6d-ef9e0410bbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:47.782373 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf028f83-4f84-4d0f-ac6d-ef9e0410bbf9 None admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:47.782855 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf028f83-4f84-4d0f-ac6d-ef9e0410bbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:47.783330 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf028f83-4f84-4d0f-ac6d-ef9e0410bbf9 None admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:47.784676 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf028f83-4f84-4d0f-ac6d-ef9e0410bbf9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:47.789039 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf028f83-4f84-4d0f-ac6d-ef9e0410bbf9 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:47.810929 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8186533-c3aa-4432-a4e5-23afa2f47c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:47.811653 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8186533-c3aa-4432-a4e5-23afa2f47c24 None admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:47.812117 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8186533-c3aa-4432-a4e5-23afa2f47c24 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:47.812453 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8186533-c3aa-4432-a4e5-23afa2f47c24 None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:47.813272 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8186533-c3aa-4432-a4e5-23afa2f47c24 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:47.814874 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8186533-c3aa-4432-a4e5-23afa2f47c24 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:47.826381 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 243/477] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Oct 28 20:38:47 2022] POST /identity/v3/users => generated 249 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:38:47.828290 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.sql.core [None req-f8186533-c3aa-4432-a4e5-23afa2f47c24 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 28 20:38:47.828290 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 28 20:38:47.828290 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [parameters: {'id': '80c2d8f030104c68807f1c70059ba7e2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 28 20:38:47.828290 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91652) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 28 20:38:47.844609 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-f8186533-c3aa-4432-a4e5-23afa2f47c24 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 28 20:38:47.846441 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 235/478] 10.222.0.49 () {60 vars in 1131 bytes} [Fri Oct 28 20:38:47 2022] POST /identity/v3/roles => generated 144 bytes in 266 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:38:47.856188 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf028f83-4f84-4d0f-ac6d-ef9e0410bbf9 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:48.098657 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf028f83-4f84-4d0f-ac6d-ef9e0410bbf9 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:48.175185 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24d11d-be8b-49fd-a806-e531e402b34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:48.177005 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24d11d-be8b-49fd-a806-e531e402b34b None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:48.177486 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24d11d-be8b-49fd-a806-e531e402b34b None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:48.178026 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24d11d-be8b-49fd-a806-e531e402b34b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:48.197310 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24d11d-be8b-49fd-a806-e531e402b34b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:48.205154 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-df24d11d-be8b-49fd-a806-e531e402b34b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 20:38:48.206840 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 244/479] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 20:38:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:48.216249 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8186533-c3aa-4432-a4e5-23afa2f47c24 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:48.335017 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8186533-c3aa-4432-a4e5-23afa2f47c24 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:48.375151 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a454e08-64db-4288-9524-5740add2ffcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:48.376256 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a454e08-64db-4288-9524-5740add2ffcc None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:48.376745 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a454e08-64db-4288-9524-5740add2ffcc None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:48.377222 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a454e08-64db-4288-9524-5740add2ffcc None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:48.379478 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a454e08-64db-4288-9524-5740add2ffcc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:48.381393 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a454e08-64db-4288-9524-5740add2ffcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:48.384078 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a454e08-64db-4288-9524-5740add2ffcc None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:48.403954 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 236/480] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:38:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:49.614181 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4aa7d5-ea54-4e1c-8bb0-d4845dfcba41 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:49.615297 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4aa7d5-ea54-4e1c-8bb0-d4845dfcba41 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:49.615910 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4aa7d5-ea54-4e1c-8bb0-d4845dfcba41 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:49.617989 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 245/481] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:49.623719 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66279f-f9aa-42fd-95a3-e93d32fd613c None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:49.624632 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66279f-f9aa-42fd-95a3-e93d32fd613c None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:49.625112 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66279f-f9aa-42fd-95a3-e93d32fd613c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:49.643481 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-4b66279f-f9aa-42fd-95a3-e93d32fd613c None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:49.645124 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-4b66279f-f9aa-42fd-95a3-e93d32fd613c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:49.717924 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 237/482] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:38:49.745870 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4aa7d5-ea54-4e1c-8bb0-d4845dfcba41 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:49.857457 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4aa7d5-ea54-4e1c-8bb0-d4845dfcba41 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:49.895709 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df163bfc-7a45-48c0-865f-e4d8c4cc1d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:49.896888 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df163bfc-7a45-48c0-865f-e4d8c4cc1d42 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:49.897367 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df163bfc-7a45-48c0-865f-e4d8c4cc1d42 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:49.897835 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df163bfc-7a45-48c0-865f-e4d8c4cc1d42 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:49.909619 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df163bfc-7a45-48c0-865f-e4d8c4cc1d42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:49.918131 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-df163bfc-7a45-48c0-865f-e4d8c4cc1d42 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 20:38:49.924115 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 246/483] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 20:38:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:49.926745 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66279f-f9aa-42fd-95a3-e93d32fd613c None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:50.040048 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66279f-f9aa-42fd-95a3-e93d32fd613c None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:50.080389 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f5eb1-e26b-4852-882c-3ff0c49fa016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:50.081516 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f5eb1-e26b-4852-882c-3ff0c49fa016 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:50.082050 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f5eb1-e26b-4852-882c-3ff0c49fa016 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:50.082533 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f5eb1-e26b-4852-882c-3ff0c49fa016 None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:50.083536 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f5eb1-e26b-4852-882c-3ff0c49fa016 None admin] RBAC: Adding query filter params (name=service) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:50.084107 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f5eb1-e26b-4852-882c-3ff0c49fa016 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:50.085758 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f5eb1-e26b-4852-882c-3ff0c49fa016 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:50.095446 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 238/484] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 20:38:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:50.104861 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df163bfc-7a45-48c0-865f-e4d8c4cc1d42 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:50.284154 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df163bfc-7a45-48c0-865f-e4d8c4cc1d42 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:50.335192 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb2d31-62a7-4249-afe9-77eee40ca3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:50.336101 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb2d31-62a7-4249-afe9-77eee40ca3c4 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:50.336380 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb2d31-62a7-4249-afe9-77eee40ca3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:50.336662 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb2d31-62a7-4249-afe9-77eee40ca3c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:50.357958 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb2d31-62a7-4249-afe9-77eee40ca3c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:50.359433 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb2d31-62a7-4249-afe9-77eee40ca3c4 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:50.383118 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-a6eb2d31-62a7-4249-afe9-77eee40ca3c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:38:50.384732 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 247/485] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:38:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:50.390289 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f5eb1-e26b-4852-882c-3ff0c49fa016 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:50.564127 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f5eb1-e26b-4852-882c-3ff0c49fa016 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:50.616750 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748e38c-18f0-4689-8dce-48fa31b44209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:50.617458 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748e38c-18f0-4689-8dce-48fa31b44209 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:50.617743 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748e38c-18f0-4689-8dce-48fa31b44209 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:50.618024 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748e38c-18f0-4689-8dce-48fa31b44209 None admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:50.618825 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748e38c-18f0-4689-8dce-48fa31b44209 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:50.619158 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748e38c-18f0-4689-8dce-48fa31b44209 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:50.620820 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748e38c-18f0-4689-8dce-48fa31b44209 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:50.636241 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 239/486] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:50.645595 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb2d31-62a7-4249-afe9-77eee40ca3c4 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:50.701899 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f25551-c184-44d6-bc28-4da520d57b53 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:50.702246 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f25551-c184-44d6-bc28-4da520d57b53 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:50.702478 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f25551-c184-44d6-bc28-4da520d57b53 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:50.704432 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 240/487] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:38:50.711595 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cdb81-7a42-4ab4-a352-38c74d174ea2 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:50.712247 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cdb81-7a42-4ab4-a352-38c74d174ea2 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:50.712748 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cdb81-7a42-4ab4-a352-38c74d174ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:50.735654 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-6d3cdb81-7a42-4ab4-a352-38c74d174ea2 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:50.737721 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-6d3cdb81-7a42-4ab4-a352-38c74d174ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:50.827935 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 241/488] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 20:38:50.865521 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb2d31-62a7-4249-afe9-77eee40ca3c4 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:50.879601 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3cdb81-7a42-4ab4-a352-38c74d174ea2 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:50.938696 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c2715-f96e-49e9-bd85-f0bb21a0e978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:50.939582 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c2715-f96e-49e9-bd85-f0bb21a0e978 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:50.939888 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c2715-f96e-49e9-bd85-f0bb21a0e978 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:50.940159 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c2715-f96e-49e9-bd85-f0bb21a0e978 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:50.962837 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c2715-f96e-49e9-bd85-f0bb21a0e978 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:50.964502 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c2715-f96e-49e9-bd85-f0bb21a0e978 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:50.988325 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-a65c2715-f96e-49e9-bd85-f0bb21a0e978 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 28 20:38:50.996484 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 248/489] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:38:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:51.001569 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c2715-f96e-49e9-bd85-f0bb21a0e978 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:51.003154 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3cdb81-7a42-4ab4-a352-38c74d174ea2 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:51.045571 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0fd6f-d315-471f-8203-0d36f7540bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:51.047290 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0fd6f-d315-471f-8203-0d36f7540bf0 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:51.047825 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0fd6f-d315-471f-8203-0d36f7540bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:51.048299 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0fd6f-d315-471f-8203-0d36f7540bf0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:51.062136 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0fd6f-d315-471f-8203-0d36f7540bf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:51.070913 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-e2c0fd6f-d315-471f-8203-0d36f7540bf0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 20:38:51.073419 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 242/490] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 20:38:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:38:51.083870 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0fd6f-d315-471f-8203-0d36f7540bf0 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:51.256232 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c2715-f96e-49e9-bd85-f0bb21a0e978 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:51.306891 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0fd6f-d315-471f-8203-0d36f7540bf0 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:51.321899 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa3c71-6eea-461b-b9a5-cf165bc9d8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:51.323332 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa3c71-6eea-461b-b9a5-cf165bc9d8d4 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:51.324171 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa3c71-6eea-461b-b9a5-cf165bc9d8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:51.324989 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa3c71-6eea-461b-b9a5-cf165bc9d8d4 None admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:51.326873 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa3c71-6eea-461b-b9a5-cf165bc9d8d4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:51.327734 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa3c71-6eea-461b-b9a5-cf165bc9d8d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:51.330812 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa3c71-6eea-461b-b9a5-cf165bc9d8d4 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:51.364057 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5702b53-5d8f-4a3a-9a1a-8a678d95734f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:51.365126 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5702b53-5d8f-4a3a-9a1a-8a678d95734f None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:51.365625 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5702b53-5d8f-4a3a-9a1a-8a678d95734f None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:51.366130 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5702b53-5d8f-4a3a-9a1a-8a678d95734f None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:51.367573 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5702b53-5d8f-4a3a-9a1a-8a678d95734f None admin] RBAC: Adding query filter params (name=service) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:51.368150 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5702b53-5d8f-4a3a-9a1a-8a678d95734f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:51.370401 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5702b53-5d8f-4a3a-9a1a-8a678d95734f None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:51.392135 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 243/491] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 20:38:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:51.396524 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6bf9d-87f1-4887-8fde-01b9e0e2771a None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:51.397036 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6bf9d-87f1-4887-8fde-01b9e0e2771a None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:51.397322 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6bf9d-87f1-4887-8fde-01b9e0e2771a None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:51.400689 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 244/492] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:51.404593 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6bf9d-87f1-4887-8fde-01b9e0e2771a None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:51.407366 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 249/493] 10.222.0.49 () {56 vars in 1137 bytes} [Fri Oct 28 20:38:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:51.411026 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b6d41-8398-4670-9f1b-6fc76ac3ae43 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:51.411783 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b6d41-8398-4670-9f1b-6fc76ac3ae43 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:51.412420 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b6d41-8398-4670-9f1b-6fc76ac3ae43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:51.441670 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-8b6b6d41-8398-4670-9f1b-6fc76ac3ae43 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:51.443765 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-8b6b6d41-8398-4670-9f1b-6fc76ac3ae43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:51.545336 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 250/494] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:38:51.547283 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b6d41-8398-4670-9f1b-6fc76ac3ae43 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:51.582362 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6bf9d-87f1-4887-8fde-01b9e0e2771a None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:51.627853 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7efda-a38f-47d8-93de-3661a1fd73ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:51.628740 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7efda-a38f-47d8-93de-3661a1fd73ee None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:51.629018 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7efda-a38f-47d8-93de-3661a1fd73ee None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:51.629291 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7efda-a38f-47d8-93de-3661a1fd73ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:51.641368 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7efda-a38f-47d8-93de-3661a1fd73ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:51.642880 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7efda-a38f-47d8-93de-3661a1fd73ee None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:51.664307 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-c7b7efda-a38f-47d8-93de-3661a1fd73ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:38:51.670413 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 245/495] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:38:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:51.670413 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8b3f2-2136-4a2c-8161-47552d6b4791 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:51.670413 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8b3f2-2136-4a2c-8161-47552d6b4791 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:51.670413 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8b3f2-2136-4a2c-8161-47552d6b4791 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:51.670413 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 246/496] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:51.670413 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8b3f2-2136-4a2c-8161-47552d6b4791 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:51.688283 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b6d41-8398-4670-9f1b-6fc76ac3ae43 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:51.728859 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f02e5-30cb-423f-82b8-9578329995f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:51.729528 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f02e5-30cb-423f-82b8-9578329995f7 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:51.729804 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f02e5-30cb-423f-82b8-9578329995f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:51.730074 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f02e5-30cb-423f-82b8-9578329995f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:51.802553 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8b3f2-2136-4a2c-8161-47552d6b4791 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:51.842955 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37fc4e-08ba-4ada-bd89-197a75cee8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:51.843712 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f02e5-30cb-423f-82b8-9578329995f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:51.844083 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37fc4e-08ba-4ada-bd89-197a75cee8cb None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:51.844488 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37fc4e-08ba-4ada-bd89-197a75cee8cb None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:51.844884 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37fc4e-08ba-4ada-bd89-197a75cee8cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:51.846694 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f02e5-30cb-423f-82b8-9578329995f7 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:51.858541 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37fc4e-08ba-4ada-bd89-197a75cee8cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:51.866815 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-fd37fc4e-08ba-4ada-bd89-197a75cee8cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 20:38:51.868391 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 247/497] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 20:38:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:51.869186 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37fc4e-08ba-4ada-bd89-197a75cee8cb None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:51.982863 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37fc4e-08ba-4ada-bd89-197a75cee8cb None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:51.995407 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 251/498] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:38:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 20:38:51.996792 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3113ad-939e-4796-b79a-350d553540a1 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:51.997071 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3113ad-939e-4796-b79a-350d553540a1 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:51.997344 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3113ad-939e-4796-b79a-350d553540a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:52.017288 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-2c3113ad-939e-4796-b79a-350d553540a1 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:52.018488 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-2c3113ad-939e-4796-b79a-350d553540a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:52.022724 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7eacd-d913-4098-b451-c534d52ebe36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:52.023410 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7eacd-d913-4098-b451-c534d52ebe36 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:52.023683 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7eacd-d913-4098-b451-c534d52ebe36 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:52.024004 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7eacd-d913-4098-b451-c534d52ebe36 None admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:52.024738 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7eacd-d913-4098-b451-c534d52ebe36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:52.025042 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7eacd-d913-4098-b451-c534d52ebe36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:52.026438 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7eacd-d913-4098-b451-c534d52ebe36 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:52.042138 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 248/499] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:52.043507 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7eacd-d913-4098-b451-c534d52ebe36 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:52.106032 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 252/500] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:38:52.108018 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce41d9-1343-4f3d-9688-f0da8b1d725c None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:52.108476 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce41d9-1343-4f3d-9688-f0da8b1d725c None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:52.108910 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce41d9-1343-4f3d-9688-f0da8b1d725c None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:52.111962 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 253/501] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:52.115686 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce41d9-1343-4f3d-9688-f0da8b1d725c None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:52.174851 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7eacd-d913-4098-b451-c534d52ebe36 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:52.211467 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64221a1-8eaa-43ce-8a42-79cce9252504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:52.212166 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64221a1-8eaa-43ce-8a42-79cce9252504 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:52.212445 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64221a1-8eaa-43ce-8a42-79cce9252504 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:52.212717 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64221a1-8eaa-43ce-8a42-79cce9252504 None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:52.213459 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64221a1-8eaa-43ce-8a42-79cce9252504 None admin] RBAC: Adding query filter params (name=service) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:52.213760 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64221a1-8eaa-43ce-8a42-79cce9252504 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:52.215158 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64221a1-8eaa-43ce-8a42-79cce9252504 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:52.229426 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 249/502] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 20:38:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:52.230916 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64221a1-8eaa-43ce-8a42-79cce9252504 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:52.243000 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce41d9-1343-4f3d-9688-f0da8b1d725c None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:52.280207 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715acb58-dc86-46e6-933d-3da00340f51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:52.281183 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715acb58-dc86-46e6-933d-3da00340f51c None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:52.281589 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715acb58-dc86-46e6-933d-3da00340f51c None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:52.281969 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715acb58-dc86-46e6-933d-3da00340f51c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:52.294126 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715acb58-dc86-46e6-933d-3da00340f51c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:52.295640 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715acb58-dc86-46e6-933d-3da00340f51c None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:52.313636 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-715acb58-dc86-46e6-933d-3da00340f51c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:38:52.314855 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 254/503] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:38:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:52.317028 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33df0b-800d-4b3c-a4b6-49c165c68cb2 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:52.317350 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33df0b-800d-4b3c-a4b6-49c165c68cb2 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:52.317660 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33df0b-800d-4b3c-a4b6-49c165c68cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:52.335807 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-3d33df0b-800d-4b3c-a4b6-49c165c68cb2 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:52.337006 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-3d33df0b-800d-4b3c-a4b6-49c165c68cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:52.370900 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64221a1-8eaa-43ce-8a42-79cce9252504 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:52.404789 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6fe31-6776-44ae-bf0b-a41c9a1b1ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:52.405583 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6fe31-6776-44ae-bf0b-a41c9a1b1ee9 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:52.405870 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6fe31-6776-44ae-bf0b-a41c9a1b1ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:52.406155 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6fe31-6776-44ae-bf0b-a41c9a1b1ee9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:52.416372 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6fe31-6776-44ae-bf0b-a41c9a1b1ee9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:52.417842 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6fe31-6776-44ae-bf0b-a41c9a1b1ee9 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:52.431708 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-8bb6fe31-6776-44ae-bf0b-a41c9a1b1ee9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 20:38:52.432968 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 250/504] 10.222.0.49 () {56 vars in 1093 bytes} [Fri Oct 28 20:38:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:52.433831 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6fe31-6776-44ae-bf0b-a41c9a1b1ee9 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:52.441807 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 255/505] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:38:52.441807 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33df0b-800d-4b3c-a4b6-49c165c68cb2 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:52.551319 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33df0b-800d-4b3c-a4b6-49c165c68cb2 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:52.555582 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6fe31-6776-44ae-bf0b-a41c9a1b1ee9 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:52.589708 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a60189-259d-47dc-bc97-5d1faabb3fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:52.590524 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a60189-259d-47dc-bc97-5d1faabb3fbe None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:52.590791 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a60189-259d-47dc-bc97-5d1faabb3fbe None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:52.591057 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a60189-259d-47dc-bc97-5d1faabb3fbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:52.592778 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc61284-eb27-4e4e-b946-7c87591e18f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:52.593588 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc61284-eb27-4e4e-b946-7c87591e18f9 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:52.593870 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc61284-eb27-4e4e-b946-7c87591e18f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:52.594148 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc61284-eb27-4e4e-b946-7c87591e18f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:52.603507 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a60189-259d-47dc-bc97-5d1faabb3fbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:52.605114 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a60189-259d-47dc-bc97-5d1faabb3fbe None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:52.606957 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc61284-eb27-4e4e-b946-7c87591e18f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:52.615728 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-6cc61284-eb27-4e4e-b946-7c87591e18f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 20:38:52.617031 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 251/506] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 20:38:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:52.617957 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc61284-eb27-4e4e-b946-7c87591e18f9 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:52.626169 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-36a60189-259d-47dc-bc97-5d1faabb3fbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:38:52.627432 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 256/507] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:38:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:52.628382 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a60189-259d-47dc-bc97-5d1faabb3fbe None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:52.726562 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc61284-eb27-4e4e-b946-7c87591e18f9 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:52.739866 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a60189-259d-47dc-bc97-5d1faabb3fbe None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:52.761451 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9ac8f-70af-4937-90e5-4b767330b6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:52.762120 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9ac8f-70af-4937-90e5-4b767330b6a5 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:52.762394 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9ac8f-70af-4937-90e5-4b767330b6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:52.762662 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9ac8f-70af-4937-90e5-4b767330b6a5 None admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:52.763380 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9ac8f-70af-4937-90e5-4b767330b6a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:52.763680 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9ac8f-70af-4937-90e5-4b767330b6a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:52.765100 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9ac8f-70af-4937-90e5-4b767330b6a5 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:52.776784 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92599d66-a9b3-41f6-93d5-fee4fb8e0eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:52.777487 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92599d66-a9b3-41f6-93d5-fee4fb8e0eca None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:52.777768 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92599d66-a9b3-41f6-93d5-fee4fb8e0eca None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:52.778058 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92599d66-a9b3-41f6-93d5-fee4fb8e0eca None admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:52.778914 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92599d66-a9b3-41f6-93d5-fee4fb8e0eca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:52.779224 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92599d66-a9b3-41f6-93d5-fee4fb8e0eca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:52.780058 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 252/508] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:52.780746 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92599d66-a9b3-41f6-93d5-fee4fb8e0eca None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:52.781282 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9ac8f-70af-4937-90e5-4b767330b6a5 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:52.801099 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 257/509] 10.222.0.49 () {56 vars in 1133 bytes} [Fri Oct 28 20:38:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:52.802044 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92599d66-a9b3-41f6-93d5-fee4fb8e0eca None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:52.919614 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9ac8f-70af-4937-90e5-4b767330b6a5 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:52.933105 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92599d66-a9b3-41f6-93d5-fee4fb8e0eca None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:52.954501 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78b775-f6d2-438b-b7c8-2828791b2e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:52.955298 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78b775-f6d2-438b-b7c8-2828791b2e1e None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:52.955573 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78b775-f6d2-438b-b7c8-2828791b2e1e None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:52.955868 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78b775-f6d2-438b-b7c8-2828791b2e1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:52.967156 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78b775-f6d2-438b-b7c8-2828791b2e1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:52.968625 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138a865-c562-4de1-8cf8-61c147cc41d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:52.968852 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78b775-f6d2-438b-b7c8-2828791b2e1e None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:52.969309 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138a865-c562-4de1-8cf8-61c147cc41d2 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:52.969579 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138a865-c562-4de1-8cf8-61c147cc41d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:52.969853 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138a865-c562-4de1-8cf8-61c147cc41d2 None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:52.970596 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138a865-c562-4de1-8cf8-61c147cc41d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:52.970897 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138a865-c562-4de1-8cf8-61c147cc41d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:52.972904 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138a865-c562-4de1-8cf8-61c147cc41d2 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:52.981482 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 258/510] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 20:38:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:52.982345 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138a865-c562-4de1-8cf8-61c147cc41d2 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:52.988465 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-af78b775-f6d2-438b-b7c8-2828791b2e1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:38:52.989716 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 253/511] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:38:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:52.990509 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78b775-f6d2-438b-b7c8-2828791b2e1e None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:53.117340 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138a865-c562-4de1-8cf8-61c147cc41d2 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:53.123886 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78b775-f6d2-438b-b7c8-2828791b2e1e None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:53.154215 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46501e17-8cea-4f9f-a2cf-99503c4b2e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:53.154901 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46501e17-8cea-4f9f-a2cf-99503c4b2e32 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:53.155175 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46501e17-8cea-4f9f-a2cf-99503c4b2e32 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:53.155439 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46501e17-8cea-4f9f-a2cf-99503c4b2e32 None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:53.156223 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46501e17-8cea-4f9f-a2cf-99503c4b2e32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:53.156523 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46501e17-8cea-4f9f-a2cf-99503c4b2e32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:53.157968 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46501e17-8cea-4f9f-a2cf-99503c4b2e32 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:53.162391 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13729788-0b31-4091-b385-931515913961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:53.163279 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13729788-0b31-4091-b385-931515913961 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:53.163563 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13729788-0b31-4091-b385-931515913961 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:53.163870 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13729788-0b31-4091-b385-931515913961 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:53.171383 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13729788-0b31-4091-b385-931515913961 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:53.171642 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 259/512] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:53.172598 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46501e17-8cea-4f9f-a2cf-99503c4b2e32 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:53.172966 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13729788-0b31-4091-b385-931515913961 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:53.192300 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-13729788-0b31-4091-b385-931515913961 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 20:38:53.193593 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 254/513] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:38:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:53.194426 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13729788-0b31-4091-b385-931515913961 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:53.291074 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46501e17-8cea-4f9f-a2cf-99503c4b2e32 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:53.329665 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13729788-0b31-4091-b385-931515913961 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:53.333142 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3248678-d9e1-4879-8b2d-1434e452eac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:53.334050 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3248678-d9e1-4879-8b2d-1434e452eac0 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:53.334374 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3248678-d9e1-4879-8b2d-1434e452eac0 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:53.334718 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3248678-d9e1-4879-8b2d-1434e452eac0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:53.381526 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e05c7-a5cd-4815-bd9d-943819976435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:53.382689 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e05c7-a5cd-4815-bd9d-943819976435 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:53.383137 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e05c7-a5cd-4815-bd9d-943819976435 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:53.383586 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e05c7-a5cd-4815-bd9d-943819976435 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:53.399895 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e05c7-a5cd-4815-bd9d-943819976435 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:53.401436 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e05c7-a5cd-4815-bd9d-943819976435 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:53.419701 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-964e05c7-a5cd-4815-bd9d-943819976435 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:38:53.420959 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 255/514] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:38:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:53.421754 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e05c7-a5cd-4815-bd9d-943819976435 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:53.427296 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3248678-d9e1-4879-8b2d-1434e452eac0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:53.428307 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3248678-d9e1-4879-8b2d-1434e452eac0 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:53.557553 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e05c7-a5cd-4815-bd9d-943819976435 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:53.561021 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 260/515] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:38:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 20:38:53.561885 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3248678-d9e1-4879-8b2d-1434e452eac0 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:53.608090 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e79ab-c77c-4095-8f59-d3a97a2a6411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:53.608837 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e79ab-c77c-4095-8f59-d3a97a2a6411 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:53.609158 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e79ab-c77c-4095-8f59-d3a97a2a6411 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:53.609477 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e79ab-c77c-4095-8f59-d3a97a2a6411 None admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:53.610266 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e79ab-c77c-4095-8f59-d3a97a2a6411 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:53.610624 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e79ab-c77c-4095-8f59-d3a97a2a6411 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:53.612137 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e79ab-c77c-4095-8f59-d3a97a2a6411 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:53.626168 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 256/516] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:38:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:53.627021 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e79ab-c77c-4095-8f59-d3a97a2a6411 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:53.691650 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3248678-d9e1-4879-8b2d-1434e452eac0 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:53.742037 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80856e6a-c4e3-4869-b11b-76cea93b47fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:53.743267 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80856e6a-c4e3-4869-b11b-76cea93b47fb None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:53.743704 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80856e6a-c4e3-4869-b11b-76cea93b47fb None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:53.744179 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80856e6a-c4e3-4869-b11b-76cea93b47fb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:53.756563 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80856e6a-c4e3-4869-b11b-76cea93b47fb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:53.758631 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80856e6a-c4e3-4869-b11b-76cea93b47fb None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:53.768866 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e79ab-c77c-4095-8f59-d3a97a2a6411 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:53.782643 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-80856e6a-c4e3-4869-b11b-76cea93b47fb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 20:38:53.784011 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 261/517] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:38:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:53.786266 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80856e6a-c4e3-4869-b11b-76cea93b47fb None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:53.820744 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab94711-7d15-4a63-a3dc-fce593d9553f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:53.821781 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab94711-7d15-4a63-a3dc-fce593d9553f None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:53.822259 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab94711-7d15-4a63-a3dc-fce593d9553f None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:53.822583 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab94711-7d15-4a63-a3dc-fce593d9553f None admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:53.823987 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab94711-7d15-4a63-a3dc-fce593d9553f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:53.824482 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab94711-7d15-4a63-a3dc-fce593d9553f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:53.826923 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab94711-7d15-4a63-a3dc-fce593d9553f None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:53.849479 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 257/518] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 20:38:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:53.850352 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab94711-7d15-4a63-a3dc-fce593d9553f None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:53.926714 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80856e6a-c4e3-4869-b11b-76cea93b47fb None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:53.975285 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd2d0d-f5dc-411b-8b14-7ed2f3069ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:53.976524 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd2d0d-f5dc-411b-8b14-7ed2f3069ed8 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:53.977011 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd2d0d-f5dc-411b-8b14-7ed2f3069ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:53.977484 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd2d0d-f5dc-411b-8b14-7ed2f3069ed8 None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:53.978396 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd2d0d-f5dc-411b-8b14-7ed2f3069ed8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:53.978928 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd2d0d-f5dc-411b-8b14-7ed2f3069ed8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:53.980413 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd2d0d-f5dc-411b-8b14-7ed2f3069ed8 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:53.980932 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab94711-7d15-4a63-a3dc-fce593d9553f None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:53.995088 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 262/519] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:38:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:53.996593 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd2d0d-f5dc-411b-8b14-7ed2f3069ed8 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:54.025576 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4b8b7-1fd8-4f8c-b6b2-4ef1621a518d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:54.026392 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4b8b7-1fd8-4f8c-b6b2-4ef1621a518d None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:54.026677 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4b8b7-1fd8-4f8c-b6b2-4ef1621a518d None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:54.026950 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4b8b7-1fd8-4f8c-b6b2-4ef1621a518d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:54.039568 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4b8b7-1fd8-4f8c-b6b2-4ef1621a518d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:54.041181 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4b8b7-1fd8-4f8c-b6b2-4ef1621a518d None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:54.062038 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-e9b4b8b7-1fd8-4f8c-b6b2-4ef1621a518d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:38:54.063307 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 258/520] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:38:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:54.064160 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4b8b7-1fd8-4f8c-b6b2-4ef1621a518d None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:54.123759 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd2d0d-f5dc-411b-8b14-7ed2f3069ed8 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:54.158130 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc8739-9b2e-42ca-bf83-881e0af15c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:54.158813 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc8739-9b2e-42ca-bf83-881e0af15c11 None admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:54.159085 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc8739-9b2e-42ca-bf83-881e0af15c11 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:54.159356 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc8739-9b2e-42ca-bf83-881e0af15c11 None admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:54.160609 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc8739-9b2e-42ca-bf83-881e0af15c11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:54.162333 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc8739-9b2e-42ca-bf83-881e0af15c11 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:54.183534 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 263/521] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Oct 28 20:38:53 2022] POST /identity/v3/users => generated 247 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:38:54.184409 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc8739-9b2e-42ca-bf83-881e0af15c11 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:54.216205 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4b8b7-1fd8-4f8c-b6b2-4ef1621a518d None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:54.281770 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278eff2-3c8f-4c5c-b17f-6b5f57298528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:54.282769 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278eff2-3c8f-4c5c-b17f-6b5f57298528 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:54.283257 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278eff2-3c8f-4c5c-b17f-6b5f57298528 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:54.283785 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278eff2-3c8f-4c5c-b17f-6b5f57298528 None admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:54.287110 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278eff2-3c8f-4c5c-b17f-6b5f57298528 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:54.287570 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278eff2-3c8f-4c5c-b17f-6b5f57298528 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:54.290498 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278eff2-3c8f-4c5c-b17f-6b5f57298528 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:54.338978 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc8739-9b2e-42ca-bf83-881e0af15c11 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:54.365317 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 259/522] 10.222.0.49 () {56 vars in 1137 bytes} [Fri Oct 28 20:38:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:54.366850 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278eff2-3c8f-4c5c-b17f-6b5f57298528 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:54.391564 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eca278-9c71-4671-b9a4-a0b334b4c296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:54.392719 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eca278-9c71-4671-b9a4-a0b334b4c296 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:54.393134 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eca278-9c71-4671-b9a4-a0b334b4c296 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:54.393534 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eca278-9c71-4671-b9a4-a0b334b4c296 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:54.396218 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eca278-9c71-4671-b9a4-a0b334b4c296 None admin] RBAC: Adding query filter params (role.id=7190d40a528146289333f0b9c16a6370, scope.project.id=c55c2ee59af14cf8a7e4275de4f43037, user.id=05029a41bd2b42febfd5ce91a3f28c24) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:54.396625 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eca278-9c71-4671-b9a4-a0b334b4c296 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:54.398877 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eca278-9c71-4671-b9a4-a0b334b4c296 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:54.407100 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 264/523] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:38:54 2022] GET /identity/v3/role_assignments?user.id=05029a41bd2b42febfd5ce91a3f28c24&scope.project.id=c55c2ee59af14cf8a7e4275de4f43037&role.id=7190d40a528146289333f0b9c16a6370 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:54.408030 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eca278-9c71-4671-b9a4-a0b334b4c296 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:54.559932 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278eff2-3c8f-4c5c-b17f-6b5f57298528 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:54.608702 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eca278-9c71-4671-b9a4-a0b334b4c296 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:54.627807 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373aa83-a31b-42c0-8dbc-7c98a100f352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:54.627807 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373aa83-a31b-42c0-8dbc-7c98a100f352 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:54.627807 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373aa83-a31b-42c0-8dbc-7c98a100f352 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:54.627807 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373aa83-a31b-42c0-8dbc-7c98a100f352 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:54.635345 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373aa83-a31b-42c0-8dbc-7c98a100f352 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:54.636941 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373aa83-a31b-42c0-8dbc-7c98a100f352 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:54.653299 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-e373aa83-a31b-42c0-8dbc-7c98a100f352 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 20:38:54.654863 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 260/524] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 20:38:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:54.655665 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373aa83-a31b-42c0-8dbc-7c98a100f352 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:54.676941 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301c155-cd6f-4780-a2f0-81c24950f0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:54.677709 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301c155-cd6f-4780-a2f0-81c24950f0eb None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:54.678230 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301c155-cd6f-4780-a2f0-81c24950f0eb None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:54.678705 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301c155-cd6f-4780-a2f0-81c24950f0eb None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:54.680113 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301c155-cd6f-4780-a2f0-81c24950f0eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:54.680670 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301c155-cd6f-4780-a2f0-81c24950f0eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:54.683422 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301c155-cd6f-4780-a2f0-81c24950f0eb None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:54.715815 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 265/525] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:54.717465 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301c155-cd6f-4780-a2f0-81c24950f0eb None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:54.766273 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373aa83-a31b-42c0-8dbc-7c98a100f352 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:54.804430 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4663c5-42c8-4d1b-b83b-eef15509ce9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:54.805572 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4663c5-42c8-4d1b-b83b-eef15509ce9b None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:54.805572 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4663c5-42c8-4d1b-b83b-eef15509ce9b None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:54.805572 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4663c5-42c8-4d1b-b83b-eef15509ce9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:54.879685 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4663c5-42c8-4d1b-b83b-eef15509ce9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:54.880987 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4663c5-42c8-4d1b-b83b-eef15509ce9b None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:54.906403 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301c155-cd6f-4780-a2f0-81c24950f0eb None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:54.974305 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd00fa9-9078-4636-b5ff-54febf63e822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:54.975464 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd00fa9-9078-4636-b5ff-54febf63e822 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:54.976004 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd00fa9-9078-4636-b5ff-54febf63e822 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:54.976508 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd00fa9-9078-4636-b5ff-54febf63e822 None admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:54.978281 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd00fa9-9078-4636-b5ff-54febf63e822 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:54.978944 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd00fa9-9078-4636-b5ff-54febf63e822 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:54.981976 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd00fa9-9078-4636-b5ff-54febf63e822 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:55.000736 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 261/526] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:38:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 20:38:55.002196 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4663c5-42c8-4d1b-b83b-eef15509ce9b None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:55.017955 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 266/527] 10.222.0.49 () {56 vars in 1139 bytes} [Fri Oct 28 20:38:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:55.020754 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd00fa9-9078-4636-b5ff-54febf63e822 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:55.200163 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4663c5-42c8-4d1b-b83b-eef15509ce9b None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:55.202810 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd00fa9-9078-4636-b5ff-54febf63e822 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:55.264834 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3201b92-b349-477b-9f74-5d4f54ce41ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:55.266257 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba68de5-b387-4d16-86a8-bce219226422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:55.266456 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3201b92-b349-477b-9f74-5d4f54ce41ee None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:55.266783 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3201b92-b349-477b-9f74-5d4f54ce41ee None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:55.267269 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3201b92-b349-477b-9f74-5d4f54ce41ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:55.267633 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba68de5-b387-4d16-86a8-bce219226422 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:55.271772 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba68de5-b387-4d16-86a8-bce219226422 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:55.271772 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba68de5-b387-4d16-86a8-bce219226422 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:55.283799 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3201b92-b349-477b-9f74-5d4f54ce41ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:55.284169 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3201b92-b349-477b-9f74-5d4f54ce41ee None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:55.289330 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba68de5-b387-4d16-86a8-bce219226422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:55.292158 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba68de5-b387-4d16-86a8-bce219226422 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:55.311812 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-a3201b92-b349-477b-9f74-5d4f54ce41ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 20:38:55.314446 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 262/528] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:38:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:55.316502 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3201b92-b349-477b-9f74-5d4f54ce41ee None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:55.336921 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-6ba68de5-b387-4d16-86a8-bce219226422 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:38:55.339536 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 267/529] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:38:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:55.341113 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba68de5-b387-4d16-86a8-bce219226422 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:55.512718 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba68de5-b387-4d16-86a8-bce219226422 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:55.522413 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3201b92-b349-477b-9f74-5d4f54ce41ee None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:55.556076 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cd92b-9fef-4401-89c8-bb9610ffa939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:55.557166 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cd92b-9fef-4401-89c8-bb9610ffa939 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:55.557680 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cd92b-9fef-4401-89c8-bb9610ffa939 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:55.558227 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cd92b-9fef-4401-89c8-bb9610ffa939 None admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:55.559296 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18cd92b-9fef-4401-89c8-bb9610ffa939 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:55.559903 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18cd92b-9fef-4401-89c8-bb9610ffa939 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:55.561621 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18cd92b-9fef-4401-89c8-bb9610ffa939 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:55.585077 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 268/530] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 20:38:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:55.586299 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cd92b-9fef-4401-89c8-bb9610ffa939 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:55.591811 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed8fc0-5745-4542-a10e-a7a837339d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:55.593007 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed8fc0-5745-4542-a10e-a7a837339d69 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:55.593495 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed8fc0-5745-4542-a10e-a7a837339d69 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:55.593956 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed8fc0-5745-4542-a10e-a7a837339d69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:55.721314 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed8fc0-5745-4542-a10e-a7a837339d69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:55.724019 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed8fc0-5745-4542-a10e-a7a837339d69 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:55.726044 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cd92b-9fef-4401-89c8-bb9610ffa939 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:55.786771 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18270a5c-669e-40ab-b015-acb461fe97d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:55.787729 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18270a5c-669e-40ab-b015-acb461fe97d2 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:55.788184 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18270a5c-669e-40ab-b015-acb461fe97d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:55.788617 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18270a5c-669e-40ab-b015-acb461fe97d2 None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:55.789842 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18270a5c-669e-40ab-b015-acb461fe97d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:55.790326 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18270a5c-669e-40ab-b015-acb461fe97d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:55.792764 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18270a5c-669e-40ab-b015-acb461fe97d2 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:55.819909 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 269/531] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:55.821419 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18270a5c-669e-40ab-b015-acb461fe97d2 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:55.901756 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 263/532] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:38:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 20:38:55.903048 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed8fc0-5745-4542-a10e-a7a837339d69 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:56.018899 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18270a5c-669e-40ab-b015-acb461fe97d2 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:56.063717 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed8fc0-5745-4542-a10e-a7a837339d69 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:56.089375 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bccfec-3d92-4696-b1d1-117d501e5019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:56.090413 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bccfec-3d92-4696-b1d1-117d501e5019 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:56.090853 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bccfec-3d92-4696-b1d1-117d501e5019 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:56.091301 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bccfec-3d92-4696-b1d1-117d501e5019 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:56.092795 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bccfec-3d92-4696-b1d1-117d501e5019 None admin] RBAC: Adding query filter params (role.id=7190d40a528146289333f0b9c16a6370, scope.project.id=c55c2ee59af14cf8a7e4275de4f43037, user.id=04bc6ee009e34a5f82e2807db51523d3) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:56.093298 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bccfec-3d92-4696-b1d1-117d501e5019 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:56.095870 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bccfec-3d92-4696-b1d1-117d501e5019 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:56.106715 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 270/533] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:38:55 2022] GET /identity/v3/role_assignments?user.id=04bc6ee009e34a5f82e2807db51523d3&scope.project.id=c55c2ee59af14cf8a7e4275de4f43037&role.id=7190d40a528146289333f0b9c16a6370 => generated 259 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:56.108264 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bccfec-3d92-4696-b1d1-117d501e5019 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:56.126048 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bb4e4-f56d-4010-8920-1671acbaa6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:56.127320 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bb4e4-f56d-4010-8920-1671acbaa6a0 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:56.127796 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bb4e4-f56d-4010-8920-1671acbaa6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:56.128292 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bb4e4-f56d-4010-8920-1671acbaa6a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:56.140861 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516bb4e4-f56d-4010-8920-1671acbaa6a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:56.143513 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516bb4e4-f56d-4010-8920-1671acbaa6a0 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:56.168718 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-516bb4e4-f56d-4010-8920-1671acbaa6a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 20:38:56.170915 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 264/534] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:38:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:56.182658 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bb4e4-f56d-4010-8920-1671acbaa6a0 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:56.292241 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bccfec-3d92-4696-b1d1-117d501e5019 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:56.372970 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749b03f-cb9c-4447-99c9-8670fa782c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:56.375170 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749b03f-cb9c-4447-99c9-8670fa782c27 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:56.375676 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749b03f-cb9c-4447-99c9-8670fa782c27 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:56.376193 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749b03f-cb9c-4447-99c9-8670fa782c27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:56.401839 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749b03f-cb9c-4447-99c9-8670fa782c27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:56.405188 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749b03f-cb9c-4447-99c9-8670fa782c27 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:56.445207 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-7749b03f-cb9c-4447-99c9-8670fa782c27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:38:56.448549 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 271/535] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:38:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:56.458617 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749b03f-cb9c-4447-99c9-8670fa782c27 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:56.460888 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bb4e4-f56d-4010-8920-1671acbaa6a0 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:56.548014 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b3906-d7a7-4e80-a060-67fb2d725022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:56.549155 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b3906-d7a7-4e80-a060-67fb2d725022 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:56.549641 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b3906-d7a7-4e80-a060-67fb2d725022 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:56.550136 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b3906-d7a7-4e80-a060-67fb2d725022 None admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:56.551593 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b3906-d7a7-4e80-a060-67fb2d725022 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:56.552157 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b3906-d7a7-4e80-a060-67fb2d725022 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:56.553843 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b3906-d7a7-4e80-a060-67fb2d725022 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:56.596203 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 265/536] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 20:38:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:56.605879 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b3906-d7a7-4e80-a060-67fb2d725022 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:56.633105 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749b03f-cb9c-4447-99c9-8670fa782c27 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:56.686076 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2748cd2-0aea-4de0-9a13-2862e6b8ea76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:56.687133 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2748cd2-0aea-4de0-9a13-2862e6b8ea76 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:56.687667 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2748cd2-0aea-4de0-9a13-2862e6b8ea76 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:56.688173 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2748cd2-0aea-4de0-9a13-2862e6b8ea76 None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:56.689095 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2748cd2-0aea-4de0-9a13-2862e6b8ea76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:56.689593 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2748cd2-0aea-4de0-9a13-2862e6b8ea76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:56.691953 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2748cd2-0aea-4de0-9a13-2862e6b8ea76 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:56.728789 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 272/537] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:38:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:56.737323 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2748cd2-0aea-4de0-9a13-2862e6b8ea76 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:56.804064 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b3906-d7a7-4e80-a060-67fb2d725022 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:56.860967 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf584a2f-f895-4d24-b3fb-ebb60510735e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:56.861773 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf584a2f-f895-4d24-b3fb-ebb60510735e None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:56.862204 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf584a2f-f895-4d24-b3fb-ebb60510735e None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:56.863212 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf584a2f-f895-4d24-b3fb-ebb60510735e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:56.865358 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf584a2f-f895-4d24-b3fb-ebb60510735e None admin] RBAC: Adding query filter params (role.id=7190d40a528146289333f0b9c16a6370, scope.project.id=c55c2ee59af14cf8a7e4275de4f43037, user.id=f305aece531c412b9e0ac30be9f47667) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:56.865902 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf584a2f-f895-4d24-b3fb-ebb60510735e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:56.867586 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf584a2f-f895-4d24-b3fb-ebb60510735e None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:56.892970 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 266/538] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:38:56 2022] GET /identity/v3/role_assignments?user.id=f305aece531c412b9e0ac30be9f47667&scope.project.id=c55c2ee59af14cf8a7e4275de4f43037&role.id=7190d40a528146289333f0b9c16a6370 => generated 259 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:57.028954 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2748cd2-0aea-4de0-9a13-2862e6b8ea76 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:57.079515 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab06bdc-8daf-4f57-a7a4-87e6912eac56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:57.080750 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab06bdc-8daf-4f57-a7a4-87e6912eac56 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:57.081190 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab06bdc-8daf-4f57-a7a4-87e6912eac56 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:57.082152 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab06bdc-8daf-4f57-a7a4-87e6912eac56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:57.094998 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab06bdc-8daf-4f57-a7a4-87e6912eac56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:57.096797 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab06bdc-8daf-4f57-a7a4-87e6912eac56 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:57.119132 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-cab06bdc-8daf-4f57-a7a4-87e6912eac56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 20:38:57.125067 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 273/539] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:38:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:38:57.134387 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf584a2f-f895-4d24-b3fb-ebb60510735e None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:57.271927 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf584a2f-f895-4d24-b3fb-ebb60510735e None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:57.329403 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49602e-4953-4bcf-beb2-5cdf6355f374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:57.330640 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49602e-4953-4bcf-beb2-5cdf6355f374 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:57.331127 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49602e-4953-4bcf-beb2-5cdf6355f374 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:57.332211 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49602e-4953-4bcf-beb2-5cdf6355f374 None admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:57.333736 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f49602e-4953-4bcf-beb2-5cdf6355f374 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:57.334257 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f49602e-4953-4bcf-beb2-5cdf6355f374 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:57.336647 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f49602e-4953-4bcf-beb2-5cdf6355f374 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:57.359502 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 267/540] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 20:38:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:57.370195 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab06bdc-8daf-4f57-a7a4-87e6912eac56 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:57.607964 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab06bdc-8daf-4f57-a7a4-87e6912eac56 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:57.653050 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf35aa1-c54a-4743-a907-8f0842a3302f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:57.653721 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf35aa1-c54a-4743-a907-8f0842a3302f None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:57.653996 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf35aa1-c54a-4743-a907-8f0842a3302f None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:57.654265 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf35aa1-c54a-4743-a907-8f0842a3302f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:57.655104 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf35aa1-c54a-4743-a907-8f0842a3302f None admin] RBAC: Adding query filter params (role.id=7190d40a528146289333f0b9c16a6370, scope.project.id=c55c2ee59af14cf8a7e4275de4f43037, user.id=691a2da563a84da48ca8fd75a0bfe787) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:57.655411 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf35aa1-c54a-4743-a907-8f0842a3302f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:57.656909 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf35aa1-c54a-4743-a907-8f0842a3302f None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:57.668714 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 274/541] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:38:57 2022] GET /identity/v3/role_assignments?user.id=691a2da563a84da48ca8fd75a0bfe787&scope.project.id=c55c2ee59af14cf8a7e4275de4f43037&role.id=7190d40a528146289333f0b9c16a6370 => generated 259 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:57.745886 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208d771-cf53-4952-b634-0f9e8c538d36 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:57.746216 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208d771-cf53-4952-b634-0f9e8c538d36 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:57.746446 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208d771-cf53-4952-b634-0f9e8c538d36 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:57.748384 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 268/542] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:57.754892 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb13cf-955d-4fb7-a2c5-b0f3e8c1811d None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:57.755245 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb13cf-955d-4fb7-a2c5-b0f3e8c1811d None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:57.755436 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb13cf-955d-4fb7-a2c5-b0f3e8c1811d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:57.781002 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-a4bb13cf-955d-4fb7-a2c5-b0f3e8c1811d None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:57.782281 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-a4bb13cf-955d-4fb7-a2c5-b0f3e8c1811d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:57.884350 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 275/543] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:38:57.939305 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208d771-cf53-4952-b634-0f9e8c538d36 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:58.068715 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9a395-55c4-4106-8c1d-446cc18859b6 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:58.069264 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9a395-55c4-4106-8c1d-446cc18859b6 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:58.069264 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9a395-55c4-4106-8c1d-446cc18859b6 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:58.073400 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 276/544] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:58.081200 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be38fba-ffdd-4550-9a2c-015dbaa657fe None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:58.081994 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be38fba-ffdd-4550-9a2c-015dbaa657fe None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:58.082276 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be38fba-ffdd-4550-9a2c-015dbaa657fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:58.115084 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-2be38fba-ffdd-4550-9a2c-015dbaa657fe None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:58.116314 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-2be38fba-ffdd-4550-9a2c-015dbaa657fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:58.174971 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208d771-cf53-4952-b634-0f9e8c538d36 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:58.242426 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8c43b-0cea-49d5-ba20-1f4cdbcf1c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:58.243229 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8c43b-0cea-49d5-ba20-1f4cdbcf1c1c None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:58.243511 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8c43b-0cea-49d5-ba20-1f4cdbcf1c1c None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:58.243802 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8c43b-0cea-49d5-ba20-1f4cdbcf1c1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:58.248892 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 277/545] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:38:58.266187 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8c43b-0cea-49d5-ba20-1f4cdbcf1c1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:58.274518 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-41b8c43b-0cea-49d5-ba20-1f4cdbcf1c1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 20:38:58.275875 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 269/546] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 20:38:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:58.281501 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be38fba-ffdd-4550-9a2c-015dbaa657fe None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:58.313793 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8c43b-0cea-49d5-ba20-1f4cdbcf1c1c None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:58.454210 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be38fba-ffdd-4550-9a2c-015dbaa657fe None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:58.493337 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c822586-9730-4a4b-90e7-0b64824d00de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:58.494004 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c822586-9730-4a4b-90e7-0b64824d00de None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:58.494277 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c822586-9730-4a4b-90e7-0b64824d00de None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:58.494541 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c822586-9730-4a4b-90e7-0b64824d00de None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:58.495286 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c822586-9730-4a4b-90e7-0b64824d00de None admin] RBAC: Adding query filter params (name=service) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:58.495578 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c822586-9730-4a4b-90e7-0b64824d00de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:58.496985 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c822586-9730-4a4b-90e7-0b64824d00de None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:58.510225 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8c43b-0cea-49d5-ba20-1f4cdbcf1c1c None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:58.521081 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 278/547] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 20:38:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:58.529686 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c822586-9730-4a4b-90e7-0b64824d00de None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:58.590245 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c08f54-edca-4b2a-a4b4-6c0fe96f18a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:58.591571 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c08f54-edca-4b2a-a4b4-6c0fe96f18a0 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:58.592097 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c08f54-edca-4b2a-a4b4-6c0fe96f18a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:58.592596 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c08f54-edca-4b2a-a4b4-6c0fe96f18a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:58.624721 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c08f54-edca-4b2a-a4b4-6c0fe96f18a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:38:58.641901 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c822586-9730-4a4b-90e7-0b64824d00de None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:58.646167 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-98c08f54-edca-4b2a-a4b4-6c0fe96f18a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 20:38:58.657051 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 270/548] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 20:38:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:58.667404 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c08f54-edca-4b2a-a4b4-6c0fe96f18a0 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:58.687291 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7467bf-23f5-41ef-a93c-0b6033599e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:58.688129 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7467bf-23f5-41ef-a93c-0b6033599e4a None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:58.688409 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7467bf-23f5-41ef-a93c-0b6033599e4a None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:58.688678 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7467bf-23f5-41ef-a93c-0b6033599e4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:58.709635 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7467bf-23f5-41ef-a93c-0b6033599e4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:58.711137 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7467bf-23f5-41ef-a93c-0b6033599e4a None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:58.736841 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-ff7467bf-23f5-41ef-a93c-0b6033599e4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:38:58.744052 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 279/549] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:38:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:38:58.752899 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7467bf-23f5-41ef-a93c-0b6033599e4a None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:58.800205 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c08f54-edca-4b2a-a4b4-6c0fe96f18a0 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:58.846664 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c49d8f-ac4d-4a31-baf4-330eb28a0c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:58.852458 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c49d8f-ac4d-4a31-baf4-330eb28a0c9f None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:58.852458 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c49d8f-ac4d-4a31-baf4-330eb28a0c9f None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:58.852458 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c49d8f-ac4d-4a31-baf4-330eb28a0c9f None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:58.852458 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c49d8f-ac4d-4a31-baf4-330eb28a0c9f None admin] RBAC: Adding query filter params (name=service) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:58.852458 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c49d8f-ac4d-4a31-baf4-330eb28a0c9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:58.852458 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c49d8f-ac4d-4a31-baf4-330eb28a0c9f None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:58.878411 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 271/550] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 20:38:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:58.883892 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c49d8f-ac4d-4a31-baf4-330eb28a0c9f None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:58.912125 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7467bf-23f5-41ef-a93c-0b6033599e4a None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:58.958709 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e42d4-bb22-4372-9cfd-970994358a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:58.959786 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e42d4-bb22-4372-9cfd-970994358a6b None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:58.960175 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e42d4-bb22-4372-9cfd-970994358a6b None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:58.960594 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e42d4-bb22-4372-9cfd-970994358a6b None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:58.963165 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e42d4-bb22-4372-9cfd-970994358a6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:58.963657 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e42d4-bb22-4372-9cfd-970994358a6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:58.966004 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e42d4-bb22-4372-9cfd-970994358a6b None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:58.990129 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 280/551] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:58.996907 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e42d4-bb22-4372-9cfd-970994358a6b None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:59.071405 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c49d8f-ac4d-4a31-baf4-330eb28a0c9f None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:59.124518 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7986b-dc8b-4a2f-8d7e-81bc40bfd09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:59.125798 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7986b-dc8b-4a2f-8d7e-81bc40bfd09f None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:59.127230 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7986b-dc8b-4a2f-8d7e-81bc40bfd09f None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:59.129128 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7986b-dc8b-4a2f-8d7e-81bc40bfd09f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:59.154569 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f7986b-dc8b-4a2f-8d7e-81bc40bfd09f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:59.156945 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f7986b-dc8b-4a2f-8d7e-81bc40bfd09f None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:59.181376 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e42d4-bb22-4372-9cfd-970994358a6b None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:59.199871 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-67f7986b-dc8b-4a2f-8d7e-81bc40bfd09f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:38:59.201857 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 272/552] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:38:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:59.208425 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7986b-dc8b-4a2f-8d7e-81bc40bfd09f None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:59.262735 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174819a5-6d6a-4a43-be7c-6c86ffa19bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:59.264436 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174819a5-6d6a-4a43-be7c-6c86ffa19bf6 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:59.264962 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174819a5-6d6a-4a43-be7c-6c86ffa19bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:59.265434 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174819a5-6d6a-4a43-be7c-6c86ffa19bf6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:59.280834 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174819a5-6d6a-4a43-be7c-6c86ffa19bf6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:59.284004 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174819a5-6d6a-4a43-be7c-6c86ffa19bf6 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:59.314593 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-174819a5-6d6a-4a43-be7c-6c86ffa19bf6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 20:38:59.317334 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 281/553] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 20:38:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:59.324080 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174819a5-6d6a-4a43-be7c-6c86ffa19bf6 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:59.383589 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7986b-dc8b-4a2f-8d7e-81bc40bfd09f None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:59.426689 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc76273-4f16-4075-b01a-ff7ca2c8f8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:59.427763 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc76273-4f16-4075-b01a-ff7ca2c8f8f4 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:59.428250 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc76273-4f16-4075-b01a-ff7ca2c8f8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:59.428724 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc76273-4f16-4075-b01a-ff7ca2c8f8f4 None admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:59.429682 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc76273-4f16-4075-b01a-ff7ca2c8f8f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:59.430273 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc76273-4f16-4075-b01a-ff7ca2c8f8f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:59.431915 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc76273-4f16-4075-b01a-ff7ca2c8f8f4 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:59.450666 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 273/554] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:38:59.459766 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc76273-4f16-4075-b01a-ff7ca2c8f8f4 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:59.521382 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174819a5-6d6a-4a43-be7c-6c86ffa19bf6 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:59.559126 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da99100-58ba-4700-8e41-783131924e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:59.560184 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da99100-58ba-4700-8e41-783131924e52 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:59.560665 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da99100-58ba-4700-8e41-783131924e52 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:59.561238 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da99100-58ba-4700-8e41-783131924e52 None admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:59.562345 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da99100-58ba-4700-8e41-783131924e52 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:38:59.562869 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da99100-58ba-4700-8e41-783131924e52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:59.564594 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da99100-58ba-4700-8e41-783131924e52 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:59.585845 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 282/555] 10.222.0.49 () {56 vars in 1135 bytes} [Fri Oct 28 20:38:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:38:59.595482 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da99100-58ba-4700-8e41-783131924e52 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:38:59.715013 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc76273-4f16-4075-b01a-ff7ca2c8f8f4 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:59.777206 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a6237-c0a1-4ac3-832d-9149bf0a5065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:59.778281 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a6237-c0a1-4ac3-832d-9149bf0a5065 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:59.778562 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a6237-c0a1-4ac3-832d-9149bf0a5065 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:59.778914 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a6237-c0a1-4ac3-832d-9149bf0a5065 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:59.790823 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a6237-c0a1-4ac3-832d-9149bf0a5065 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:38:59.792929 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a6237-c0a1-4ac3-832d-9149bf0a5065 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:38:59.817992 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-f38a6237-c0a1-4ac3-832d-9149bf0a5065 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 28 20:38:59.820464 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 274/556] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:38:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:38:59.822706 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb4c5f-8ed0-4b6d-80d5-40a9c0aa2431 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:59.823193 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb4c5f-8ed0-4b6d-80d5-40a9c0aa2431 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:59.823689 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb4c5f-8ed0-4b6d-80d5-40a9c0aa2431 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:59.827430 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 275/557] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:38:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:38:59.838309 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12709a9e-21ad-4646-ab04-87a90f0954fc None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:59.838941 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12709a9e-21ad-4646-ab04-87a90f0954fc None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:59.839508 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12709a9e-21ad-4646-ab04-87a90f0954fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:38:59.853099 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da99100-58ba-4700-8e41-783131924e52 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:38:59.869651 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-12709a9e-21ad-4646-ab04-87a90f0954fc None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:38:59.871777 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-12709a9e-21ad-4646-ab04-87a90f0954fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:38:59.917387 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e112906-5d7d-445d-955b-f00a5e3f1e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:38:59.918500 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e112906-5d7d-445d-955b-f00a5e3f1e66 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:38:59.918980 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e112906-5d7d-445d-955b-f00a5e3f1e66 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:38:59.919466 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e112906-5d7d-445d-955b-f00a5e3f1e66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:00.000218 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 276/558] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:38:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:39:00.001529 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12709a9e-21ad-4646-ab04-87a90f0954fc None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:00.040863 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e112906-5d7d-445d-955b-f00a5e3f1e66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:00.042490 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e112906-5d7d-445d-955b-f00a5e3f1e66 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:00.180240 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12709a9e-21ad-4646-ab04-87a90f0954fc None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:00.183860 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 283/559] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:38:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 20:39:00.185502 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e112906-5d7d-445d-955b-f00a5e3f1e66 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:00.240168 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762c4c5-177b-4bac-ace9-931981435692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:00.242053 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762c4c5-177b-4bac-ace9-931981435692 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:00.242487 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762c4c5-177b-4bac-ace9-931981435692 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:00.242839 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762c4c5-177b-4bac-ace9-931981435692 None admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:00.243920 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762c4c5-177b-4bac-ace9-931981435692 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:00.244419 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762c4c5-177b-4bac-ace9-931981435692 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:00.249182 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762c4c5-177b-4bac-ace9-931981435692 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:00.287604 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 277/560] 10.222.0.49 () {56 vars in 1137 bytes} [Fri Oct 28 20:39:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:00.288533 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762c4c5-177b-4bac-ace9-931981435692 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:00.353416 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e112906-5d7d-445d-955b-f00a5e3f1e66 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:00.432046 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728689e5-f77f-412a-aa1a-0c95273a7381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:00.433583 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728689e5-f77f-412a-aa1a-0c95273a7381 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:00.434274 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728689e5-f77f-412a-aa1a-0c95273a7381 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:00.434612 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728689e5-f77f-412a-aa1a-0c95273a7381 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:00.449839 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762c4c5-177b-4bac-ace9-931981435692 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:00.451990 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728689e5-f77f-412a-aa1a-0c95273a7381 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:39:00.464382 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-728689e5-f77f-412a-aa1a-0c95273a7381 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 20:39:00.465971 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 284/561] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 20:39:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:00.469465 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728689e5-f77f-412a-aa1a-0c95273a7381 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:00.512908 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb413c3c-31d8-4e90-b5d7-addd227c6304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:00.513721 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb413c3c-31d8-4e90-b5d7-addd227c6304 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:00.513998 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb413c3c-31d8-4e90-b5d7-addd227c6304 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:00.514263 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb413c3c-31d8-4e90-b5d7-addd227c6304 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:00.527144 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb413c3c-31d8-4e90-b5d7-addd227c6304 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:00.529677 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb413c3c-31d8-4e90-b5d7-addd227c6304 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:00.553340 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-cb413c3c-31d8-4e90-b5d7-addd227c6304 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:00.559907 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 278/562] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:00.559907 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb413c3c-31d8-4e90-b5d7-addd227c6304 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:00.626480 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728689e5-f77f-412a-aa1a-0c95273a7381 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:00.666822 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b9797-3167-496f-804a-b0716b606498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:00.667639 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b9797-3167-496f-804a-b0716b606498 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:00.667945 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b9797-3167-496f-804a-b0716b606498 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:00.668210 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b9797-3167-496f-804a-b0716b606498 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:00.680965 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b9797-3167-496f-804a-b0716b606498 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:00.682624 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b9797-3167-496f-804a-b0716b606498 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:00.701162 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-993b9797-3167-496f-804a-b0716b606498 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:00.702626 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 285/563] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:00.703778 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c76a8d-50da-4510-8179-92fcc16e2ca4 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:00.704059 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c76a8d-50da-4510-8179-92fcc16e2ca4 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:00.704331 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c76a8d-50da-4510-8179-92fcc16e2ca4 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:00.706158 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 286/564] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:39:00.708011 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c76a8d-50da-4510-8179-92fcc16e2ca4 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:00.715545 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb413c3c-31d8-4e90-b5d7-addd227c6304 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:00.755627 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8ed76-f32f-4830-9207-542c48fb2667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:00.756334 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8ed76-f32f-4830-9207-542c48fb2667 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:00.756612 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8ed76-f32f-4830-9207-542c48fb2667 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:00.756889 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8ed76-f32f-4830-9207-542c48fb2667 None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:00.757662 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d8ed76-f32f-4830-9207-542c48fb2667 None admin] RBAC: Adding query filter params (name=service) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:00.757969 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d8ed76-f32f-4830-9207-542c48fb2667 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:00.759435 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d8ed76-f32f-4830-9207-542c48fb2667 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:00.769036 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 279/565] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 20:39:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:00.770799 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92e14b-f3c5-4f84-b5cc-bb5736b8503f None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:00.771101 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92e14b-f3c5-4f84-b5cc-bb5736b8503f None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:00.771338 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92e14b-f3c5-4f84-b5cc-bb5736b8503f None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:00.773424 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 280/566] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:39:00.774283 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92e14b-f3c5-4f84-b5cc-bb5736b8503f None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:00.845229 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c76a8d-50da-4510-8179-92fcc16e2ca4 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:00.884071 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbdc913-d6ff-4d79-be1d-b69d755a4899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:00.884789 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdc913-d6ff-4d79-be1d-b69d755a4899 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:00.885183 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdc913-d6ff-4d79-be1d-b69d755a4899 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:00.885559 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdc913-d6ff-4d79-be1d-b69d755a4899 None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:00.886548 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbdc913-d6ff-4d79-be1d-b69d755a4899 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:00.886951 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbdc913-d6ff-4d79-be1d-b69d755a4899 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:00.888692 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbdc913-d6ff-4d79-be1d-b69d755a4899 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:00.901680 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 287/567] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:00.902987 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62649600-ef22-4cae-951a-27f901ad0e8a None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:00.903382 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62649600-ef22-4cae-951a-27f901ad0e8a None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:00.903531 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62649600-ef22-4cae-951a-27f901ad0e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:00.922261 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-62649600-ef22-4cae-951a-27f901ad0e8a None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:00.923487 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-62649600-ef22-4cae-951a-27f901ad0e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:00.923696 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92e14b-f3c5-4f84-b5cc-bb5736b8503f None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:00.985424 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbdc06a-35bc-4b73-9bd0-89b7ad378e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:00.986564 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbdc06a-35bc-4b73-9bd0-89b7ad378e69 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:00.987069 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbdc06a-35bc-4b73-9bd0-89b7ad378e69 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:00.988141 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbdc06a-35bc-4b73-9bd0-89b7ad378e69 None admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:00.989575 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbdc06a-35bc-4b73-9bd0-89b7ad378e69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:00.990121 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbdc06a-35bc-4b73-9bd0-89b7ad378e69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:00.992770 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbdc06a-35bc-4b73-9bd0-89b7ad378e69 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:00.997196 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 288/568] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:39:00.998301 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62649600-ef22-4cae-951a-27f901ad0e8a None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:01.014278 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 281/569] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:01.016558 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059822a-1a2b-4c71-a701-3852d9569518 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:01.017009 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059822a-1a2b-4c71-a701-3852d9569518 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:01.017439 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059822a-1a2b-4c71-a701-3852d9569518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:01.048596 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-1059822a-1a2b-4c71-a701-3852d9569518 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:01.051366 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-1059822a-1a2b-4c71-a701-3852d9569518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:01.114096 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62649600-ef22-4cae-951a-27f901ad0e8a None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:01.151086 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480f4c6-763b-4b37-82a6-bf3524d1eddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:01.152035 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480f4c6-763b-4b37-82a6-bf3524d1eddd None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:01.152348 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480f4c6-763b-4b37-82a6-bf3524d1eddd None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:01.152737 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480f4c6-763b-4b37-82a6-bf3524d1eddd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:01.165490 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480f4c6-763b-4b37-82a6-bf3524d1eddd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:01.167022 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480f4c6-763b-4b37-82a6-bf3524d1eddd None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:01.183806 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 282/570] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:39:01.183806 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059822a-1a2b-4c71-a701-3852d9569518 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:01.187982 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-1480f4c6-763b-4b37-82a6-bf3524d1eddd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:01.189255 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 289/571] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:01.190075 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480f4c6-763b-4b37-82a6-bf3524d1eddd None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:01.334745 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059822a-1a2b-4c71-a701-3852d9569518 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:01.350099 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480f4c6-763b-4b37-82a6-bf3524d1eddd None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:01.389035 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd46e9-4121-420b-90a2-3d73553214da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:01.390241 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd46e9-4121-420b-90a2-3d73553214da None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:01.390714 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd46e9-4121-420b-90a2-3d73553214da None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:01.391202 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd46e9-4121-420b-90a2-3d73553214da None admin] PATH_INFO: `/v3/projects/service` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:01.392306 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e554718-fb6c-4e9b-9ca2-11d7bac9f2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:01.393099 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e554718-fb6c-4e9b-9ca2-11d7bac9f2cc None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:01.393378 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e554718-fb6c-4e9b-9ca2-11d7bac9f2cc None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:01.393649 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e554718-fb6c-4e9b-9ca2-11d7bac9f2cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:01.400657 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd46e9-4121-420b-90a2-3d73553214da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:01.402460 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd46e9-4121-420b-90a2-3d73553214da None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:01.402617 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e554718-fb6c-4e9b-9ca2-11d7bac9f2cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:01.405378 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e554718-fb6c-4e9b-9ca2-11d7bac9f2cc None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:01.416978 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-51bd46e9-4121-420b-90a2-3d73553214da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 20:39:01.418226 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 283/572] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:39:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:01.419024 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd46e9-4121-420b-90a2-3d73553214da None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:01.430379 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-6e554718-fb6c-4e9b-9ca2-11d7bac9f2cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 20:39:01.432410 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 290/573] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:39:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:01.433721 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e554718-fb6c-4e9b-9ca2-11d7bac9f2cc None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:01.540899 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd46e9-4121-420b-90a2-3d73553214da None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:01.555126 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e554718-fb6c-4e9b-9ca2-11d7bac9f2cc None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:01.586363 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5683538-37a8-415d-ac52-c76fc1933ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:01.587691 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5683538-37a8-415d-ac52-c76fc1933ffd None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:01.588207 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5683538-37a8-415d-ac52-c76fc1933ffd None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:01.588683 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5683538-37a8-415d-ac52-c76fc1933ffd None admin] PATH_INFO: `/v3/roles/service` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:01.590121 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17175a27-673b-4195-bdd7-4681b8370b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:01.590783 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17175a27-673b-4195-bdd7-4681b8370b8d None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:01.591062 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17175a27-673b-4195-bdd7-4681b8370b8d None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:01.591332 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17175a27-673b-4195-bdd7-4681b8370b8d None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:01.592092 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17175a27-673b-4195-bdd7-4681b8370b8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:01.592395 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17175a27-673b-4195-bdd7-4681b8370b8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:01.593785 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17175a27-673b-4195-bdd7-4681b8370b8d None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:01.607441 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5683538-37a8-415d-ac52-c76fc1933ffd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:39:01.608143 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 291/574] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:01.608828 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17175a27-673b-4195-bdd7-4681b8370b8d None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:01.622031 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-b5683538-37a8-415d-ac52-c76fc1933ffd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 20:39:01.630763 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 284/575] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 20:39:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:01.630763 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5683538-37a8-415d-ac52-c76fc1933ffd None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:01.724625 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17175a27-673b-4195-bdd7-4681b8370b8d None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:01.762285 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973b847-f946-4f55-85b4-c54cb3e685da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:01.763168 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973b847-f946-4f55-85b4-c54cb3e685da None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:01.763570 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973b847-f946-4f55-85b4-c54cb3e685da None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:01.764048 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973b847-f946-4f55-85b4-c54cb3e685da None admin] PATH_INFO: `/v3/roles/service` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:01.771103 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5683538-37a8-415d-ac52-c76fc1933ffd None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:01.776204 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973b847-f946-4f55-85b4-c54cb3e685da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:39:01.783381 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-e973b847-f946-4f55-85b4-c54cb3e685da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 20:39:01.785170 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 292/576] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 20:39:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:01.786228 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973b847-f946-4f55-85b4-c54cb3e685da None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:01.808188 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b61502-b717-4ed0-96ef-6acad44f57d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:01.808859 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b61502-b717-4ed0-96ef-6acad44f57d1 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:01.809132 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b61502-b717-4ed0-96ef-6acad44f57d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:01.809401 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b61502-b717-4ed0-96ef-6acad44f57d1 None admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:01.810191 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b61502-b717-4ed0-96ef-6acad44f57d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:01.810493 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b61502-b717-4ed0-96ef-6acad44f57d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:01.811966 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b61502-b717-4ed0-96ef-6acad44f57d1 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:01.825244 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 285/577] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 20:39:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:01.826098 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b61502-b717-4ed0-96ef-6acad44f57d1 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:01.919664 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973b847-f946-4f55-85b4-c54cb3e685da None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:01.950704 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b61502-b717-4ed0-96ef-6acad44f57d1 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:01.966255 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71158ec-877c-49f6-9ad4-89318dc5e102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:01.967109 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71158ec-877c-49f6-9ad4-89318dc5e102 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:01.967547 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71158ec-877c-49f6-9ad4-89318dc5e102 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:01.968030 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71158ec-877c-49f6-9ad4-89318dc5e102 None admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:01.969459 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71158ec-877c-49f6-9ad4-89318dc5e102 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:01.969938 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71158ec-877c-49f6-9ad4-89318dc5e102 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:01.973157 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71158ec-877c-49f6-9ad4-89318dc5e102 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:01.999615 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 293/578] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 20:39:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:01.999615 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71158ec-877c-49f6-9ad4-89318dc5e102 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:02.008553 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced451c6-38fa-4a92-89f9-6ee98678d87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:02.009787 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced451c6-38fa-4a92-89f9-6ee98678d87f None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:02.010112 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced451c6-38fa-4a92-89f9-6ee98678d87f None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:02.010519 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced451c6-38fa-4a92-89f9-6ee98678d87f None admin] PATH_INFO: `/v3/users/nova` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:02.023182 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced451c6-38fa-4a92-89f9-6ee98678d87f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:02.025791 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced451c6-38fa-4a92-89f9-6ee98678d87f None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:02.050766 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-ced451c6-38fa-4a92-89f9-6ee98678d87f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 20:39:02.052950 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 286/579] 10.222.0.49 () {56 vars in 1093 bytes} [Fri Oct 28 20:39:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:02.053841 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced451c6-38fa-4a92-89f9-6ee98678d87f None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:02.152751 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71158ec-877c-49f6-9ad4-89318dc5e102 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:02.211021 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f11e4-350d-443f-8fd0-1a3d096b9175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:02.211714 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced451c6-38fa-4a92-89f9-6ee98678d87f None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:02.212088 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f11e4-350d-443f-8fd0-1a3d096b9175 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:02.212533 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f11e4-350d-443f-8fd0-1a3d096b9175 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:02.212967 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f11e4-350d-443f-8fd0-1a3d096b9175 None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:02.214207 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f11e4-350d-443f-8fd0-1a3d096b9175 None admin] RBAC: Adding query filter params (name=service) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:02.214702 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f11e4-350d-443f-8fd0-1a3d096b9175 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:02.216616 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f11e4-350d-443f-8fd0-1a3d096b9175 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:02.229153 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 294/580] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 20:39:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:02.230319 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f11e4-350d-443f-8fd0-1a3d096b9175 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:02.268086 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e45f9d-cfd2-465c-bcf0-eb0947d51fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:02.269307 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e45f9d-cfd2-465c-bcf0-eb0947d51fa6 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:02.269979 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e45f9d-cfd2-465c-bcf0-eb0947d51fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:02.270450 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e45f9d-cfd2-465c-bcf0-eb0947d51fa6 None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:02.271823 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e45f9d-cfd2-465c-bcf0-eb0947d51fa6 None admin] RBAC: Adding query filter params (name=service) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:02.272326 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e45f9d-cfd2-465c-bcf0-eb0947d51fa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:02.274716 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e45f9d-cfd2-465c-bcf0-eb0947d51fa6 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:02.290357 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 287/581] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 20:39:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:02.291629 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e45f9d-cfd2-465c-bcf0-eb0947d51fa6 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:02.338049 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f11e4-350d-443f-8fd0-1a3d096b9175 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:02.373124 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae7917-3e3e-467c-8f65-7374469d197c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:02.373790 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae7917-3e3e-467c-8f65-7374469d197c None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:02.374072 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae7917-3e3e-467c-8f65-7374469d197c None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:02.374360 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae7917-3e3e-467c-8f65-7374469d197c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:02.375192 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae7917-3e3e-467c-8f65-7374469d197c None admin] RBAC: Adding query filter params (role.id=7190d40a528146289333f0b9c16a6370, scope.project.id=c55c2ee59af14cf8a7e4275de4f43037, user.id=91d70db11d2d4923943bc6479bc49206) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:02.375497 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae7917-3e3e-467c-8f65-7374469d197c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:02.376991 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae7917-3e3e-467c-8f65-7374469d197c None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:02.383652 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 295/582] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:39:02 2022] GET /identity/v3/role_assignments?user.id=91d70db11d2d4923943bc6479bc49206&scope.project.id=c55c2ee59af14cf8a7e4275de4f43037&role.id=7190d40a528146289333f0b9c16a6370 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:02.385079 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae7917-3e3e-467c-8f65-7374469d197c None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:02.460479 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e45f9d-cfd2-465c-bcf0-eb0947d51fa6 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:02.519095 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec670e7-8acf-4558-bdd2-9a69ea183099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:02.521113 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec670e7-8acf-4558-bdd2-9a69ea183099 None admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:02.521589 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec670e7-8acf-4558-bdd2-9a69ea183099 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:02.522360 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec670e7-8acf-4558-bdd2-9a69ea183099 None admin] PATH_INFO: `/v3/projects/c55c2ee59af14cf8a7e4275de4f43037/users/05029a41bd2b42febfd5ce91a3f28c24/roles/7190d40a528146289333f0b9c16a6370` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:02.541893 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae7917-3e3e-467c-8f65-7374469d197c None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:02.550959 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec670e7-8acf-4558-bdd2-9a69ea183099 None admin] RBAC: Authorizing `identity:create_grant(project_id=c55c2ee59af14cf8a7e4275de4f43037, user_id=05029a41bd2b42febfd5ce91a3f28c24, role_id=7190d40a528146289333f0b9c16a6370)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:02.553836 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec670e7-8acf-4558-bdd2-9a69ea183099 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:02.577204 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 288/583] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 20:39:02 2022] PUT /identity/v3/projects/c55c2ee59af14cf8a7e4275de4f43037/users/05029a41bd2b42febfd5ce91a3f28c24/roles/7190d40a528146289333f0b9c16a6370 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:39:02.578887 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec670e7-8acf-4558-bdd2-9a69ea183099 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:02.607617 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f567cfc-bd06-449a-b246-360f76f3c2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:02.608460 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f567cfc-bd06-449a-b246-360f76f3c2d0 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:02.608718 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f567cfc-bd06-449a-b246-360f76f3c2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:02.608939 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f567cfc-bd06-449a-b246-360f76f3c2d0 None admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:02.609862 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f567cfc-bd06-449a-b246-360f76f3c2d0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:02.610260 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f567cfc-bd06-449a-b246-360f76f3c2d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:02.612006 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f567cfc-bd06-449a-b246-360f76f3c2d0 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:02.644457 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 296/584] 10.222.0.49 () {56 vars in 1133 bytes} [Fri Oct 28 20:39:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:02.649430 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f567cfc-bd06-449a-b246-360f76f3c2d0 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:02.814616 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec670e7-8acf-4558-bdd2-9a69ea183099 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:02.842423 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f567cfc-bd06-449a-b246-360f76f3c2d0 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:02.884372 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459aa16-0f71-45e3-98f2-3e3a1f6dc9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:02.886230 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459aa16-0f71-45e3-98f2-3e3a1f6dc9c7 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:02.887001 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459aa16-0f71-45e3-98f2-3e3a1f6dc9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:02.887797 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459aa16-0f71-45e3-98f2-3e3a1f6dc9c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:02.902529 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a2491-e8b8-4e17-8371-535a12a9441d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:02.903534 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a2491-e8b8-4e17-8371-535a12a9441d None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:02.903995 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a2491-e8b8-4e17-8371-535a12a9441d None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:02.904392 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a2491-e8b8-4e17-8371-535a12a9441d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:02.911656 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459aa16-0f71-45e3-98f2-3e3a1f6dc9c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:02.913511 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459aa16-0f71-45e3-98f2-3e3a1f6dc9c7 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:02.921982 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a2491-e8b8-4e17-8371-535a12a9441d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:02.923839 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a2491-e8b8-4e17-8371-535a12a9441d None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:02.949921 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-f459aa16-0f71-45e3-98f2-3e3a1f6dc9c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:02.952205 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 289/585] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:02.953878 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459aa16-0f71-45e3-98f2-3e3a1f6dc9c7 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:02.956443 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-529a2491-e8b8-4e17-8371-535a12a9441d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:02.959295 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 297/586] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:02.965263 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a2491-e8b8-4e17-8371-535a12a9441d None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:03.146389 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459aa16-0f71-45e3-98f2-3e3a1f6dc9c7 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:03.163067 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a2491-e8b8-4e17-8371-535a12a9441d None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:03.211530 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c692b74-ea4a-4cbd-b247-c7928c48a337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:03.212909 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c692b74-ea4a-4cbd-b247-c7928c48a337 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:03.213355 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c692b74-ea4a-4cbd-b247-c7928c48a337 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:03.213821 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c692b74-ea4a-4cbd-b247-c7928c48a337 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:03.229510 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5351ee-a4eb-4f16-89eb-de91f39d6a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:03.231346 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5351ee-a4eb-4f16-89eb-de91f39d6a25 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:03.232151 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5351ee-a4eb-4f16-89eb-de91f39d6a25 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:03.232789 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5351ee-a4eb-4f16-89eb-de91f39d6a25 None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:03.234269 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5351ee-a4eb-4f16-89eb-de91f39d6a25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:03.235022 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5351ee-a4eb-4f16-89eb-de91f39d6a25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:03.238382 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5351ee-a4eb-4f16-89eb-de91f39d6a25 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:03.240172 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c692b74-ea4a-4cbd-b247-c7928c48a337 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:03.243525 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c692b74-ea4a-4cbd-b247-c7928c48a337 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:03.263194 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 298/587] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:03.265641 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5351ee-a4eb-4f16-89eb-de91f39d6a25 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:03.287471 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-4c692b74-ea4a-4cbd-b247-c7928c48a337 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:03.290399 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 290/588] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:03.292096 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c692b74-ea4a-4cbd-b247-c7928c48a337 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:03.477763 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5351ee-a4eb-4f16-89eb-de91f39d6a25 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:03.486702 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c692b74-ea4a-4cbd-b247-c7928c48a337 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:03.547522 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a9abe-cf6a-44bb-b3e4-e4594420be26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:03.550881 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a9abe-cf6a-44bb-b3e4-e4594420be26 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:03.552177 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a9abe-cf6a-44bb-b3e4-e4594420be26 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:03.552437 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c570e69-20bf-4495-b7b0-3b5a2eff03fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:03.553280 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a9abe-cf6a-44bb-b3e4-e4594420be26 None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:03.553705 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c570e69-20bf-4495-b7b0-3b5a2eff03fd None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:03.554204 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c570e69-20bf-4495-b7b0-3b5a2eff03fd None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:03.554689 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c570e69-20bf-4495-b7b0-3b5a2eff03fd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:03.556098 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a9abe-cf6a-44bb-b3e4-e4594420be26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:03.556978 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a9abe-cf6a-44bb-b3e4-e4594420be26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:03.559927 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a9abe-cf6a-44bb-b3e4-e4594420be26 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:03.569407 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c570e69-20bf-4495-b7b0-3b5a2eff03fd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:03.572222 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c570e69-20bf-4495-b7b0-3b5a2eff03fd None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:03.592146 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 299/589] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:03.594140 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a9abe-cf6a-44bb-b3e4-e4594420be26 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:03.602750 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-9c570e69-20bf-4495-b7b0-3b5a2eff03fd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 20:39:03.605577 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 291/590] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:39:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:03.607172 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c570e69-20bf-4495-b7b0-3b5a2eff03fd None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:03.795083 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c570e69-20bf-4495-b7b0-3b5a2eff03fd None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:03.801655 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a9abe-cf6a-44bb-b3e4-e4594420be26 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:03.858231 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7ec4d-798b-4b23-a335-3bef933e6651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:03.859684 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7ec4d-798b-4b23-a335-3bef933e6651 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:03.860159 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7ec4d-798b-4b23-a335-3bef933e6651 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:03.860614 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7ec4d-798b-4b23-a335-3bef933e6651 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:03.869978 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0995b6-c66e-4912-a889-3dda148cd5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:03.871541 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0995b6-c66e-4912-a889-3dda148cd5ea None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:03.872333 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0995b6-c66e-4912-a889-3dda148cd5ea None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:03.873054 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0995b6-c66e-4912-a889-3dda148cd5ea None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:03.874657 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0995b6-c66e-4912-a889-3dda148cd5ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:03.875572 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0995b6-c66e-4912-a889-3dda148cd5ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:03.876320 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7ec4d-798b-4b23-a335-3bef933e6651 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:03.878808 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0995b6-c66e-4912-a889-3dda148cd5ea None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:03.879076 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7ec4d-798b-4b23-a335-3bef933e6651 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:03.902600 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 300/591] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:03.904643 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0995b6-c66e-4912-a889-3dda148cd5ea None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:03.906365 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-bbf7ec4d-798b-4b23-a335-3bef933e6651 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 20:39:03.915927 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 292/592] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 20:39:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:03.917577 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7ec4d-798b-4b23-a335-3bef933e6651 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:04.102822 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0995b6-c66e-4912-a889-3dda148cd5ea None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:04.111782 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7ec4d-798b-4b23-a335-3bef933e6651 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:04.167032 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868169f-f37d-4b1e-b8a3-262d2532f42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:04.168664 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868169f-f37d-4b1e-b8a3-262d2532f42f None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:04.169457 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868169f-f37d-4b1e-b8a3-262d2532f42f None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:04.170189 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868169f-f37d-4b1e-b8a3-262d2532f42f None admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:04.171995 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0868169f-f37d-4b1e-b8a3-262d2532f42f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:04.172810 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0868169f-f37d-4b1e-b8a3-262d2532f42f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:04.176504 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0868169f-f37d-4b1e-b8a3-262d2532f42f None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:04.181505 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23c4c4-b1b4-41d7-88a3-1675f03a7914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:04.183949 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23c4c4-b1b4-41d7-88a3-1675f03a7914 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:04.184443 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23c4c4-b1b4-41d7-88a3-1675f03a7914 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:04.184930 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23c4c4-b1b4-41d7-88a3-1675f03a7914 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:04.200521 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23c4c4-b1b4-41d7-88a3-1675f03a7914 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:04.203163 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23c4c4-b1b4-41d7-88a3-1675f03a7914 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:04.214762 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 301/593] 10.222.0.49 () {56 vars in 1137 bytes} [Fri Oct 28 20:39:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:04.216791 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868169f-f37d-4b1e-b8a3-262d2532f42f None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:04.235182 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-ef23c4c4-b1b4-41d7-88a3-1675f03a7914 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 20:39:04.239853 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 293/594] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:39:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:04.241710 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23c4c4-b1b4-41d7-88a3-1675f03a7914 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:04.421720 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868169f-f37d-4b1e-b8a3-262d2532f42f None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:04.448889 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23c4c4-b1b4-41d7-88a3-1675f03a7914 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:04.489804 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7044608-2dc8-4094-99fc-a48b0aaa5afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:04.491319 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7044608-2dc8-4094-99fc-a48b0aaa5afc None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:04.491820 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7044608-2dc8-4094-99fc-a48b0aaa5afc None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:04.492288 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7044608-2dc8-4094-99fc-a48b0aaa5afc None admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:04.493880 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7044608-2dc8-4094-99fc-a48b0aaa5afc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:04.494661 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7044608-2dc8-4094-99fc-a48b0aaa5afc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:04.498619 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7044608-2dc8-4094-99fc-a48b0aaa5afc None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:04.514551 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9a986-f3b6-4054-88a3-b681e716e860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:04.516935 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9a986-f3b6-4054-88a3-b681e716e860 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:04.517656 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9a986-f3b6-4054-88a3-b681e716e860 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:04.518381 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9a986-f3b6-4054-88a3-b681e716e860 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:04.542764 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 302/595] 10.222.0.49 () {56 vars in 1139 bytes} [Fri Oct 28 20:39:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:04.542764 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7044608-2dc8-4094-99fc-a48b0aaa5afc None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:04.544297 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9a986-f3b6-4054-88a3-b681e716e860 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:04.546049 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9a986-f3b6-4054-88a3-b681e716e860 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:04.578263 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-76d9a986-f3b6-4054-88a3-b681e716e860 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:04.582015 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 294/596] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:04.584130 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9a986-f3b6-4054-88a3-b681e716e860 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:04.735924 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7044608-2dc8-4094-99fc-a48b0aaa5afc None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:04.766399 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9a986-f3b6-4054-88a3-b681e716e860 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:04.797974 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14f7fa-1bb2-4dbb-9267-23ef91c7c800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:04.799384 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14f7fa-1bb2-4dbb-9267-23ef91c7c800 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:04.799952 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14f7fa-1bb2-4dbb-9267-23ef91c7c800 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:04.800381 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14f7fa-1bb2-4dbb-9267-23ef91c7c800 None admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:04.801794 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e14f7fa-1bb2-4dbb-9267-23ef91c7c800 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:04.802319 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e14f7fa-1bb2-4dbb-9267-23ef91c7c800 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:04.804921 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e14f7fa-1bb2-4dbb-9267-23ef91c7c800 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:04.830322 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5802483-62a3-4659-a2dc-8976d7cd1812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:04.832241 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 303/597] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 20:39:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:04.833017 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5802483-62a3-4659-a2dc-8976d7cd1812 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:04.833712 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5802483-62a3-4659-a2dc-8976d7cd1812 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:04.833866 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14f7fa-1bb2-4dbb-9267-23ef91c7c800 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:04.834732 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5802483-62a3-4659-a2dc-8976d7cd1812 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:04.855015 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5802483-62a3-4659-a2dc-8976d7cd1812 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:04.858086 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5802483-62a3-4659-a2dc-8976d7cd1812 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:04.889656 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-a5802483-62a3-4659-a2dc-8976d7cd1812 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:04.892508 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 295/598] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:04.901835 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5802483-62a3-4659-a2dc-8976d7cd1812 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:05.022691 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14f7fa-1bb2-4dbb-9267-23ef91c7c800 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:05.052749 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5802483-62a3-4659-a2dc-8976d7cd1812 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:05.077547 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87484e4-78cf-4dc5-bae8-1ef3eb06a5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:05.078644 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87484e4-78cf-4dc5-bae8-1ef3eb06a5b5 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:05.079101 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87484e4-78cf-4dc5-bae8-1ef3eb06a5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:05.079543 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87484e4-78cf-4dc5-bae8-1ef3eb06a5b5 None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:05.080491 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87484e4-78cf-4dc5-bae8-1ef3eb06a5b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:05.080925 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87484e4-78cf-4dc5-bae8-1ef3eb06a5b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:05.083245 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87484e4-78cf-4dc5-bae8-1ef3eb06a5b5 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:05.103987 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 304/599] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:05.103987 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87484e4-78cf-4dc5-bae8-1ef3eb06a5b5 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:05.109080 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf715c41-6b1e-4a05-8b60-d783e1a06e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:05.110005 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf715c41-6b1e-4a05-8b60-d783e1a06e5c None admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:05.110278 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf715c41-6b1e-4a05-8b60-d783e1a06e5c None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:05.110542 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf715c41-6b1e-4a05-8b60-d783e1a06e5c None admin] PATH_INFO: `/v3/projects/c55c2ee59af14cf8a7e4275de4f43037/users/04bc6ee009e34a5f82e2807db51523d3/roles/7190d40a528146289333f0b9c16a6370` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:05.127810 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf715c41-6b1e-4a05-8b60-d783e1a06e5c None admin] RBAC: Authorizing `identity:create_grant(project_id=c55c2ee59af14cf8a7e4275de4f43037, user_id=04bc6ee009e34a5f82e2807db51523d3, role_id=7190d40a528146289333f0b9c16a6370)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:05.129352 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf715c41-6b1e-4a05-8b60-d783e1a06e5c None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:05.151817 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 296/600] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 20:39:04 2022] PUT /identity/v3/projects/c55c2ee59af14cf8a7e4275de4f43037/users/04bc6ee009e34a5f82e2807db51523d3/roles/7190d40a528146289333f0b9c16a6370 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:39:05.151817 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964c3ad-59fd-4959-912b-5acc97c1209f None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:05.151817 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964c3ad-59fd-4959-912b-5acc97c1209f None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:05.151817 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964c3ad-59fd-4959-912b-5acc97c1209f None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:05.151817 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 297/601] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:39:05.151817 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964c3ad-59fd-4959-912b-5acc97c1209f None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:05.300707 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87484e4-78cf-4dc5-bae8-1ef3eb06a5b5 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:05.320796 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964c3ad-59fd-4959-912b-5acc97c1209f None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:05.353235 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc1071-4789-4006-b546-40dcf61c0c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:05.354853 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc1071-4789-4006-b546-40dcf61c0c01 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:05.355651 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc1071-4789-4006-b546-40dcf61c0c01 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:05.356287 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc1071-4789-4006-b546-40dcf61c0c01 None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:05.357463 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc1071-4789-4006-b546-40dcf61c0c01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:05.358049 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc1071-4789-4006-b546-40dcf61c0c01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:05.359873 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399bfd1-514d-447c-825c-e0050af3d1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:05.360214 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc1071-4789-4006-b546-40dcf61c0c01 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:05.360892 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399bfd1-514d-447c-825c-e0050af3d1ce None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:05.361238 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399bfd1-514d-447c-825c-e0050af3d1ce None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:05.361575 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399bfd1-514d-447c-825c-e0050af3d1ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:05.370910 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399bfd1-514d-447c-825c-e0050af3d1ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:05.372629 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399bfd1-514d-447c-825c-e0050af3d1ce None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:05.377373 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 305/602] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:05.380186 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b107e-d410-4a8d-88b5-077dcd4729e2 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:05.380684 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b107e-d410-4a8d-88b5-077dcd4729e2 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:05.381129 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b107e-d410-4a8d-88b5-077dcd4729e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:05.394323 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-0399bfd1-514d-447c-825c-e0050af3d1ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 20:39:05.400225 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 298/603] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:39:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:05.401338 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399bfd1-514d-447c-825c-e0050af3d1ce None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:05.403317 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-507b107e-d410-4a8d-88b5-077dcd4729e2 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:05.405035 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-507b107e-d410-4a8d-88b5-077dcd4729e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:05.497151 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 306/604] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:39:05.505587 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b107e-d410-4a8d-88b5-077dcd4729e2 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:05.549414 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399bfd1-514d-447c-825c-e0050af3d1ce None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:05.613562 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f9782-d572-4570-a9a1-52832c1e4482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:05.615342 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f9782-d572-4570-a9a1-52832c1e4482 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:05.615876 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f9782-d572-4570-a9a1-52832c1e4482 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:05.616520 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f9782-d572-4570-a9a1-52832c1e4482 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:05.630559 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f9782-d572-4570-a9a1-52832c1e4482 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:05.633937 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f9782-d572-4570-a9a1-52832c1e4482 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:05.662411 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-a08f9782-d572-4570-a9a1-52832c1e4482 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 20:39:05.664813 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 299/605] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:39:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:05.669705 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f9782-d572-4570-a9a1-52832c1e4482 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:05.685142 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b107e-d410-4a8d-88b5-077dcd4729e2 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:05.748566 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53f45f-3728-4e49-ba4a-ef804965c96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:05.750140 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53f45f-3728-4e49-ba4a-ef804965c96e None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:05.750841 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53f45f-3728-4e49-ba4a-ef804965c96e None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:05.751552 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53f45f-3728-4e49-ba4a-ef804965c96e None admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:05.754829 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53f45f-3728-4e49-ba4a-ef804965c96e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:05.755460 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53f45f-3728-4e49-ba4a-ef804965c96e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:05.757598 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53f45f-3728-4e49-ba4a-ef804965c96e None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:05.779716 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 307/606] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 20:39:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:05.781206 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53f45f-3728-4e49-ba4a-ef804965c96e None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:05.844488 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f9782-d572-4570-a9a1-52832c1e4482 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:05.886277 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42aecd-1366-4380-b928-bb6b2765b0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:05.887415 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42aecd-1366-4380-b928-bb6b2765b0ea None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:05.887928 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42aecd-1366-4380-b928-bb6b2765b0ea None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:05.888411 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42aecd-1366-4380-b928-bb6b2765b0ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:05.900823 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42aecd-1366-4380-b928-bb6b2765b0ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:39:05.908312 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-dc42aecd-1366-4380-b928-bb6b2765b0ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 20:39:05.910772 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 300/607] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 20:39:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:05.911791 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42aecd-1366-4380-b928-bb6b2765b0ea None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:05.954249 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53f45f-3728-4e49-ba4a-ef804965c96e None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:06.021296 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5511d-68b9-493f-a1e2-7ec7838ac46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:06.022508 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5511d-68b9-493f-a1e2-7ec7838ac46e None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:06.022989 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5511d-68b9-493f-a1e2-7ec7838ac46e None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:06.023543 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5511d-68b9-493f-a1e2-7ec7838ac46e None admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:06.025469 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5511d-68b9-493f-a1e2-7ec7838ac46e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:06.025724 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5511d-68b9-493f-a1e2-7ec7838ac46e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:06.028651 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5511d-68b9-493f-a1e2-7ec7838ac46e None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:06.029126 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42aecd-1366-4380-b928-bb6b2765b0ea None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:06.059619 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 308/608] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 20:39:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:06.059619 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5511d-68b9-493f-a1e2-7ec7838ac46e None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:06.076641 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c4226-b9bd-4f3f-b878-8779cefad617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:06.077932 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c4226-b9bd-4f3f-b878-8779cefad617 None admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:06.078410 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c4226-b9bd-4f3f-b878-8779cefad617 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:06.078881 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c4226-b9bd-4f3f-b878-8779cefad617 None admin] PATH_INFO: `/v3/projects/c55c2ee59af14cf8a7e4275de4f43037/users/f305aece531c412b9e0ac30be9f47667/roles/7190d40a528146289333f0b9c16a6370` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:06.098524 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c4226-b9bd-4f3f-b878-8779cefad617 None admin] RBAC: Authorizing `identity:create_grant(project_id=c55c2ee59af14cf8a7e4275de4f43037, user_id=f305aece531c412b9e0ac30be9f47667, role_id=7190d40a528146289333f0b9c16a6370)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:06.100508 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c4226-b9bd-4f3f-b878-8779cefad617 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:06.125861 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 301/609] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 20:39:05 2022] PUT /identity/v3/projects/c55c2ee59af14cf8a7e4275de4f43037/users/f305aece531c412b9e0ac30be9f47667/roles/7190d40a528146289333f0b9c16a6370 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:39:06.127152 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c4226-b9bd-4f3f-b878-8779cefad617 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:06.198056 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5511d-68b9-493f-a1e2-7ec7838ac46e None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:06.239095 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e55391-6e77-46ed-8abc-e40f6ba1dd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:06.239812 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e55391-6e77-46ed-8abc-e40f6ba1dd97 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:06.240098 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e55391-6e77-46ed-8abc-e40f6ba1dd97 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:06.247966 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e55391-6e77-46ed-8abc-e40f6ba1dd97 None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:06.247966 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e55391-6e77-46ed-8abc-e40f6ba1dd97 None admin] RBAC: Adding query filter params (name=service) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:06.247966 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e55391-6e77-46ed-8abc-e40f6ba1dd97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:06.247966 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e55391-6e77-46ed-8abc-e40f6ba1dd97 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:06.253750 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 309/610] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 20:39:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:06.259715 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e55391-6e77-46ed-8abc-e40f6ba1dd97 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:06.399269 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c4226-b9bd-4f3f-b878-8779cefad617 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:06.456874 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53add79a-97a4-473b-abcc-1c724421403b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:06.458724 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53add79a-97a4-473b-abcc-1c724421403b None admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:06.459232 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53add79a-97a4-473b-abcc-1c724421403b None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:06.459591 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53add79a-97a4-473b-abcc-1c724421403b None admin] PATH_INFO: `/v3/projects/c55c2ee59af14cf8a7e4275de4f43037/users/691a2da563a84da48ca8fd75a0bfe787/roles/7190d40a528146289333f0b9c16a6370` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:06.488098 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53add79a-97a4-473b-abcc-1c724421403b None admin] RBAC: Authorizing `identity:create_grant(project_id=c55c2ee59af14cf8a7e4275de4f43037, user_id=691a2da563a84da48ca8fd75a0bfe787, role_id=7190d40a528146289333f0b9c16a6370)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:06.490911 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53add79a-97a4-473b-abcc-1c724421403b None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:06.514376 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 302/611] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 20:39:06 2022] PUT /identity/v3/projects/c55c2ee59af14cf8a7e4275de4f43037/users/691a2da563a84da48ca8fd75a0bfe787/roles/7190d40a528146289333f0b9c16a6370 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:39:06.516431 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72f0c0-d120-4bad-9f61-11c548e6166a None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:06.516736 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72f0c0-d120-4bad-9f61-11c548e6166a None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:06.517720 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72f0c0-d120-4bad-9f61-11c548e6166a None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:06.520589 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e55391-6e77-46ed-8abc-e40f6ba1dd97 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:06.521346 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 303/612] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:39:06.529495 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c7706-baaa-471d-975a-069327cd6263 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:06.530451 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c7706-baaa-471d-975a-069327cd6263 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:06.531278 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c7706-baaa-471d-975a-069327cd6263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:06.569319 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-857c7706-baaa-471d-975a-069327cd6263 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:06.571322 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-857c7706-baaa-471d-975a-069327cd6263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:06.593094 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f2570-88c2-4b8c-aa67-1b15404a9d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:06.594509 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f2570-88c2-4b8c-aa67-1b15404a9d56 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:06.594968 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f2570-88c2-4b8c-aa67-1b15404a9d56 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:06.595449 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f2570-88c2-4b8c-aa67-1b15404a9d56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:06.626170 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f2570-88c2-4b8c-aa67-1b15404a9d56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:06.628031 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f2570-88c2-4b8c-aa67-1b15404a9d56 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:06.664311 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-156f2570-88c2-4b8c-aa67-1b15404a9d56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:06.666307 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 310/613] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:06.671656 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f2570-88c2-4b8c-aa67-1b15404a9d56 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:06.788229 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 304/614] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:39:06.817530 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c7706-baaa-471d-975a-069327cd6263 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:06.844381 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f2570-88c2-4b8c-aa67-1b15404a9d56 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:06.903261 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4cb3d3-c2af-4ace-aade-2fa4bc7b0f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:06.904931 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4cb3d3-c2af-4ace-aade-2fa4bc7b0f10 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:06.905680 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4cb3d3-c2af-4ace-aade-2fa4bc7b0f10 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:06.906372 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4cb3d3-c2af-4ace-aade-2fa4bc7b0f10 None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:06.908081 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4cb3d3-c2af-4ace-aade-2fa4bc7b0f10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:06.908889 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4cb3d3-c2af-4ace-aade-2fa4bc7b0f10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:06.912500 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4cb3d3-c2af-4ace-aade-2fa4bc7b0f10 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:06.936053 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 311/615] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:06.941837 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4cb3d3-c2af-4ace-aade-2fa4bc7b0f10 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:06.993937 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c7706-baaa-471d-975a-069327cd6263 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:07.082665 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3d2d9-20f7-40d2-9370-bee6283a90ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:07.083821 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3d2d9-20f7-40d2-9370-bee6283a90ba None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:07.084248 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3d2d9-20f7-40d2-9370-bee6283a90ba None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:07.084666 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3d2d9-20f7-40d2-9370-bee6283a90ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:07.113276 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4cb3d3-c2af-4ace-aade-2fa4bc7b0f10 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:07.114375 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c3d2d9-20f7-40d2-9370-bee6283a90ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:39:07.121848 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-a0c3d2d9-20f7-40d2-9370-bee6283a90ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 20:39:07.128837 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 305/616] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 20:39:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:39:07.132161 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3d2d9-20f7-40d2-9370-bee6283a90ba None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:07.164647 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d367402-796f-46ab-bbbc-002ff74918d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:07.165982 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d367402-796f-46ab-bbbc-002ff74918d4 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:07.166417 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d367402-796f-46ab-bbbc-002ff74918d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:07.167902 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d367402-796f-46ab-bbbc-002ff74918d4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:07.181689 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d367402-796f-46ab-bbbc-002ff74918d4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:07.183308 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d367402-796f-46ab-bbbc-002ff74918d4 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:07.202759 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-9d367402-796f-46ab-bbbc-002ff74918d4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 20:39:07.204327 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 312/617] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 20:39:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:07.221895 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d367402-796f-46ab-bbbc-002ff74918d4 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:07.355232 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3d2d9-20f7-40d2-9370-bee6283a90ba None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:07.425582 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a5803-0398-4890-a98b-89bc07ed4805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:07.426456 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a5803-0398-4890-a98b-89bc07ed4805 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:07.426816 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a5803-0398-4890-a98b-89bc07ed4805 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:07.427090 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a5803-0398-4890-a98b-89bc07ed4805 None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:07.427984 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a5803-0398-4890-a98b-89bc07ed4805 None admin] RBAC: Adding query filter params (name=service) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:07.428391 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a5803-0398-4890-a98b-89bc07ed4805 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:07.429801 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a5803-0398-4890-a98b-89bc07ed4805 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:07.462111 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 306/618] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 20:39:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:39:07.477215 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a5803-0398-4890-a98b-89bc07ed4805 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:07.485930 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d367402-796f-46ab-bbbc-002ff74918d4 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:07.583615 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b93e6d-a709-4f60-a971-b40453674dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:07.585159 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b93e6d-a709-4f60-a971-b40453674dcd None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:07.585632 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b93e6d-a709-4f60-a971-b40453674dcd None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:07.586103 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b93e6d-a709-4f60-a971-b40453674dcd None admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:07.587147 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b93e6d-a709-4f60-a971-b40453674dcd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:07.587697 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b93e6d-a709-4f60-a971-b40453674dcd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:07.589377 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b93e6d-a709-4f60-a971-b40453674dcd None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:07.632252 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 313/619] 10.222.0.49 () {56 vars in 1135 bytes} [Fri Oct 28 20:39:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:07.637405 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b93e6d-a709-4f60-a971-b40453674dcd None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:07.650068 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a5803-0398-4890-a98b-89bc07ed4805 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:07.698034 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552aa0b-77e8-4609-8cc1-d1d5e17f1a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:07.699388 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552aa0b-77e8-4609-8cc1-d1d5e17f1a10 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:07.701190 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552aa0b-77e8-4609-8cc1-d1d5e17f1a10 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:07.701723 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552aa0b-77e8-4609-8cc1-d1d5e17f1a10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:07.717151 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552aa0b-77e8-4609-8cc1-d1d5e17f1a10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:07.718991 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552aa0b-77e8-4609-8cc1-d1d5e17f1a10 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:07.738946 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-7552aa0b-77e8-4609-8cc1-d1d5e17f1a10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:07.741041 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 307/620] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:39:07.746490 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552aa0b-77e8-4609-8cc1-d1d5e17f1a10 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:07.889231 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b93e6d-a709-4f60-a971-b40453674dcd None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:07.932575 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552aa0b-77e8-4609-8cc1-d1d5e17f1a10 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:07.995116 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077fb5f-da79-48cf-9dc8-4d2823808f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:07.996435 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077fb5f-da79-48cf-9dc8-4d2823808f90 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:07.997042 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077fb5f-da79-48cf-9dc8-4d2823808f90 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:07.999303 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077fb5f-da79-48cf-9dc8-4d2823808f90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:08.026127 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077fb5f-da79-48cf-9dc8-4d2823808f90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:08.029409 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077fb5f-da79-48cf-9dc8-4d2823808f90 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:08.030385 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3c9a4-8005-4a2f-96fa-dcd67f593e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:08.031305 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3c9a4-8005-4a2f-96fa-dcd67f593e07 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:08.031898 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3c9a4-8005-4a2f-96fa-dcd67f593e07 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:08.032395 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3c9a4-8005-4a2f-96fa-dcd67f593e07 None admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:08.033970 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3c9a4-8005-4a2f-96fa-dcd67f593e07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:08.036339 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3c9a4-8005-4a2f-96fa-dcd67f593e07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:08.038455 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3c9a4-8005-4a2f-96fa-dcd67f593e07 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:08.062757 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 308/621] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:08.068415 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-9077fb5f-da79-48cf-9dc8-4d2823808f90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:08.073646 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 314/622] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 436 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:39:08.074939 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3c9a4-8005-4a2f-96fa-dcd67f593e07 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:08.079096 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077fb5f-da79-48cf-9dc8-4d2823808f90 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:08.260326 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077fb5f-da79-48cf-9dc8-4d2823808f90 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:08.296964 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3c9a4-8005-4a2f-96fa-dcd67f593e07 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:08.323158 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf86bcd-3e55-47d4-8c18-7c13b3b7a7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:08.324816 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf86bcd-3e55-47d4-8c18-7c13b3b7a7bc None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:08.325555 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf86bcd-3e55-47d4-8c18-7c13b3b7a7bc None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:08.326337 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf86bcd-3e55-47d4-8c18-7c13b3b7a7bc None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:08.328160 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf86bcd-3e55-47d4-8c18-7c13b3b7a7bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:08.328993 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf86bcd-3e55-47d4-8c18-7c13b3b7a7bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:08.333842 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf86bcd-3e55-47d4-8c18-7c13b3b7a7bc None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:08.335436 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a439c2-dd6d-4252-a0fe-21f782ff8348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:08.336365 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a439c2-dd6d-4252-a0fe-21f782ff8348 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:08.336696 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a439c2-dd6d-4252-a0fe-21f782ff8348 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:08.337034 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a439c2-dd6d-4252-a0fe-21f782ff8348 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:08.345013 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a439c2-dd6d-4252-a0fe-21f782ff8348 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:08.346584 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a439c2-dd6d-4252-a0fe-21f782ff8348 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:08.357111 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 315/623] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:08.358969 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1321a9-8f58-4a1b-aa1e-1f6beea02b2b None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:08.359444 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1321a9-8f58-4a1b-aa1e-1f6beea02b2b None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:08.359921 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1321a9-8f58-4a1b-aa1e-1f6beea02b2b None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:08.362591 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-69a439c2-dd6d-4252-a0fe-21f782ff8348 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 28 20:39:08.362862 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 316/624] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:39:08.364154 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1321a9-8f58-4a1b-aa1e-1f6beea02b2b None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:08.375778 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 309/625] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:39:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:08.375778 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d927242-1824-4eaf-826b-af670f6c3af6 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:08.375778 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d927242-1824-4eaf-826b-af670f6c3af6 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:08.375778 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d927242-1824-4eaf-826b-af670f6c3af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:08.421357 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-0d927242-1824-4eaf-826b-af670f6c3af6 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:08.425388 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-0d927242-1824-4eaf-826b-af670f6c3af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:08.506221 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1321a9-8f58-4a1b-aa1e-1f6beea02b2b None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:08.546464 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27b533-deb0-4c3c-830e-28a71dbda7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:08.547554 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27b533-deb0-4c3c-830e-28a71dbda7a5 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:08.548019 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27b533-deb0-4c3c-830e-28a71dbda7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:08.548569 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27b533-deb0-4c3c-830e-28a71dbda7a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:08.555536 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 310/626] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:39:08.556663 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d927242-1824-4eaf-826b-af670f6c3af6 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:08.557352 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27b533-deb0-4c3c-830e-28a71dbda7a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:08.559036 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27b533-deb0-4c3c-830e-28a71dbda7a5 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:08.573876 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-0c27b533-deb0-4c3c-830e-28a71dbda7a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 20:39:08.575705 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 317/627] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:39:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:08.587855 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27b533-deb0-4c3c-830e-28a71dbda7a5 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:08.728838 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27b533-deb0-4c3c-830e-28a71dbda7a5 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:08.729817 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d927242-1824-4eaf-826b-af670f6c3af6 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:08.780146 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e683a23-6507-41dc-80ef-6b66c6356941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:08.781087 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e683a23-6507-41dc-80ef-6b66c6356941 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:08.781492 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e683a23-6507-41dc-80ef-6b66c6356941 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:08.782011 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e683a23-6507-41dc-80ef-6b66c6356941 None admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:08.783402 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e683a23-6507-41dc-80ef-6b66c6356941 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:08.783895 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e683a23-6507-41dc-80ef-6b66c6356941 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:08.786807 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e683a23-6507-41dc-80ef-6b66c6356941 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:08.804309 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676815c1-907b-4573-8d14-5d57e7256399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:08.804982 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676815c1-907b-4573-8d14-5d57e7256399 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:08.805266 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676815c1-907b-4573-8d14-5d57e7256399 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:08.805537 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676815c1-907b-4573-8d14-5d57e7256399 None admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:08.806368 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676815c1-907b-4573-8d14-5d57e7256399 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:08.806676 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676815c1-907b-4573-8d14-5d57e7256399 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:08.808191 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676815c1-907b-4573-8d14-5d57e7256399 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:08.816739 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 311/628] 10.222.0.49 () {56 vars in 1137 bytes} [Fri Oct 28 20:39:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:08.816739 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e683a23-6507-41dc-80ef-6b66c6356941 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:08.832494 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 318/629] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 20:39:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:08.832494 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676815c1-907b-4573-8d14-5d57e7256399 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:08.967732 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e683a23-6507-41dc-80ef-6b66c6356941 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:08.975579 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676815c1-907b-4573-8d14-5d57e7256399 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:09.013065 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00df21-4d97-45ed-b2b2-2b1a27f68a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:09.014170 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00df21-4d97-45ed-b2b2-2b1a27f68a9e None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:09.014613 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00df21-4d97-45ed-b2b2-2b1a27f68a9e None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:09.015079 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00df21-4d97-45ed-b2b2-2b1a27f68a9e None admin] PATH_INFO: `/v3/roles/service` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:09.016450 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b764ac5-f529-494d-ac9f-6917ba2e03c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:09.017162 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b764ac5-f529-494d-ac9f-6917ba2e03c7 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:09.017504 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b764ac5-f529-494d-ac9f-6917ba2e03c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:09.017873 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b764ac5-f529-494d-ac9f-6917ba2e03c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:09.030378 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00df21-4d97-45ed-b2b2-2b1a27f68a9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:39:09.041347 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-6e00df21-4d97-45ed-b2b2-2b1a27f68a9e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 20:39:09.043201 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 312/630] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 20:39:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:09.044156 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00df21-4d97-45ed-b2b2-2b1a27f68a9e None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:09.115001 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b764ac5-f529-494d-ac9f-6917ba2e03c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:09.117856 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b764ac5-f529-494d-ac9f-6917ba2e03c7 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:09.171511 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00df21-4d97-45ed-b2b2-2b1a27f68a9e None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:09.209873 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3c730-71d3-47dc-be8a-223115d08470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:09.210762 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3c730-71d3-47dc-be8a-223115d08470 None admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:09.211037 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3c730-71d3-47dc-be8a-223115d08470 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:09.211307 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3c730-71d3-47dc-be8a-223115d08470 None admin] PATH_INFO: `/v3/projects/c55c2ee59af14cf8a7e4275de4f43037/users/91d70db11d2d4923943bc6479bc49206/roles/7190d40a528146289333f0b9c16a6370` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:09.227684 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3c730-71d3-47dc-be8a-223115d08470 None admin] RBAC: Authorizing `identity:create_grant(project_id=c55c2ee59af14cf8a7e4275de4f43037, user_id=91d70db11d2d4923943bc6479bc49206, role_id=7190d40a528146289333f0b9c16a6370)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:09.229188 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3c730-71d3-47dc-be8a-223115d08470 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:09.252327 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 319/631] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:39:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:09.252327 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b764ac5-f529-494d-ac9f-6917ba2e03c7 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:09.252572 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 313/632] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 20:39:09 2022] PUT /identity/v3/projects/c55c2ee59af14cf8a7e4275de4f43037/users/91d70db11d2d4923943bc6479bc49206/roles/7190d40a528146289333f0b9c16a6370 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:39:09.252572 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c654874-5a23-4be4-a580-48f0a7afc884 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:09.252572 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c654874-5a23-4be4-a580-48f0a7afc884 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:09.252572 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c654874-5a23-4be4-a580-48f0a7afc884 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:09.252572 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 314/633] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:39:09.254082 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c654874-5a23-4be4-a580-48f0a7afc884 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:09.389287 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b764ac5-f529-494d-ac9f-6917ba2e03c7 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:09.402212 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c654874-5a23-4be4-a580-48f0a7afc884 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:09.432038 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ac625-b2cd-4ff7-8e98-6bfbea93f57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:09.432834 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ac625-b2cd-4ff7-8e98-6bfbea93f57c None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:09.433182 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ac625-b2cd-4ff7-8e98-6bfbea93f57c None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:09.433526 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ac625-b2cd-4ff7-8e98-6bfbea93f57c None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:09.434464 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ac625-b2cd-4ff7-8e98-6bfbea93f57c None admin] RBAC: Adding query filter params (name=service) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:09.434875 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ac625-b2cd-4ff7-8e98-6bfbea93f57c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:09.436443 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ac625-b2cd-4ff7-8e98-6bfbea93f57c None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:09.446776 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dab93d-08fb-4f3d-b861-74f55ffa2928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:09.447642 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dab93d-08fb-4f3d-b861-74f55ffa2928 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:09.447976 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dab93d-08fb-4f3d-b861-74f55ffa2928 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:09.448290 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dab93d-08fb-4f3d-b861-74f55ffa2928 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:09.454129 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 320/634] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 20:39:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:09.455839 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bc9b5-7e36-418e-afc6-27fb4bf02512 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:09.456671 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bc9b5-7e36-418e-afc6-27fb4bf02512 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:09.457124 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bc9b5-7e36-418e-afc6-27fb4bf02512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:09.462049 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dab93d-08fb-4f3d-b861-74f55ffa2928 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:09.463635 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dab93d-08fb-4f3d-b861-74f55ffa2928 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:09.476143 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-814bc9b5-7e36-418e-afc6-27fb4bf02512 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:09.477175 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-814bc9b5-7e36-418e-afc6-27fb4bf02512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:09.484579 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-c6dab93d-08fb-4f3d-b861-74f55ffa2928 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:09.485790 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 315/635] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:09.486725 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dab93d-08fb-4f3d-b861-74f55ffa2928 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:09.595770 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 321/636] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:39:09.595770 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bc9b5-7e36-418e-afc6-27fb4bf02512 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:09.631568 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dab93d-08fb-4f3d-b861-74f55ffa2928 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:09.671428 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1573ffef-bd84-458e-ace9-7469dece349e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:09.672178 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573ffef-bd84-458e-ace9-7469dece349e None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:09.672451 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573ffef-bd84-458e-ace9-7469dece349e None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:09.672718 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573ffef-bd84-458e-ace9-7469dece349e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:09.686505 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1573ffef-bd84-458e-ace9-7469dece349e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:09.688027 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1573ffef-bd84-458e-ace9-7469dece349e None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:09.707427 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-1573ffef-bd84-458e-ace9-7469dece349e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:09.708964 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 316/637] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:09.710124 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fcc35-20c5-4388-9a07-45d548723ab9 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:09.710406 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fcc35-20c5-4388-9a07-45d548723ab9 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:09.710677 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fcc35-20c5-4388-9a07-45d548723ab9 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:09.712696 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 317/638] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:39:09.718356 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232fcc35-20c5-4388-9a07-45d548723ab9 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:09.745619 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bc9b5-7e36-418e-afc6-27fb4bf02512 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:09.796709 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ea5e5-1f07-49c6-bd82-b5c760f9cedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:09.797372 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ea5e5-1f07-49c6-bd82-b5c760f9cedd None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:09.797651 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ea5e5-1f07-49c6-bd82-b5c760f9cedd None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:09.797924 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ea5e5-1f07-49c6-bd82-b5c760f9cedd None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:09.798657 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ea5e5-1f07-49c6-bd82-b5c760f9cedd None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:09.798959 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ea5e5-1f07-49c6-bd82-b5c760f9cedd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:09.800958 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ea5e5-1f07-49c6-bd82-b5c760f9cedd None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:09.819226 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 322/639] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:09.819226 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ea5e5-1f07-49c6-bd82-b5c760f9cedd None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:09.856154 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232fcc35-20c5-4388-9a07-45d548723ab9 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:09.911085 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa518c1-3572-4433-8a4d-9cf9f49cd68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:09.911927 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa518c1-3572-4433-8a4d-9cf9f49cd68b None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:09.912206 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa518c1-3572-4433-8a4d-9cf9f49cd68b None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:09.912479 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa518c1-3572-4433-8a4d-9cf9f49cd68b None admin] PATH_INFO: `/v3/roles/service` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:09.923374 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa518c1-3572-4433-8a4d-9cf9f49cd68b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:39:09.930905 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-6aa518c1-3572-4433-8a4d-9cf9f49cd68b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 20:39:09.932159 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 318/640] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 20:39:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:09.933363 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb09f08-3406-4f89-a8be-321aca64ad13 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:09.933642 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb09f08-3406-4f89-a8be-321aca64ad13 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:09.933910 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb09f08-3406-4f89-a8be-321aca64ad13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:09.949846 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ea5e5-1f07-49c6-bd82-b5c760f9cedd None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:09.959687 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-bfb09f08-3406-4f89-a8be-321aca64ad13 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:09.961156 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-bfb09f08-3406-4f89-a8be-321aca64ad13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:09.989243 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f779e-3487-4d9f-b4e8-bef37fa6c52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:09.989913 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f779e-3487-4d9f-b4e8-bef37fa6c52d None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:09.990203 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f779e-3487-4d9f-b4e8-bef37fa6c52d None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:09.990485 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f779e-3487-4d9f-b4e8-bef37fa6c52d None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:09.991553 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f779e-3487-4d9f-b4e8-bef37fa6c52d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:09.991913 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f779e-3487-4d9f-b4e8-bef37fa6c52d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:09.993310 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f779e-3487-4d9f-b4e8-bef37fa6c52d None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:10.006313 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 323/641] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:10.007177 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f779e-3487-4d9f-b4e8-bef37fa6c52d None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:10.057204 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 319/642] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:39:10.057995 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb09f08-3406-4f89-a8be-321aca64ad13 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:10.133301 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f779e-3487-4d9f-b4e8-bef37fa6c52d None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:10.172116 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d0df6-feb3-4558-8a6a-eaae62e16a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:10.172929 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d0df6-feb3-4558-8a6a-eaae62e16a71 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:10.173208 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d0df6-feb3-4558-8a6a-eaae62e16a71 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:10.173531 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d0df6-feb3-4558-8a6a-eaae62e16a71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:10.186304 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d0df6-feb3-4558-8a6a-eaae62e16a71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:10.189169 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d0df6-feb3-4558-8a6a-eaae62e16a71 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:10.199356 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb09f08-3406-4f89-a8be-321aca64ad13 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:10.213654 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-004d0df6-feb3-4558-8a6a-eaae62e16a71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 20:39:10.215246 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 324/643] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:39:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:10.216610 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d0df6-feb3-4558-8a6a-eaae62e16a71 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:10.261156 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fb442-8d83-4a85-9120-e302b89045b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:10.262808 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fb442-8d83-4a85-9120-e302b89045b6 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:10.263376 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fb442-8d83-4a85-9120-e302b89045b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:10.263863 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fb442-8d83-4a85-9120-e302b89045b6 None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:10.265135 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2fb442-8d83-4a85-9120-e302b89045b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:10.265609 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2fb442-8d83-4a85-9120-e302b89045b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:10.268049 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2fb442-8d83-4a85-9120-e302b89045b6 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:10.284909 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 320/644] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 20:39:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:10.286261 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fb442-8d83-4a85-9120-e302b89045b6 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:10.340584 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d0df6-feb3-4558-8a6a-eaae62e16a71 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:10.379930 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b8148-a04f-4cbb-9e3d-eaaa802cd70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:10.380748 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b8148-a04f-4cbb-9e3d-eaaa802cd70c None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:10.381019 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b8148-a04f-4cbb-9e3d-eaaa802cd70c None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:10.381284 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b8148-a04f-4cbb-9e3d-eaaa802cd70c None admin] PATH_INFO: `/v3/users/nova` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:10.390328 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b8148-a04f-4cbb-9e3d-eaaa802cd70c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:10.391850 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b8148-a04f-4cbb-9e3d-eaaa802cd70c None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:10.406419 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-059b8148-a04f-4cbb-9e3d-eaaa802cd70c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 20:39:10.411922 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 325/645] 10.222.0.49 () {56 vars in 1093 bytes} [Fri Oct 28 20:39:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:10.411922 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b8148-a04f-4cbb-9e3d-eaaa802cd70c None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:10.425682 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fb442-8d83-4a85-9120-e302b89045b6 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:10.463599 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c6599-41d9-48ce-8707-913bb8fc86f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:10.464768 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c6599-41d9-48ce-8707-913bb8fc86f9 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:10.465276 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c6599-41d9-48ce-8707-913bb8fc86f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:10.465617 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c6599-41d9-48ce-8707-913bb8fc86f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:10.477193 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c6599-41d9-48ce-8707-913bb8fc86f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:39:10.484410 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-c76c6599-41d9-48ce-8707-913bb8fc86f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 20:39:10.491415 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 321/646] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 20:39:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:10.491415 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c6599-41d9-48ce-8707-913bb8fc86f9 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:10.523345 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b8148-a04f-4cbb-9e3d-eaaa802cd70c None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:10.562170 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c4ff7-e563-49ed-8985-2e2a72998b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:10.562848 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c4ff7-e563-49ed-8985-2e2a72998b81 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:10.563124 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c4ff7-e563-49ed-8985-2e2a72998b81 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:10.563395 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c4ff7-e563-49ed-8985-2e2a72998b81 None admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:10.564233 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c4ff7-e563-49ed-8985-2e2a72998b81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:10.564545 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c4ff7-e563-49ed-8985-2e2a72998b81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:10.566119 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c4ff7-e563-49ed-8985-2e2a72998b81 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:10.579393 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 326/647] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 20:39:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:10.581318 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c4ff7-e563-49ed-8985-2e2a72998b81 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:10.604256 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c6599-41d9-48ce-8707-913bb8fc86f9 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:10.644789 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b7985-f659-491d-a3d1-02a30c41eace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:10.645596 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b7985-f659-491d-a3d1-02a30c41eace None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:10.645877 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b7985-f659-491d-a3d1-02a30c41eace None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:10.646151 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b7985-f659-491d-a3d1-02a30c41eace None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:10.661296 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b7985-f659-491d-a3d1-02a30c41eace None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:10.663834 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b7985-f659-491d-a3d1-02a30c41eace None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:10.695109 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-4d3b7985-f659-491d-a3d1-02a30c41eace None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:10.704803 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 322/648] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:10.704803 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b7985-f659-491d-a3d1-02a30c41eace None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:10.726546 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c4ff7-e563-49ed-8985-2e2a72998b81 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:10.786528 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd60e5f-c084-415a-bcb0-ab50490b3965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:10.787686 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd60e5f-c084-415a-bcb0-ab50490b3965 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:10.788234 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd60e5f-c084-415a-bcb0-ab50490b3965 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:10.788732 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd60e5f-c084-415a-bcb0-ab50490b3965 None admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:10.790353 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd60e5f-c084-415a-bcb0-ab50490b3965 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:10.790912 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd60e5f-c084-415a-bcb0-ab50490b3965 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:10.793765 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd60e5f-c084-415a-bcb0-ab50490b3965 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:10.827788 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 327/649] 10.222.0.49 () {56 vars in 1133 bytes} [Fri Oct 28 20:39:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:10.827788 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd60e5f-c084-415a-bcb0-ab50490b3965 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:10.861162 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b7985-f659-491d-a3d1-02a30c41eace None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:10.903953 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7adfd-a87e-44ab-9b49-5fd72fed0525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:10.904637 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7adfd-a87e-44ab-9b49-5fd72fed0525 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:10.904913 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7adfd-a87e-44ab-9b49-5fd72fed0525 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:10.905183 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7adfd-a87e-44ab-9b49-5fd72fed0525 None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:10.905954 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7adfd-a87e-44ab-9b49-5fd72fed0525 None admin] RBAC: Adding query filter params (name=service) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:10.906309 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7adfd-a87e-44ab-9b49-5fd72fed0525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:10.907677 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7adfd-a87e-44ab-9b49-5fd72fed0525 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:10.925894 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 323/650] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 20:39:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:10.925894 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7adfd-a87e-44ab-9b49-5fd72fed0525 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:10.994597 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd60e5f-c084-415a-bcb0-ab50490b3965 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:11.043651 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13db7a5-5fb5-4885-a029-213cbdf84ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:11.044831 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13db7a5-5fb5-4885-a029-213cbdf84ecc None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:11.045326 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13db7a5-5fb5-4885-a029-213cbdf84ecc None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:11.045822 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13db7a5-5fb5-4885-a029-213cbdf84ecc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:11.047463 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13db7a5-5fb5-4885-a029-213cbdf84ecc None admin] RBAC: Adding query filter params (role.id=7190d40a528146289333f0b9c16a6370, scope.project.id=c55c2ee59af14cf8a7e4275de4f43037, user.id=05029a41bd2b42febfd5ce91a3f28c24) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:11.048042 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13db7a5-5fb5-4885-a029-213cbdf84ecc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:11.050417 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7adfd-a87e-44ab-9b49-5fd72fed0525 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:11.050866 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13db7a5-5fb5-4885-a029-213cbdf84ecc None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:11.069700 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 328/651] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:39:10 2022] GET /identity/v3/role_assignments?user.id=05029a41bd2b42febfd5ce91a3f28c24&scope.project.id=c55c2ee59af14cf8a7e4275de4f43037&role.id=7190d40a528146289333f0b9c16a6370 => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:11.069700 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13db7a5-5fb5-4885-a029-213cbdf84ecc None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:11.089184 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2cf7b-e82a-48e3-a206-083179d4e50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:11.089869 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2cf7b-e82a-48e3-a206-083179d4e50e None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:11.090149 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2cf7b-e82a-48e3-a206-083179d4e50e None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:11.090415 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2cf7b-e82a-48e3-a206-083179d4e50e None admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:11.091180 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2cf7b-e82a-48e3-a206-083179d4e50e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:11.091475 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2cf7b-e82a-48e3-a206-083179d4e50e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:11.092943 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2cf7b-e82a-48e3-a206-083179d4e50e None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:11.107722 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 324/652] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:11.108633 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2cf7b-e82a-48e3-a206-083179d4e50e None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:11.228980 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2cf7b-e82a-48e3-a206-083179d4e50e None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:11.270151 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc05b8e-01aa-42d6-8a15-d7609d433911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:11.270949 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc05b8e-01aa-42d6-8a15-d7609d433911 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:11.271286 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc05b8e-01aa-42d6-8a15-d7609d433911 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:11.271592 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc05b8e-01aa-42d6-8a15-d7609d433911 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:11.283387 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc05b8e-01aa-42d6-8a15-d7609d433911 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:11.285757 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc05b8e-01aa-42d6-8a15-d7609d433911 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:11.286064 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13db7a5-5fb5-4885-a029-213cbdf84ecc None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:11.305470 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-2bc05b8e-01aa-42d6-8a15-d7609d433911 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:11.307057 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 325/653] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:11.307948 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc05b8e-01aa-42d6-8a15-d7609d433911 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:11.363491 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d81bc1-006a-4ad9-ae7a-41716bc938a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:11.364670 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d81bc1-006a-4ad9-ae7a-41716bc938a5 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:11.365159 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d81bc1-006a-4ad9-ae7a-41716bc938a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:11.365645 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d81bc1-006a-4ad9-ae7a-41716bc938a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:11.459394 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc05b8e-01aa-42d6-8a15-d7609d433911 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:11.494171 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d81bc1-006a-4ad9-ae7a-41716bc938a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:11.494461 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d81bc1-006a-4ad9-ae7a-41716bc938a5 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:11.517092 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2e4eb-97ce-4e1d-a7dd-ffb5fb8e6824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:11.517877 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2e4eb-97ce-4e1d-a7dd-ffb5fb8e6824 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:11.518156 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2e4eb-97ce-4e1d-a7dd-ffb5fb8e6824 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:11.518461 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2e4eb-97ce-4e1d-a7dd-ffb5fb8e6824 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:11.528393 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2e4eb-97ce-4e1d-a7dd-ffb5fb8e6824 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:11.529780 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2e4eb-97ce-4e1d-a7dd-ffb5fb8e6824 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:11.548712 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-a2a2e4eb-97ce-4e1d-a7dd-ffb5fb8e6824 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 20:39:11.551285 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 326/654] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:39:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:11.552160 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2e4eb-97ce-4e1d-a7dd-ffb5fb8e6824 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:11.692318 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 329/655] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:39:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:11.692318 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d81bc1-006a-4ad9-ae7a-41716bc938a5 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:11.719192 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2e4eb-97ce-4e1d-a7dd-ffb5fb8e6824 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:11.757341 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ceda43-8d61-4292-91a0-f6fbbd9dcdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:11.758382 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ceda43-8d61-4292-91a0-f6fbbd9dcdaf None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:11.758859 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ceda43-8d61-4292-91a0-f6fbbd9dcdaf None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:11.759347 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ceda43-8d61-4292-91a0-f6fbbd9dcdaf None admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:11.760336 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ceda43-8d61-4292-91a0-f6fbbd9dcdaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:11.760842 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ceda43-8d61-4292-91a0-f6fbbd9dcdaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:11.762452 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ceda43-8d61-4292-91a0-f6fbbd9dcdaf None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:11.776881 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 327/656] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:11.778070 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ceda43-8d61-4292-91a0-f6fbbd9dcdaf None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:11.872955 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d81bc1-006a-4ad9-ae7a-41716bc938a5 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:11.926778 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d240593-bdab-412a-9e53-9968168b5f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:11.927886 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d240593-bdab-412a-9e53-9968168b5f63 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:11.928369 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d240593-bdab-412a-9e53-9968168b5f63 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:11.928763 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d240593-bdab-412a-9e53-9968168b5f63 None admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:11.929748 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d240593-bdab-412a-9e53-9968168b5f63 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:11.930167 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d240593-bdab-412a-9e53-9968168b5f63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:11.932030 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d240593-bdab-412a-9e53-9968168b5f63 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:11.945957 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ceda43-8d61-4292-91a0-f6fbbd9dcdaf None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:11.962179 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 330/657] 10.222.0.49 () {56 vars in 1137 bytes} [Fri Oct 28 20:39:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:11.962179 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d240593-bdab-412a-9e53-9968168b5f63 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:11.987144 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5e95b-6d13-4a3f-be29-07e7fc5cbec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:11.988786 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5e95b-6d13-4a3f-be29-07e7fc5cbec8 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:11.989157 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5e95b-6d13-4a3f-be29-07e7fc5cbec8 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:11.989428 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5e95b-6d13-4a3f-be29-07e7fc5cbec8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:12.001052 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5e95b-6d13-4a3f-be29-07e7fc5cbec8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:12.002526 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5e95b-6d13-4a3f-be29-07e7fc5cbec8 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:12.022917 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-04d5e95b-6d13-4a3f-be29-07e7fc5cbec8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:12.029208 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 328/658] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:12.029208 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f82c8f-97ae-4a29-b4d7-356e2a457d11 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:12.029208 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f82c8f-97ae-4a29-b4d7-356e2a457d11 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:12.029208 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f82c8f-97ae-4a29-b4d7-356e2a457d11 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:12.029208 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 329/659] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:39:12.029208 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f82c8f-97ae-4a29-b4d7-356e2a457d11 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:12.122874 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d240593-bdab-412a-9e53-9968168b5f63 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:12.178697 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a673ff9-87a8-4e3f-9322-02ebf700fda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:12.179941 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a673ff9-87a8-4e3f-9322-02ebf700fda7 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:12.180390 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a673ff9-87a8-4e3f-9322-02ebf700fda7 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:12.180866 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a673ff9-87a8-4e3f-9322-02ebf700fda7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:12.187792 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f82c8f-97ae-4a29-b4d7-356e2a457d11 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:12.191164 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a673ff9-87a8-4e3f-9322-02ebf700fda7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:12.193327 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a673ff9-87a8-4e3f-9322-02ebf700fda7 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:12.210490 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-2a673ff9-87a8-4e3f-9322-02ebf700fda7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 20:39:12.212019 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 331/660] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 20:39:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:12.212550 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a673ff9-87a8-4e3f-9322-02ebf700fda7 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:12.243197 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189246f-7e92-4c51-a434-6b64d3121af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:12.244198 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189246f-7e92-4c51-a434-6b64d3121af1 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:12.244610 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189246f-7e92-4c51-a434-6b64d3121af1 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:12.245080 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189246f-7e92-4c51-a434-6b64d3121af1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:12.335931 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8189246f-7e92-4c51-a434-6b64d3121af1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:12.337522 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8189246f-7e92-4c51-a434-6b64d3121af1 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:12.351907 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a673ff9-87a8-4e3f-9322-02ebf700fda7 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:12.399432 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a77ca5-e24f-4db1-aa6b-cb112c3735e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:12.400147 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a77ca5-e24f-4db1-aa6b-cb112c3735e7 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:12.400423 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a77ca5-e24f-4db1-aa6b-cb112c3735e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:12.400693 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a77ca5-e24f-4db1-aa6b-cb112c3735e7 None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:12.401454 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a77ca5-e24f-4db1-aa6b-cb112c3735e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:12.401755 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a77ca5-e24f-4db1-aa6b-cb112c3735e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:12.403186 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a77ca5-e24f-4db1-aa6b-cb112c3735e7 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:12.421024 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 332/661] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:12.422167 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e342e2b-7a42-4b28-88b1-9be60d4a4131 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:12.422507 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e342e2b-7a42-4b28-88b1-9be60d4a4131 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:12.422781 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e342e2b-7a42-4b28-88b1-9be60d4a4131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:12.441685 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-3e342e2b-7a42-4b28-88b1-9be60d4a4131 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:12.442840 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-3e342e2b-7a42-4b28-88b1-9be60d4a4131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:12.486534 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 330/662] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:39:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:12.486534 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189246f-7e92-4c51-a434-6b64d3121af1 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:12.539799 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 333/663] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:39:12.539799 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e342e2b-7a42-4b28-88b1-9be60d4a4131 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:12.625257 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189246f-7e92-4c51-a434-6b64d3121af1 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:12.685732 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf506d-a955-4e8c-8cab-5f7643686836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:12.686737 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf506d-a955-4e8c-8cab-5f7643686836 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:12.687542 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf506d-a955-4e8c-8cab-5f7643686836 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:12.688033 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf506d-a955-4e8c-8cab-5f7643686836 None admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:12.689455 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf506d-a955-4e8c-8cab-5f7643686836 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:12.689884 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf506d-a955-4e8c-8cab-5f7643686836 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:12.693652 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf506d-a955-4e8c-8cab-5f7643686836 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:12.702101 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e342e2b-7a42-4b28-88b1-9be60d4a4131 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:12.723007 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 331/664] 10.222.0.49 () {56 vars in 1139 bytes} [Fri Oct 28 20:39:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:12.725789 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf506d-a955-4e8c-8cab-5f7643686836 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:12.755543 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b802d9b-e061-4e10-86bd-c5ea0706599c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:12.757047 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b802d9b-e061-4e10-86bd-c5ea0706599c None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:12.757470 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b802d9b-e061-4e10-86bd-c5ea0706599c None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:12.758023 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b802d9b-e061-4e10-86bd-c5ea0706599c None admin] PATH_INFO: `/v3/projects/service` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:12.769143 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b802d9b-e061-4e10-86bd-c5ea0706599c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:12.771901 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b802d9b-e061-4e10-86bd-c5ea0706599c None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:12.796823 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-2b802d9b-e061-4e10-86bd-c5ea0706599c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 20:39:12.798742 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 334/665] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:39:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:12.800793 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b802d9b-e061-4e10-86bd-c5ea0706599c None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:12.878435 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf506d-a955-4e8c-8cab-5f7643686836 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:12.935474 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124cd756-70ff-4985-8499-0c198d688619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:12.937242 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cd756-70ff-4985-8499-0c198d688619 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:12.937946 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cd756-70ff-4985-8499-0c198d688619 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:12.938645 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cd756-70ff-4985-8499-0c198d688619 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:12.953014 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b802d9b-e061-4e10-86bd-c5ea0706599c None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:12.958782 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124cd756-70ff-4985-8499-0c198d688619 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:12.961611 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124cd756-70ff-4985-8499-0c198d688619 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:12.986876 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-124cd756-70ff-4985-8499-0c198d688619 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:12.996901 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 332/666] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:12.996901 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124cd756-70ff-4985-8499-0c198d688619 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:13.009901 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb1b86-a0e5-4596-b206-a9a026f95998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:13.011256 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb1b86-a0e5-4596-b206-a9a026f95998 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:13.011764 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb1b86-a0e5-4596-b206-a9a026f95998 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:13.012249 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb1b86-a0e5-4596-b206-a9a026f95998 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:13.031561 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb1b86-a0e5-4596-b206-a9a026f95998 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:39:13.046244 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-19fb1b86-a0e5-4596-b206-a9a026f95998 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 20:39:13.048928 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 335/667] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 20:39:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:13.051127 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb1b86-a0e5-4596-b206-a9a026f95998 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:13.114743 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124cd756-70ff-4985-8499-0c198d688619 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:13.170130 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa28cf-812b-4688-b70d-77f7af296329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:13.171568 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa28cf-812b-4688-b70d-77f7af296329 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:13.172258 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa28cf-812b-4688-b70d-77f7af296329 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:13.173003 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa28cf-812b-4688-b70d-77f7af296329 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:13.208329 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb1b86-a0e5-4596-b206-a9a026f95998 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:13.261484 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f34e52-258b-4ffe-89d3-daec6a7a465d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:13.262757 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f34e52-258b-4ffe-89d3-daec6a7a465d None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:13.263338 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f34e52-258b-4ffe-89d3-daec6a7a465d None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:13.263898 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f34e52-258b-4ffe-89d3-daec6a7a465d None admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:13.265398 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f34e52-258b-4ffe-89d3-daec6a7a465d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:13.266026 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f34e52-258b-4ffe-89d3-daec6a7a465d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:13.269465 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f34e52-258b-4ffe-89d3-daec6a7a465d None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:13.290638 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 336/668] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 20:39:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:13.291767 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f34e52-258b-4ffe-89d3-daec6a7a465d None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:13.300530 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa28cf-812b-4688-b70d-77f7af296329 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:13.303872 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa28cf-812b-4688-b70d-77f7af296329 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:13.448160 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 333/669] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:39:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:13.449780 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa28cf-812b-4688-b70d-77f7af296329 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:13.469767 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f34e52-258b-4ffe-89d3-daec6a7a465d None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:13.519330 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504caa1-5b2d-47ed-b9b4-4e7bb93d2962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:13.520770 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504caa1-5b2d-47ed-b9b4-4e7bb93d2962 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:13.521045 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504caa1-5b2d-47ed-b9b4-4e7bb93d2962 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:13.521321 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504caa1-5b2d-47ed-b9b4-4e7bb93d2962 None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:13.522075 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9504caa1-5b2d-47ed-b9b4-4e7bb93d2962 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:13.522378 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9504caa1-5b2d-47ed-b9b4-4e7bb93d2962 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:13.523852 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9504caa1-5b2d-47ed-b9b4-4e7bb93d2962 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:13.541633 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 337/670] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:13.543126 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504caa1-5b2d-47ed-b9b4-4e7bb93d2962 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:13.628803 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa28cf-812b-4688-b70d-77f7af296329 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:13.680666 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f680b-d893-4213-b3cb-6d36416a776c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:13.681339 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f680b-d893-4213-b3cb-6d36416a776c None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:13.682158 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f680b-d893-4213-b3cb-6d36416a776c None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:13.682433 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f680b-d893-4213-b3cb-6d36416a776c None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:13.683214 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f680b-d893-4213-b3cb-6d36416a776c None admin] RBAC: Adding query filter params (name=service) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:13.683512 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f680b-d893-4213-b3cb-6d36416a776c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:13.685802 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f680b-d893-4213-b3cb-6d36416a776c None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:13.703254 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 334/671] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 20:39:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:13.704097 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f680b-d893-4213-b3cb-6d36416a776c None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:13.720441 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504caa1-5b2d-47ed-b9b4-4e7bb93d2962 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:13.773842 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf098e-7563-4e17-af19-9f60a8e3cf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:13.775062 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf098e-7563-4e17-af19-9f60a8e3cf77 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:13.775511 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf098e-7563-4e17-af19-9f60a8e3cf77 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:13.776024 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf098e-7563-4e17-af19-9f60a8e3cf77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:13.777547 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf098e-7563-4e17-af19-9f60a8e3cf77 None admin] RBAC: Adding query filter params (role.id=7190d40a528146289333f0b9c16a6370, scope.project.id=c55c2ee59af14cf8a7e4275de4f43037, user.id=04bc6ee009e34a5f82e2807db51523d3) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:13.778074 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf098e-7563-4e17-af19-9f60a8e3cf77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:13.780660 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf098e-7563-4e17-af19-9f60a8e3cf77 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:13.800481 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 338/672] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:39:13 2022] GET /identity/v3/role_assignments?user.id=04bc6ee009e34a5f82e2807db51523d3&scope.project.id=c55c2ee59af14cf8a7e4275de4f43037&role.id=7190d40a528146289333f0b9c16a6370 => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:13.800481 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf098e-7563-4e17-af19-9f60a8e3cf77 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:13.873465 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f680b-d893-4213-b3cb-6d36416a776c None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:13.920177 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7170d-ad87-4bcc-850b-efb3b8c497aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:13.921831 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7170d-ad87-4bcc-850b-efb3b8c497aa None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:13.922447 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7170d-ad87-4bcc-850b-efb3b8c497aa None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:13.922930 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7170d-ad87-4bcc-850b-efb3b8c497aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:13.944600 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7170d-ad87-4bcc-850b-efb3b8c497aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:13.947470 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7170d-ad87-4bcc-850b-efb3b8c497aa None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:13.961008 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf098e-7563-4e17-af19-9f60a8e3cf77 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:13.980638 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-1ee7170d-ad87-4bcc-850b-efb3b8c497aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:13.988887 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 335/673] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:13.990512 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7170d-ad87-4bcc-850b-efb3b8c497aa None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:14.002649 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4637520-c051-4d6a-9a80-d4aaaceedc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:14.004304 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4637520-c051-4d6a-9a80-d4aaaceedc0b None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:14.004650 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4637520-c051-4d6a-9a80-d4aaaceedc0b None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:14.004986 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4637520-c051-4d6a-9a80-d4aaaceedc0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:14.013133 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4637520-c051-4d6a-9a80-d4aaaceedc0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:14.014876 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4637520-c051-4d6a-9a80-d4aaaceedc0b None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:14.030219 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-d4637520-c051-4d6a-9a80-d4aaaceedc0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 20:39:14.031847 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 339/674] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:39:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:14.032679 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4637520-c051-4d6a-9a80-d4aaaceedc0b None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:14.166138 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7170d-ad87-4bcc-850b-efb3b8c497aa None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:14.197490 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4637520-c051-4d6a-9a80-d4aaaceedc0b None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:14.205451 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3ad5b-52e1-40f2-b90f-7b899a020045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:14.206857 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3ad5b-52e1-40f2-b90f-7b899a020045 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:14.207137 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3ad5b-52e1-40f2-b90f-7b899a020045 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:14.207397 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3ad5b-52e1-40f2-b90f-7b899a020045 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:14.219665 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f3ad5b-52e1-40f2-b90f-7b899a020045 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:14.221194 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f3ad5b-52e1-40f2-b90f-7b899a020045 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:14.241978 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-23f3ad5b-52e1-40f2-b90f-7b899a020045 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:14.250655 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 336/675] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:14.250655 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3ad5b-52e1-40f2-b90f-7b899a020045 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:14.278438 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b9cd6-c7de-4729-9419-00d836ad0765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:14.280277 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b9cd6-c7de-4729-9419-00d836ad0765 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:14.281003 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b9cd6-c7de-4729-9419-00d836ad0765 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:14.281680 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b9cd6-c7de-4729-9419-00d836ad0765 None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:14.283269 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b9cd6-c7de-4729-9419-00d836ad0765 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:14.284656 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b9cd6-c7de-4729-9419-00d836ad0765 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:14.287835 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b9cd6-c7de-4729-9419-00d836ad0765 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:14.310462 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 340/676] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:14.313108 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ea70a-9835-45d6-9a90-c69b3521ef65 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:14.313575 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ea70a-9835-45d6-9a90-c69b3521ef65 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:14.314048 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ea70a-9835-45d6-9a90-c69b3521ef65 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:14.318419 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 341/677] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:39:14.319883 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ea70a-9835-45d6-9a90-c69b3521ef65 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:14.390099 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3ad5b-52e1-40f2-b90f-7b899a020045 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:14.447044 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af190908-add9-47ab-8031-a997cce98f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:14.447942 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af190908-add9-47ab-8031-a997cce98f5f None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:14.448395 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af190908-add9-47ab-8031-a997cce98f5f None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:14.448861 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af190908-add9-47ab-8031-a997cce98f5f None admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:14.450255 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af190908-add9-47ab-8031-a997cce98f5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:14.450776 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af190908-add9-47ab-8031-a997cce98f5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:14.453664 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af190908-add9-47ab-8031-a997cce98f5f None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:14.476925 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 337/678] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 20:39:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:14.478734 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af190908-add9-47ab-8031-a997cce98f5f None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:14.490880 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ea70a-9835-45d6-9a90-c69b3521ef65 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:14.541118 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab1443-b81a-404c-9bcb-b87b36075190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:14.541916 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab1443-b81a-404c-9bcb-b87b36075190 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:14.542318 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab1443-b81a-404c-9bcb-b87b36075190 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:14.543254 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab1443-b81a-404c-9bcb-b87b36075190 None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:14.544180 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab1443-b81a-404c-9bcb-b87b36075190 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:14.544618 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab1443-b81a-404c-9bcb-b87b36075190 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:14.546647 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab1443-b81a-404c-9bcb-b87b36075190 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:14.561829 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 342/679] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:14.563499 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a24772-b843-417c-88c6-2fc59cdf7020 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:14.564038 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a24772-b843-417c-88c6-2fc59cdf7020 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:14.564534 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a24772-b843-417c-88c6-2fc59cdf7020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:14.589997 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-06a24772-b843-417c-88c6-2fc59cdf7020 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:14.591765 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-06a24772-b843-417c-88c6-2fc59cdf7020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:14.653112 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af190908-add9-47ab-8031-a997cce98f5f None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:14.704727 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66f002-3035-4987-ace5-240b53a04388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:14.706132 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66f002-3035-4987-ace5-240b53a04388 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:14.706730 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66f002-3035-4987-ace5-240b53a04388 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:14.707211 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66f002-3035-4987-ace5-240b53a04388 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:14.716265 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 343/680] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:39:14.727790 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a24772-b843-417c-88c6-2fc59cdf7020 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:14.730920 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66f002-3035-4987-ace5-240b53a04388 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:14.734975 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66f002-3035-4987-ace5-240b53a04388 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:14.762671 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-0b66f002-3035-4987-ace5-240b53a04388 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 20:39:14.764714 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 338/681] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:39:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:14.769623 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66f002-3035-4987-ace5-240b53a04388 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:14.894602 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a24772-b843-417c-88c6-2fc59cdf7020 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:14.921460 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66f002-3035-4987-ace5-240b53a04388 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:14.935863 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d592e7b-77b6-416b-927f-3edb56181fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:14.936526 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d592e7b-77b6-416b-927f-3edb56181fd1 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:14.936809 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d592e7b-77b6-416b-927f-3edb56181fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:14.937111 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d592e7b-77b6-416b-927f-3edb56181fd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:14.937911 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d592e7b-77b6-416b-927f-3edb56181fd1 None admin] RBAC: Adding query filter params (role.id=7190d40a528146289333f0b9c16a6370, scope.project.id=c55c2ee59af14cf8a7e4275de4f43037, user.id=f305aece531c412b9e0ac30be9f47667) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:14.938220 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d592e7b-77b6-416b-927f-3edb56181fd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:14.939677 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d592e7b-77b6-416b-927f-3edb56181fd1 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:14.952264 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 344/682] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:39:14 2022] GET /identity/v3/role_assignments?user.id=f305aece531c412b9e0ac30be9f47667&scope.project.id=c55c2ee59af14cf8a7e4275de4f43037&role.id=7190d40a528146289333f0b9c16a6370 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:14.954010 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d592e7b-77b6-416b-927f-3edb56181fd1 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:14.989820 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e66df-7da7-4a71-adcd-60ca49a80736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:14.992250 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e66df-7da7-4a71-adcd-60ca49a80736 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:14.993020 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e66df-7da7-4a71-adcd-60ca49a80736 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:14.993772 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e66df-7da7-4a71-adcd-60ca49a80736 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:15.009196 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e66df-7da7-4a71-adcd-60ca49a80736 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:15.012504 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e66df-7da7-4a71-adcd-60ca49a80736 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:15.041367 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-7b4e66df-7da7-4a71-adcd-60ca49a80736 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 20:39:15.044086 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 339/683] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 20:39:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:15.045955 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e66df-7da7-4a71-adcd-60ca49a80736 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:15.159608 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d592e7b-77b6-416b-927f-3edb56181fd1 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:15.237285 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e66df-7da7-4a71-adcd-60ca49a80736 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:15.238283 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e91202-dd13-42f5-852f-b519a25b4429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:15.240980 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e91202-dd13-42f5-852f-b519a25b4429 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:15.241398 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e91202-dd13-42f5-852f-b519a25b4429 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:15.241765 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e91202-dd13-42f5-852f-b519a25b4429 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:15.265612 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e91202-dd13-42f5-852f-b519a25b4429 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:15.270737 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e91202-dd13-42f5-852f-b519a25b4429 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:15.287046 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4c4e2-5c01-404f-883c-ddb9860eb6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:15.287912 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4c4e2-5c01-404f-883c-ddb9860eb6c7 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:15.288283 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4c4e2-5c01-404f-883c-ddb9860eb6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:15.288655 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4c4e2-5c01-404f-883c-ddb9860eb6c7 None admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:15.289570 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4c4e2-5c01-404f-883c-ddb9860eb6c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:15.289977 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4c4e2-5c01-404f-883c-ddb9860eb6c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:15.291622 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4c4e2-5c01-404f-883c-ddb9860eb6c7 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:15.297229 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-a8e91202-dd13-42f5-852f-b519a25b4429 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:15.299722 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 345/684] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:15.301735 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e91202-dd13-42f5-852f-b519a25b4429 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:15.317296 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 340/685] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 20:39:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:15.323985 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4c4e2-5c01-404f-883c-ddb9860eb6c7 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:15.454665 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4c4e2-5c01-404f-883c-ddb9860eb6c7 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:15.508571 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e91202-dd13-42f5-852f-b519a25b4429 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:15.512890 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb19386-06ad-4567-b123-b4bc6ad8f7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:15.513557 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb19386-06ad-4567-b123-b4bc6ad8f7ad None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:15.513832 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb19386-06ad-4567-b123-b4bc6ad8f7ad None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:15.514102 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb19386-06ad-4567-b123-b4bc6ad8f7ad None admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:15.514823 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb19386-06ad-4567-b123-b4bc6ad8f7ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:15.515128 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb19386-06ad-4567-b123-b4bc6ad8f7ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:15.516596 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb19386-06ad-4567-b123-b4bc6ad8f7ad None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:15.530976 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 341/686] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:15.531882 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb19386-06ad-4567-b123-b4bc6ad8f7ad None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:15.590952 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44fd37-adec-4234-8737-7763b52157f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:15.592385 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44fd37-adec-4234-8737-7763b52157f2 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:15.593434 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44fd37-adec-4234-8737-7763b52157f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:15.593933 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44fd37-adec-4234-8737-7763b52157f2 None admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:15.596077 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec44fd37-adec-4234-8737-7763b52157f2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:15.597094 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec44fd37-adec-4234-8737-7763b52157f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:15.599897 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec44fd37-adec-4234-8737-7763b52157f2 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:15.621046 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 346/687] 10.222.0.49 () {56 vars in 1135 bytes} [Fri Oct 28 20:39:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:15.621956 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44fd37-adec-4234-8737-7763b52157f2 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:15.689246 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb19386-06ad-4567-b123-b4bc6ad8f7ad None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:15.746077 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44fd37-adec-4234-8737-7763b52157f2 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:15.754845 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb12976-71a9-4fc0-9d39-bc7749b16308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:15.756217 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb12976-71a9-4fc0-9d39-bc7749b16308 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:15.756828 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb12976-71a9-4fc0-9d39-bc7749b16308 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:15.757427 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb12976-71a9-4fc0-9d39-bc7749b16308 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:15.759217 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb12976-71a9-4fc0-9d39-bc7749b16308 None admin] RBAC: Adding query filter params (role.id=7190d40a528146289333f0b9c16a6370, scope.project.id=c55c2ee59af14cf8a7e4275de4f43037, user.id=691a2da563a84da48ca8fd75a0bfe787) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:15.759897 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb12976-71a9-4fc0-9d39-bc7749b16308 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:15.762783 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb12976-71a9-4fc0-9d39-bc7749b16308 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:15.782321 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 342/688] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:39:15 2022] GET /identity/v3/role_assignments?user.id=691a2da563a84da48ca8fd75a0bfe787&scope.project.id=c55c2ee59af14cf8a7e4275de4f43037&role.id=7190d40a528146289333f0b9c16a6370 => generated 608 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:15.784815 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb12976-71a9-4fc0-9d39-bc7749b16308 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:15.790583 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98908e55-e325-4cc8-a17d-1aa6fb1d4e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:15.791280 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98908e55-e325-4cc8-a17d-1aa6fb1d4e58 None admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:15.791557 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98908e55-e325-4cc8-a17d-1aa6fb1d4e58 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:15.791981 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98908e55-e325-4cc8-a17d-1aa6fb1d4e58 None admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:15.792708 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98908e55-e325-4cc8-a17d-1aa6fb1d4e58 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:15.794175 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98908e55-e325-4cc8-a17d-1aa6fb1d4e58 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:15.839207 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 347/689] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Oct 28 20:39:15 2022] POST /identity/v3/users => generated 254 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:39:15.926852 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb12976-71a9-4fc0-9d39-bc7749b16308 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:15.969050 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5585f38-9bb5-4878-9c4b-06080f75a4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:15.969723 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5585f38-9bb5-4878-9c4b-06080f75a4f2 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:15.970001 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5585f38-9bb5-4878-9c4b-06080f75a4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:15.970345 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5585f38-9bb5-4878-9c4b-06080f75a4f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:16.056697 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5585f38-9bb5-4878-9c4b-06080f75a4f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:16.058133 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5585f38-9bb5-4878-9c4b-06080f75a4f2 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:16.183902 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 343/690] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:39:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:16.189747 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98908e55-e325-4cc8-a17d-1aa6fb1d4e58 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:16.337025 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98908e55-e325-4cc8-a17d-1aa6fb1d4e58 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:16.381089 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb24436-95c5-4bf4-8a2a-6c080f8e66c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:16.381891 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb24436-95c5-4bf4-8a2a-6c080f8e66c4 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:16.382164 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb24436-95c5-4bf4-8a2a-6c080f8e66c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:16.382432 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb24436-95c5-4bf4-8a2a-6c080f8e66c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:16.396436 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb24436-95c5-4bf4-8a2a-6c080f8e66c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:16.397972 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb24436-95c5-4bf4-8a2a-6c080f8e66c4 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:16.417731 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-cfb24436-95c5-4bf4-8a2a-6c080f8e66c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:16.419359 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 348/691] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:39:16.425601 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5585f38-9bb5-4878-9c4b-06080f75a4f2 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:16.581178 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5585f38-9bb5-4878-9c4b-06080f75a4f2 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:16.658721 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429c487-bbb6-4903-b7ae-d5c5c3a8aabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:16.660603 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429c487-bbb6-4903-b7ae-d5c5c3a8aabc None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:16.661095 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429c487-bbb6-4903-b7ae-d5c5c3a8aabc None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:16.661567 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429c487-bbb6-4903-b7ae-d5c5c3a8aabc None admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:16.662919 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429c487-bbb6-4903-b7ae-d5c5c3a8aabc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:16.663471 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429c487-bbb6-4903-b7ae-d5c5c3a8aabc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:16.666192 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429c487-bbb6-4903-b7ae-d5c5c3a8aabc None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:16.689055 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 344/692] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:39:16.695232 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb24436-95c5-4bf4-8a2a-6c080f8e66c4 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:16.864671 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb24436-95c5-4bf4-8a2a-6c080f8e66c4 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:16.921726 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781fede-e6d5-4041-aee9-4076ce7f9166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:16.922462 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781fede-e6d5-4041-aee9-4076ce7f9166 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:16.922735 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781fede-e6d5-4041-aee9-4076ce7f9166 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:16.922999 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781fede-e6d5-4041-aee9-4076ce7f9166 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:16.936046 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3781fede-e6d5-4041-aee9-4076ce7f9166 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:16.936046 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3781fede-e6d5-4041-aee9-4076ce7f9166 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:16.957960 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-3781fede-e6d5-4041-aee9-4076ce7f9166 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 20:39:16.963644 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 349/693] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:39:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:16.965713 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429c487-bbb6-4903-b7ae-d5c5c3a8aabc None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:17.163866 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429c487-bbb6-4903-b7ae-d5c5c3a8aabc None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:17.238670 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f536f-4442-4d07-ae46-29b864a86917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:17.239841 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f536f-4442-4d07-ae46-29b864a86917 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:17.240343 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f536f-4442-4d07-ae46-29b864a86917 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:17.240846 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f536f-4442-4d07-ae46-29b864a86917 None admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:17.242367 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f536f-4442-4d07-ae46-29b864a86917 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:17.242887 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f536f-4442-4d07-ae46-29b864a86917 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:17.245677 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f536f-4442-4d07-ae46-29b864a86917 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:17.283143 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 345/694] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 20:39:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:17.290192 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781fede-e6d5-4041-aee9-4076ce7f9166 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:17.466880 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781fede-e6d5-4041-aee9-4076ce7f9166 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:17.523945 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41cc24-7e2d-4c51-b147-d04c96eeb015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:17.524527 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41cc24-7e2d-4c51-b147-d04c96eeb015 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:17.524805 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41cc24-7e2d-4c51-b147-d04c96eeb015 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:17.525072 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41cc24-7e2d-4c51-b147-d04c96eeb015 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:17.525930 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41cc24-7e2d-4c51-b147-d04c96eeb015 None admin] RBAC: Adding query filter params (role.id=7190d40a528146289333f0b9c16a6370, scope.project.id=c55c2ee59af14cf8a7e4275de4f43037, user.id=91d70db11d2d4923943bc6479bc49206) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:17.526237 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41cc24-7e2d-4c51-b147-d04c96eeb015 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:17.527711 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41cc24-7e2d-4c51-b147-d04c96eeb015 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:17.541498 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 350/695] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:39:17 2022] GET /identity/v3/role_assignments?user.id=91d70db11d2d4923943bc6479bc49206&scope.project.id=c55c2ee59af14cf8a7e4275de4f43037&role.id=7190d40a528146289333f0b9c16a6370 => generated 608 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:17.550785 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9cfa0c-3dca-43f3-86ce-42ffa0cc491f None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:17.551232 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9cfa0c-3dca-43f3-86ce-42ffa0cc491f None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:17.551687 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9cfa0c-3dca-43f3-86ce-42ffa0cc491f None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:17.554851 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 346/696] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:39:17.568780 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e71af9-97ee-4002-b840-f8936d0edea0 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:17.569122 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e71af9-97ee-4002-b840-f8936d0edea0 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:17.569330 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e71af9-97ee-4002-b840-f8936d0edea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:17.594385 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-b9e71af9-97ee-4002-b840-f8936d0edea0 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:17.595664 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-b9e71af9-97ee-4002-b840-f8936d0edea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:17.693870 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 351/697] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:39:17.771785 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9cfa0c-3dca-43f3-86ce-42ffa0cc491f None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:17.928372 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9cfa0c-3dca-43f3-86ce-42ffa0cc491f None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:17.931088 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910f765-452e-4c9e-b6e2-8087ddcfacdc None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:17.931632 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910f765-452e-4c9e-b6e2-8087ddcfacdc None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:17.932131 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910f765-452e-4c9e-b6e2-8087ddcfacdc None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:17.934395 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 352/698] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:39:17.940864 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719d474-5bab-4781-b652-aca0f8333d99 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:17.941451 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719d474-5bab-4781-b652-aca0f8333d99 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:17.941923 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719d474-5bab-4781-b652-aca0f8333d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:17.963665 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-2719d474-5bab-4781-b652-aca0f8333d99 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:17.965252 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-2719d474-5bab-4781-b652-aca0f8333d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:17.993125 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556f5c5-a10b-4357-8543-0b81f00478c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:17.994551 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556f5c5-a10b-4357-8543-0b81f00478c7 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:17.995063 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556f5c5-a10b-4357-8543-0b81f00478c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:17.995613 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556f5c5-a10b-4357-8543-0b81f00478c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:18.016694 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4556f5c5-a10b-4357-8543-0b81f00478c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:39:18.031092 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-4556f5c5-a10b-4357-8543-0b81f00478c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 20:39:18.034694 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 347/699] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 20:39:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:18.044815 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556f5c5-a10b-4357-8543-0b81f00478c7 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:18.045114 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 353/700] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 20:39:18.068901 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719d474-5bab-4781-b652-aca0f8333d99 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:18.158286 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556f5c5-a10b-4357-8543-0b81f00478c7 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:18.181574 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719d474-5bab-4781-b652-aca0f8333d99 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:18.197902 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ccc7d-0200-4c58-b40d-ec7e9261d094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:18.199533 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ccc7d-0200-4c58-b40d-ec7e9261d094 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:18.200246 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ccc7d-0200-4c58-b40d-ec7e9261d094 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:18.201017 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ccc7d-0200-4c58-b40d-ec7e9261d094 None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:18.201998 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ccc7d-0200-4c58-b40d-ec7e9261d094 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:18.202518 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ccc7d-0200-4c58-b40d-ec7e9261d094 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:18.204801 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ccc7d-0200-4c58-b40d-ec7e9261d094 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:18.220667 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038d350-0b03-4f3a-b6b5-02f7859a3d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:18.220667 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038d350-0b03-4f3a-b6b5-02f7859a3d08 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:18.220667 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038d350-0b03-4f3a-b6b5-02f7859a3d08 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:18.220997 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038d350-0b03-4f3a-b6b5-02f7859a3d08 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:18.222440 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038d350-0b03-4f3a-b6b5-02f7859a3d08 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:18.223890 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038d350-0b03-4f3a-b6b5-02f7859a3d08 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:18.225166 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 348/701] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:39:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:18.230973 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ccc7d-0200-4c58-b40d-ec7e9261d094 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:18.238689 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-1038d350-0b03-4f3a-b6b5-02f7859a3d08 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 20:39:18.240278 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 354/702] 10.222.0.49 () {56 vars in 1129 bytes} [Fri Oct 28 20:39:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:39:18.246639 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038d350-0b03-4f3a-b6b5-02f7859a3d08 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:18.361283 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038d350-0b03-4f3a-b6b5-02f7859a3d08 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:18.398146 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0105d9-6853-46fd-b0f8-049319804f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:18.398827 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0105d9-6853-46fd-b0f8-049319804f7f None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:18.399103 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0105d9-6853-46fd-b0f8-049319804f7f None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:18.399373 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0105d9-6853-46fd-b0f8-049319804f7f None admin] PATH_INFO: `/v3/services` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:18.400208 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0105d9-6853-46fd-b0f8-049319804f7f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:18.400512 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0105d9-6853-46fd-b0f8-049319804f7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:18.401940 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0105d9-6853-46fd-b0f8-049319804f7f None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:18.407222 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 355/703] 10.222.0.49 () {56 vars in 1124 bytes} [Fri Oct 28 20:39:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:39:18.414059 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0105d9-6853-46fd-b0f8-049319804f7f None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:18.443603 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ccc7d-0200-4c58-b40d-ec7e9261d094 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:18.523968 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0105d9-6853-46fd-b0f8-049319804f7f None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:18.529357 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e37cee-5f28-4a00-8b05-46a0f3c2d139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:18.530160 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e37cee-5f28-4a00-8b05-46a0f3c2d139 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:18.530436 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e37cee-5f28-4a00-8b05-46a0f3c2d139 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:18.530700 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e37cee-5f28-4a00-8b05-46a0f3c2d139 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:18.559319 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e37cee-5f28-4a00-8b05-46a0f3c2d139 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:18.560683 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0334b-9abf-4ef5-b42b-9a0685056ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:18.561341 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0334b-9abf-4ef5-b42b-9a0685056ff9 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:18.561619 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0334b-9abf-4ef5-b42b-9a0685056ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:18.561897 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0334b-9abf-4ef5-b42b-9a0685056ff9 None admin] PATH_INFO: `/v3/services` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:18.562168 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e37cee-5f28-4a00-8b05-46a0f3c2d139 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:18.562605 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0334b-9abf-4ef5-b42b-9a0685056ff9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:18.562906 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0334b-9abf-4ef5-b42b-9a0685056ff9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:18.564308 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0334b-9abf-4ef5-b42b-9a0685056ff9 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:18.571160 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 356/704] 10.222.0.49 () {56 vars in 1124 bytes} [Fri Oct 28 20:39:18 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:39:18.617573 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-49e37cee-5f28-4a00-8b05-46a0f3c2d139 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:18.619195 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 349/705] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:39:18.627239 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0334b-9abf-4ef5-b42b-9a0685056ff9 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:18.757493 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0334b-9abf-4ef5-b42b-9a0685056ff9 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:18.799407 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9d055-7572-4bc0-aa30-130ecfdb0a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:18.801527 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9d055-7572-4bc0-aa30-130ecfdb0a6f None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:18.801960 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9d055-7572-4bc0-aa30-130ecfdb0a6f None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:18.802409 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9d055-7572-4bc0-aa30-130ecfdb0a6f None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:18.803334 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9d055-7572-4bc0-aa30-130ecfdb0a6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:18.803842 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9d055-7572-4bc0-aa30-130ecfdb0a6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:18.805416 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9d055-7572-4bc0-aa30-130ecfdb0a6f None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:18.818786 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 357/706] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:18.828916 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e37cee-5f28-4a00-8b05-46a0f3c2d139 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:18.960288 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e37cee-5f28-4a00-8b05-46a0f3c2d139 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:19.004499 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac21696-5236-416b-a623-263a6f22815c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:19.005307 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac21696-5236-416b-a623-263a6f22815c None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:19.005591 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac21696-5236-416b-a623-263a6f22815c None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:19.005861 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac21696-5236-416b-a623-263a6f22815c None admin] PATH_INFO: `/v3/users/nova` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:19.014825 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac21696-5236-416b-a623-263a6f22815c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:19.016229 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac21696-5236-416b-a623-263a6f22815c None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:19.035626 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-3ac21696-5236-416b-a623-263a6f22815c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 20:39:19.041480 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 350/707] 10.222.0.49 () {56 vars in 1093 bytes} [Fri Oct 28 20:39:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:19.050355 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9d055-7572-4bc0-aa30-130ecfdb0a6f None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:19.192267 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9d055-7572-4bc0-aa30-130ecfdb0a6f None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:19.228289 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83ab0e-533d-488c-b741-bed0ae1dee7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:19.228973 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83ab0e-533d-488c-b741-bed0ae1dee7c None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:19.229253 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83ab0e-533d-488c-b741-bed0ae1dee7c None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:19.229525 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83ab0e-533d-488c-b741-bed0ae1dee7c None admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:19.230371 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83ab0e-533d-488c-b741-bed0ae1dee7c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:19.230675 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83ab0e-533d-488c-b741-bed0ae1dee7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:19.232160 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83ab0e-533d-488c-b741-bed0ae1dee7c None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:19.252431 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 358/708] 10.222.0.49 () {56 vars in 1133 bytes} [Fri Oct 28 20:39:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:19.261190 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac21696-5236-416b-a623-263a6f22815c None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:19.390632 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac21696-5236-416b-a623-263a6f22815c None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:19.435127 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec015e3-3fc9-4c50-a20c-61c51ba39c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:19.435815 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec015e3-3fc9-4c50-a20c-61c51ba39c0d None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:19.436097 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec015e3-3fc9-4c50-a20c-61c51ba39c0d None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:19.436370 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec015e3-3fc9-4c50-a20c-61c51ba39c0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:19.520691 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec015e3-3fc9-4c50-a20c-61c51ba39c0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:19.522542 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec015e3-3fc9-4c50-a20c-61c51ba39c0d None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:19.672695 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 351/709] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:39:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:19.682201 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83ab0e-533d-488c-b741-bed0ae1dee7c None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:19.921206 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83ab0e-533d-488c-b741-bed0ae1dee7c None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:19.973202 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f942444-44ed-4bf2-b7cf-3f46cc13b6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:19.974016 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f942444-44ed-4bf2-b7cf-3f46cc13b6c4 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:19.974296 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f942444-44ed-4bf2-b7cf-3f46cc13b6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:19.974567 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f942444-44ed-4bf2-b7cf-3f46cc13b6c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:19.989371 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f942444-44ed-4bf2-b7cf-3f46cc13b6c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:19.990840 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f942444-44ed-4bf2-b7cf-3f46cc13b6c4 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:20.011806 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-0f942444-44ed-4bf2-b7cf-3f46cc13b6c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:20.015256 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 359/710] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:39:20.017167 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db63aa0-61f2-4699-9942-63a932444d33 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:20.017456 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db63aa0-61f2-4699-9942-63a932444d33 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:20.017739 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db63aa0-61f2-4699-9942-63a932444d33 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:20.020687 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 352/711] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:39:20.021894 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f942444-44ed-4bf2-b7cf-3f46cc13b6c4 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:20.026796 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b287e1-e90b-43da-90d2-b8f17d10170a None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:20.027093 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b287e1-e90b-43da-90d2-b8f17d10170a None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:20.027349 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b287e1-e90b-43da-90d2-b8f17d10170a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:20.048410 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-60b287e1-e90b-43da-90d2-b8f17d10170a None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:20.051051 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-60b287e1-e90b-43da-90d2-b8f17d10170a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:20.126271 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 353/712] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:39:20.132289 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d226d58-ffdd-4b01-875e-253f06d2df0b None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:20.132903 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d226d58-ffdd-4b01-875e-253f06d2df0b None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:20.133655 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d226d58-ffdd-4b01-875e-253f06d2df0b None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:20.136342 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 354/713] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:39:20.141482 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3e5b2-e7a9-4592-a3fa-92e2e2386913 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:20.142068 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3e5b2-e7a9-4592-a3fa-92e2e2386913 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:20.142540 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3e5b2-e7a9-4592-a3fa-92e2e2386913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:20.177489 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-0ed3e5b2-e7a9-4592-a3fa-92e2e2386913 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:20.179046 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-0ed3e5b2-e7a9-4592-a3fa-92e2e2386913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:20.218604 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f942444-44ed-4bf2-b7cf-3f46cc13b6c4 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:20.284548 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e62ef-dfbb-47e8-b736-202ea8777b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:20.286229 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e62ef-dfbb-47e8-b736-202ea8777b21 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:20.286908 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e62ef-dfbb-47e8-b736-202ea8777b21 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:20.287571 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e62ef-dfbb-47e8-b736-202ea8777b21 None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:20.289212 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e62ef-dfbb-47e8-b736-202ea8777b21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:20.289973 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e62ef-dfbb-47e8-b736-202ea8777b21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:20.292879 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e62ef-dfbb-47e8-b736-202ea8777b21 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:20.305132 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 355/714] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:39:20.307532 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3e5b2-e7a9-4592-a3fa-92e2e2386913 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:20.318045 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 360/715] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:20.328081 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e62ef-dfbb-47e8-b736-202ea8777b21 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:20.500138 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3e5b2-e7a9-4592-a3fa-92e2e2386913 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:20.528510 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e62ef-dfbb-47e8-b736-202ea8777b21 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:20.568198 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81295b8e-d783-4454-872d-29223a4cd008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:20.570082 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81295b8e-d783-4454-872d-29223a4cd008 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:20.570877 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81295b8e-d783-4454-872d-29223a4cd008 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:20.571679 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81295b8e-d783-4454-872d-29223a4cd008 None admin] PATH_INFO: `/v3/services/network` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:20.573369 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81295b8e-d783-4454-872d-29223a4cd008 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:20.576545 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81295b8e-d783-4454-872d-29223a4cd008 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:20.604179 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-81295b8e-d783-4454-872d-29223a4cd008 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 20:39:20.604809 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68103a41-3886-418f-9a16-a0d13777c7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:20.606160 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68103a41-3886-418f-9a16-a0d13777c7e2 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:20.606655 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68103a41-3886-418f-9a16-a0d13777c7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:20.607148 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68103a41-3886-418f-9a16-a0d13777c7e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:20.613928 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 356/716] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:39:20 2022] GET /identity/v3/services/network => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:20.616152 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81295b8e-d783-4454-872d-29223a4cd008 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:20.620605 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68103a41-3886-418f-9a16-a0d13777c7e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:20.623717 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68103a41-3886-418f-9a16-a0d13777c7e2 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:20.651705 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-68103a41-3886-418f-9a16-a0d13777c7e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 20:39:20.654826 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 361/717] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:39:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:20.661731 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68103a41-3886-418f-9a16-a0d13777c7e2 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:20.812654 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81295b8e-d783-4454-872d-29223a4cd008 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:20.859771 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68103a41-3886-418f-9a16-a0d13777c7e2 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:20.878945 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d67412-efbc-41ab-bacb-f57d6c38c1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:20.880807 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d67412-efbc-41ab-bacb-f57d6c38c1ff None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:20.881552 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d67412-efbc-41ab-bacb-f57d6c38c1ff None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:20.882290 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d67412-efbc-41ab-bacb-f57d6c38c1ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:20.902520 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d67412-efbc-41ab-bacb-f57d6c38c1ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:39:20.917892 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-e5d67412-efbc-41ab-bacb-f57d6c38c1ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 20:39:20.920992 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 357/718] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 20:39:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:20.922920 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d67412-efbc-41ab-bacb-f57d6c38c1ff None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:20.925315 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d28bd36-62bb-4db1-8aa0-46ec68297fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:20.926902 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28bd36-62bb-4db1-8aa0-46ec68297fa9 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:20.927595 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28bd36-62bb-4db1-8aa0-46ec68297fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:20.928326 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28bd36-62bb-4db1-8aa0-46ec68297fa9 None admin] PATH_INFO: `/v3/services` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:20.929868 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d28bd36-62bb-4db1-8aa0-46ec68297fa9 None admin] RBAC: Adding query filter params (name=network) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:20.930647 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d28bd36-62bb-4db1-8aa0-46ec68297fa9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:20.933585 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d28bd36-62bb-4db1-8aa0-46ec68297fa9 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:20.943708 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 362/719] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Oct 28 20:39:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:20.945617 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d28bd36-62bb-4db1-8aa0-46ec68297fa9 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:21.083220 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d67412-efbc-41ab-bacb-f57d6c38c1ff None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:21.125186 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d28bd36-62bb-4db1-8aa0-46ec68297fa9 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:21.131249 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9667d1-c597-468c-840f-4f303b14a44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:21.132391 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9667d1-c597-468c-840f-4f303b14a44e None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:21.132882 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9667d1-c597-468c-840f-4f303b14a44e None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:21.133369 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9667d1-c597-468c-840f-4f303b14a44e None admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:21.134885 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9667d1-c597-468c-840f-4f303b14a44e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:21.135429 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9667d1-c597-468c-840f-4f303b14a44e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:21.138168 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9667d1-c597-468c-840f-4f303b14a44e None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:21.171778 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 358/720] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 20:39:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:21.171778 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9667d1-c597-468c-840f-4f303b14a44e None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:21.176392 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb2376-aa1d-431d-8cc3-ff1cf087611c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:21.177351 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb2376-aa1d-431d-8cc3-ff1cf087611c None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:21.177791 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb2376-aa1d-431d-8cc3-ff1cf087611c None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:21.178221 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb2376-aa1d-431d-8cc3-ff1cf087611c None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:21.179116 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb2376-aa1d-431d-8cc3-ff1cf087611c None admin] RBAC: Adding query filter params (name=service) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:21.179527 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb2376-aa1d-431d-8cc3-ff1cf087611c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:21.181979 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb2376-aa1d-431d-8cc3-ff1cf087611c None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:21.204277 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 363/721] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 20:39:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:21.204277 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54a793-5de3-4f79-8858-794a8fecc402 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:21.204277 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54a793-5de3-4f79-8858-794a8fecc402 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:21.204277 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54a793-5de3-4f79-8858-794a8fecc402 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:21.204277 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 364/722] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:39:21.204277 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54a793-5de3-4f79-8858-794a8fecc402 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:21.323889 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9667d1-c597-468c-840f-4f303b14a44e None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:21.375103 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f70dd-86bd-4355-a8d2-363560c813ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:21.375910 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f70dd-86bd-4355-a8d2-363560c813ba None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:21.376152 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f70dd-86bd-4355-a8d2-363560c813ba None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:21.376423 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f70dd-86bd-4355-a8d2-363560c813ba None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:21.377134 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f70dd-86bd-4355-a8d2-363560c813ba None admin] RBAC: Adding query filter params (type=network) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:21.377505 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f70dd-86bd-4355-a8d2-363560c813ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:21.379038 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f70dd-86bd-4355-a8d2-363560c813ba None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:21.385542 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 359/723] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Oct 28 20:39:21 2022] GET /identity/v3/services?type=network => generated 124 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:21.386025 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f70dd-86bd-4355-a8d2-363560c813ba None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:21.395378 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54a793-5de3-4f79-8858-794a8fecc402 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:21.459072 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7fff2-f7d6-4b53-b712-179f6dca2cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:21.459970 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7fff2-f7d6-4b53-b712-179f6dca2cee None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:21.460286 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7fff2-f7d6-4b53-b712-179f6dca2cee None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:21.460685 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7fff2-f7d6-4b53-b712-179f6dca2cee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:21.462314 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7fff2-f7d6-4b53-b712-179f6dca2cee None admin] RBAC: Adding query filter params (role.id=8fe105eeb7bf4856a94b0633bd781414, scope.project.id=c55c2ee59af14cf8a7e4275de4f43037, user.id=04bc6ee009e34a5f82e2807db51523d3) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:21.463286 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7fff2-f7d6-4b53-b712-179f6dca2cee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:21.466948 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7fff2-f7d6-4b53-b712-179f6dca2cee None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:21.484538 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 365/724] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:39:21 2022] GET /identity/v3/role_assignments?user.id=04bc6ee009e34a5f82e2807db51523d3&scope.project.id=c55c2ee59af14cf8a7e4275de4f43037&role.id=8fe105eeb7bf4856a94b0633bd781414 => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:21.486206 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626f237-d477-47fb-9163-1df53d6dfc1d None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:21.486496 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626f237-d477-47fb-9163-1df53d6dfc1d None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:21.487335 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626f237-d477-47fb-9163-1df53d6dfc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:21.530053 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f70dd-86bd-4355-a8d2-363560c813ba None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:21.541706 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-7626f237-d477-47fb-9163-1df53d6dfc1d None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:21.544071 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-7626f237-d477-47fb-9163-1df53d6dfc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:21.582152 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61ac1a-86dc-4be4-bd88-0a9d54d2e2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:21.583498 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61ac1a-86dc-4be4-bd88-0a9d54d2e2c1 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:21.584024 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61ac1a-86dc-4be4-bd88-0a9d54d2e2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:21.584508 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61ac1a-86dc-4be4-bd88-0a9d54d2e2c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:21.599880 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61ac1a-86dc-4be4-bd88-0a9d54d2e2c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:21.602011 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61ac1a-86dc-4be4-bd88-0a9d54d2e2c1 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:21.627011 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-7b61ac1a-86dc-4be4-bd88-0a9d54d2e2c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:21.629655 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 360/725] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:21.636253 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61ac1a-86dc-4be4-bd88-0a9d54d2e2c1 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:21.707184 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 366/726] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:39:21.736024 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626f237-d477-47fb-9163-1df53d6dfc1d None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:21.790584 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61ac1a-86dc-4be4-bd88-0a9d54d2e2c1 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:21.840150 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38380401-c3d3-4bfe-9d83-89e0f6a69627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:21.840880 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38380401-c3d3-4bfe-9d83-89e0f6a69627 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:21.841162 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38380401-c3d3-4bfe-9d83-89e0f6a69627 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:21.841400 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38380401-c3d3-4bfe-9d83-89e0f6a69627 None admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:21.842163 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38380401-c3d3-4bfe-9d83-89e0f6a69627 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:21.843482 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38380401-c3d3-4bfe-9d83-89e0f6a69627 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:21.847568 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38380401-c3d3-4bfe-9d83-89e0f6a69627 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:21.868553 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 361/727] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:21.884882 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38380401-c3d3-4bfe-9d83-89e0f6a69627 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:21.980792 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626f237-d477-47fb-9163-1df53d6dfc1d None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:22.018197 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a459fc-0d53-4caf-9412-a87cf2042b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:22.019495 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a459fc-0d53-4caf-9412-a87cf2042b2e None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:22.019806 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a459fc-0d53-4caf-9412-a87cf2042b2e None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:22.020096 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a459fc-0d53-4caf-9412-a87cf2042b2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:22.032160 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a459fc-0d53-4caf-9412-a87cf2042b2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:39:22.039843 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-b9a459fc-0d53-4caf-9412-a87cf2042b2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 20:39:22.041444 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 367/728] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 20:39:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:39:22.042811 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeda9ca-7935-4ef8-9c53-3f7df8388900 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:22.043098 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeda9ca-7935-4ef8-9c53-3f7df8388900 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:22.043374 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeda9ca-7935-4ef8-9c53-3f7df8388900 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:22.049513 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 368/729] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:39:22.050477 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeda9ca-7935-4ef8-9c53-3f7df8388900 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:22.105573 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38380401-c3d3-4bfe-9d83-89e0f6a69627 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:22.145635 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e5eb8-26cd-4d0b-b403-34573d495464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:22.146401 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e5eb8-26cd-4d0b-b403-34573d495464 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:22.146726 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e5eb8-26cd-4d0b-b403-34573d495464 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:22.147005 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e5eb8-26cd-4d0b-b403-34573d495464 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:22.156373 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e5eb8-26cd-4d0b-b403-34573d495464 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:22.157838 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e5eb8-26cd-4d0b-b403-34573d495464 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:22.163720 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeda9ca-7935-4ef8-9c53-3f7df8388900 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:22.176393 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-4d1e5eb8-26cd-4d0b-b403-34573d495464 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 20:39:22.182658 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 362/730] 10.222.0.49 () {56 vars in 1117 bytes} [Fri Oct 28 20:39:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:22.184324 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316e266-0985-45ed-8b73-128ad59cd1f8 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:22.184618 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316e266-0985-45ed-8b73-128ad59cd1f8 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:22.184894 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316e266-0985-45ed-8b73-128ad59cd1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:22.201944 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a4595-8c79-4d17-a0f1-31c0273e5c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:22.202617 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a4595-8c79-4d17-a0f1-31c0273e5c2c None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:22.202912 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a4595-8c79-4d17-a0f1-31c0273e5c2c None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:22.203143 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a4595-8c79-4d17-a0f1-31c0273e5c2c None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:22.203929 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a4595-8c79-4d17-a0f1-31c0273e5c2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:22.204180 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-c316e266-0985-45ed-8b73-128ad59cd1f8 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:22.204404 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a4595-8c79-4d17-a0f1-31c0273e5c2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:22.205401 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-c316e266-0985-45ed-8b73-128ad59cd1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:22.211779 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a4595-8c79-4d17-a0f1-31c0273e5c2c None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:22.216382 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 369/731] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:39:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:22.217786 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a4595-8c79-4d17-a0f1-31c0273e5c2c None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:22.295769 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 363/732] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 20:39:22.295769 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c316e266-0985-45ed-8b73-128ad59cd1f8 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:22.369312 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a4595-8c79-4d17-a0f1-31c0273e5c2c None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:22.407328 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c316e266-0985-45ed-8b73-128ad59cd1f8 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:22.410030 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bae3f7-9eac-48bc-bef6-0ee06eb3ad1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:22.411333 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bae3f7-9eac-48bc-bef6-0ee06eb3ad1e None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:22.411819 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bae3f7-9eac-48bc-bef6-0ee06eb3ad1e None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:22.412276 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bae3f7-9eac-48bc-bef6-0ee06eb3ad1e None admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:22.413297 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bae3f7-9eac-48bc-bef6-0ee06eb3ad1e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:22.413763 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bae3f7-9eac-48bc-bef6-0ee06eb3ad1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:22.415436 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bae3f7-9eac-48bc-bef6-0ee06eb3ad1e None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:22.436185 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 370/733] 10.222.0.49 () {56 vars in 1149 bytes} [Fri Oct 28 20:39:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:22.437358 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bae3f7-9eac-48bc-bef6-0ee06eb3ad1e None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:22.454052 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b713e72-4a31-45f9-a129-4c4808404200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:22.456496 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b713e72-4a31-45f9-a129-4c4808404200 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:22.456997 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b713e72-4a31-45f9-a129-4c4808404200 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:22.457867 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b713e72-4a31-45f9-a129-4c4808404200 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:22.472412 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b713e72-4a31-45f9-a129-4c4808404200 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:22.475056 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b713e72-4a31-45f9-a129-4c4808404200 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:22.499102 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-0b713e72-4a31-45f9-a129-4c4808404200 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:22.501841 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 364/734] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:22.503694 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b713e72-4a31-45f9-a129-4c4808404200 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:22.573211 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bae3f7-9eac-48bc-bef6-0ee06eb3ad1e None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:22.620891 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b713e72-4a31-45f9-a129-4c4808404200 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:22.639027 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61072716-c3b0-4b2c-9dce-a3c39e48f164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:22.640205 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61072716-c3b0-4b2c-9dce-a3c39e48f164 None admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:22.640693 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61072716-c3b0-4b2c-9dce-a3c39e48f164 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:22.641175 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61072716-c3b0-4b2c-9dce-a3c39e48f164 None admin] PATH_INFO: `/v3/services` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:22.642452 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61072716-c3b0-4b2c-9dce-a3c39e48f164 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:22.645835 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61072716-c3b0-4b2c-9dce-a3c39e48f164 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:22.663197 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4107892-3e5c-4f68-a783-661c9ae2cd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:22.664116 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4107892-3e5c-4f68-a783-661c9ae2cd90 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:22.664403 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4107892-3e5c-4f68-a783-661c9ae2cd90 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:22.664679 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4107892-3e5c-4f68-a783-661c9ae2cd90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:22.684259 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 371/735] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Oct 28 20:39:22 2022] POST /identity/v3/services => generated 251 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:39:22.685802 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61072716-c3b0-4b2c-9dce-a3c39e48f164 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:22.749103 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4107892-3e5c-4f68-a783-661c9ae2cd90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:22.750796 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4107892-3e5c-4f68-a783-661c9ae2cd90 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:22.875380 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 365/736] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:39:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:22.881067 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4107892-3e5c-4f68-a783-661c9ae2cd90 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:23.000784 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4107892-3e5c-4f68-a783-661c9ae2cd90 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:23.046747 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61072716-c3b0-4b2c-9dce-a3c39e48f164 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:23.049001 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826696e-aafc-4458-a1f9-1ada819fafd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:23.055776 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826696e-aafc-4458-a1f9-1ada819fafd5 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:23.055776 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826696e-aafc-4458-a1f9-1ada819fafd5 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:23.055776 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826696e-aafc-4458-a1f9-1ada819fafd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:23.062763 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826696e-aafc-4458-a1f9-1ada819fafd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:23.064374 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826696e-aafc-4458-a1f9-1ada819fafd5 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:23.083584 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-f826696e-aafc-4458-a1f9-1ada819fafd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:23.086112 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 366/737] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:23.090797 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826696e-aafc-4458-a1f9-1ada819fafd5 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:23.127236 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c595541-829d-4b70-8c60-e8f9c062ecaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:23.129538 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c595541-829d-4b70-8c60-e8f9c062ecaf None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:23.130370 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c595541-829d-4b70-8c60-e8f9c062ecaf None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:23.131132 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c595541-829d-4b70-8c60-e8f9c062ecaf None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:23.132963 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c595541-829d-4b70-8c60-e8f9c062ecaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:23.133794 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c595541-829d-4b70-8c60-e8f9c062ecaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:23.136775 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c595541-829d-4b70-8c60-e8f9c062ecaf None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:23.159276 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 372/738] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 474 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:23.169149 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c595541-829d-4b70-8c60-e8f9c062ecaf None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:23.206122 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826696e-aafc-4458-a1f9-1ada819fafd5 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:23.244680 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da311221-f715-42d1-b021-744999e83f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:23.245353 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da311221-f715-42d1-b021-744999e83f0f None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:23.245632 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da311221-f715-42d1-b021-744999e83f0f None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:23.245903 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da311221-f715-42d1-b021-744999e83f0f None admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:23.246633 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da311221-f715-42d1-b021-744999e83f0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:23.246934 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da311221-f715-42d1-b021-744999e83f0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:23.248382 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da311221-f715-42d1-b021-744999e83f0f None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:23.268866 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 367/739] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:39:23.270074 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da311221-f715-42d1-b021-744999e83f0f None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:23.375304 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c595541-829d-4b70-8c60-e8f9c062ecaf None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:23.380906 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da311221-f715-42d1-b021-744999e83f0f None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:23.419850 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab8e09-e96e-4a89-ac2b-bbf33b4c1182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:23.420808 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab8e09-e96e-4a89-ac2b-bbf33b4c1182 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:23.420808 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab8e09-e96e-4a89-ac2b-bbf33b4c1182 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:23.421093 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab8e09-e96e-4a89-ac2b-bbf33b4c1182 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:23.429750 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab8e09-e96e-4a89-ac2b-bbf33b4c1182 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:23.431225 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab8e09-e96e-4a89-ac2b-bbf33b4c1182 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:23.441306 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412e3f5-30e9-4705-a216-a4038adfaa8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:23.443209 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412e3f5-30e9-4705-a216-a4038adfaa8a None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:23.444078 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412e3f5-30e9-4705-a216-a4038adfaa8a None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:23.444845 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412e3f5-30e9-4705-a216-a4038adfaa8a None admin] PATH_INFO: `/v3/users/swift` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:23.446643 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-dbab8e09-e96e-4a89-ac2b-bbf33b4c1182 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 20:39:23.448347 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 368/740] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:39:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:23.454378 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab8e09-e96e-4a89-ac2b-bbf33b4c1182 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:23.462100 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412e3f5-30e9-4705-a216-a4038adfaa8a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:23.465525 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412e3f5-30e9-4705-a216-a4038adfaa8a None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:23.495545 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-7412e3f5-30e9-4705-a216-a4038adfaa8a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 20:39:23.498625 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 373/741] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 20:39:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:23.509186 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412e3f5-30e9-4705-a216-a4038adfaa8a None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:23.575241 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab8e09-e96e-4a89-ac2b-bbf33b4c1182 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:23.646645 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f1c11-03d6-4ae0-9571-b3ded50dbfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:23.647319 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f1c11-03d6-4ae0-9571-b3ded50dbfcc None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:23.647599 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f1c11-03d6-4ae0-9571-b3ded50dbfcc None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:23.647908 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f1c11-03d6-4ae0-9571-b3ded50dbfcc None admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:23.648783 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f1c11-03d6-4ae0-9571-b3ded50dbfcc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:23.649133 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f1c11-03d6-4ae0-9571-b3ded50dbfcc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:23.650624 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f1c11-03d6-4ae0-9571-b3ded50dbfcc None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:23.677585 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 369/742] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 20:39:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:39:23.683715 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f1c11-03d6-4ae0-9571-b3ded50dbfcc None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:23.712413 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412e3f5-30e9-4705-a216-a4038adfaa8a None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:23.820737 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f1c11-03d6-4ae0-9571-b3ded50dbfcc None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:23.821357 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a3a19-9744-4cda-8c68-ba2ffdc4cd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:23.822859 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a3a19-9744-4cda-8c68-ba2ffdc4cd9d None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:23.823767 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a3a19-9744-4cda-8c68-ba2ffdc4cd9d None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:23.824508 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a3a19-9744-4cda-8c68-ba2ffdc4cd9d None admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:23.826494 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a3a19-9744-4cda-8c68-ba2ffdc4cd9d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:23.827344 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a3a19-9744-4cda-8c68-ba2ffdc4cd9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:23.830153 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a3a19-9744-4cda-8c68-ba2ffdc4cd9d None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:23.867793 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f3751-ae69-4d38-b0dc-9e802db42c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:23.867793 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f3751-ae69-4d38-b0dc-9e802db42c81 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:23.867793 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f3751-ae69-4d38-b0dc-9e802db42c81 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:23.867793 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f3751-ae69-4d38-b0dc-9e802db42c81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:23.868469 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f3751-ae69-4d38-b0dc-9e802db42c81 None admin] RBAC: Adding query filter params (role.id=7190d40a528146289333f0b9c16a6370, scope.project.id=c55c2ee59af14cf8a7e4275de4f43037, user.id=78cde480dd8b4a85ac30895026bfc406) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:23.868469 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f3751-ae69-4d38-b0dc-9e802db42c81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:23.868469 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f3751-ae69-4d38-b0dc-9e802db42c81 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:23.869890 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 370/743] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:39:23 2022] GET /identity/v3/role_assignments?user.id=78cde480dd8b4a85ac30895026bfc406&scope.project.id=c55c2ee59af14cf8a7e4275de4f43037&role.id=7190d40a528146289333f0b9c16a6370 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:23.892589 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 374/744] 10.222.0.49 () {56 vars in 1135 bytes} [Fri Oct 28 20:39:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:23.902771 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f3751-ae69-4d38-b0dc-9e802db42c81 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:24.027971 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f3751-ae69-4d38-b0dc-9e802db42c81 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:24.070391 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e6417-1166-43fa-ac0d-a8f1d97d08f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:24.071058 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e6417-1166-43fa-ac0d-a8f1d97d08f3 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:24.071390 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e6417-1166-43fa-ac0d-a8f1d97d08f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:24.071668 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e6417-1166-43fa-ac0d-a8f1d97d08f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:24.150086 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e6417-1166-43fa-ac0d-a8f1d97d08f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:24.151465 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e6417-1166-43fa-ac0d-a8f1d97d08f3 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:24.267215 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 371/745] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:39:23 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 20:39:24.276675 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a3a19-9744-4cda-8c68-ba2ffdc4cd9d None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:24.497898 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca7428-be97-403e-919e-3b1c6bb43ae0 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:24.498678 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca7428-be97-403e-919e-3b1c6bb43ae0 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:24.498678 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca7428-be97-403e-919e-3b1c6bb43ae0 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:24.500593 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 372/746] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:39:24.506959 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047fb54-ab79-46a8-a378-55004d0f734f None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:24.507233 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047fb54-ab79-46a8-a378-55004d0f734f None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:24.507527 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047fb54-ab79-46a8-a378-55004d0f734f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:24.528358 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a3a19-9744-4cda-8c68-ba2ffdc4cd9d None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:24.539202 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-3047fb54-ab79-46a8-a378-55004d0f734f None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:24.540453 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-3047fb54-ab79-46a8-a378-55004d0f734f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:24.610438 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc7efb-903d-479c-8848-52833b093463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:24.612775 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc7efb-903d-479c-8848-52833b093463 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:24.613406 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc7efb-903d-479c-8848-52833b093463 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:24.613896 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc7efb-903d-479c-8848-52833b093463 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:24.634794 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 373/747] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:24 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 20:39:24.641756 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc7efb-903d-479c-8848-52833b093463 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:24.643320 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc7efb-903d-479c-8848-52833b093463 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:24.662645 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-bfbc7efb-903d-479c-8848-52833b093463 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:24.664250 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 375/748] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:24.672225 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047fb54-ab79-46a8-a378-55004d0f734f None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:24.685905 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc7efb-903d-479c-8848-52833b093463 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:24.795799 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047fb54-ab79-46a8-a378-55004d0f734f None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:24.834257 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90038fde-5acd-44ca-8359-4bea1bdaa758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:24.834938 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90038fde-5acd-44ca-8359-4bea1bdaa758 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:24.835216 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90038fde-5acd-44ca-8359-4bea1bdaa758 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:24.835490 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90038fde-5acd-44ca-8359-4bea1bdaa758 None admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:24.836270 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90038fde-5acd-44ca-8359-4bea1bdaa758 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:24.836575 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90038fde-5acd-44ca-8359-4bea1bdaa758 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:24.838105 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90038fde-5acd-44ca-8359-4bea1bdaa758 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:24.853030 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 374/749] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:24.860276 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90038fde-5acd-44ca-8359-4bea1bdaa758 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:25.023122 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc7efb-903d-479c-8848-52833b093463 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:25.090650 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76169178-6226-4560-b315-b81a8f7d4b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:25.091224 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76169178-6226-4560-b315-b81a8f7d4b68 None admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:25.091489 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76169178-6226-4560-b315-b81a8f7d4b68 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:25.095773 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76169178-6226-4560-b315-b81a8f7d4b68 None admin] PATH_INFO: `/v3/services` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:25.095773 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76169178-6226-4560-b315-b81a8f7d4b68 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:25.095773 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76169178-6226-4560-b315-b81a8f7d4b68 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:25.119115 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90038fde-5acd-44ca-8359-4bea1bdaa758 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:25.121125 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 376/750] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Oct 28 20:39:24 2022] POST /identity/v3/services => generated 240 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:39:25.225953 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbaa8cd-d98e-4357-a47f-0905e9731af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:25.230747 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbaa8cd-d98e-4357-a47f-0905e9731af1 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:25.230747 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbaa8cd-d98e-4357-a47f-0905e9731af1 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:25.230747 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbaa8cd-d98e-4357-a47f-0905e9731af1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:25.248702 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbaa8cd-d98e-4357-a47f-0905e9731af1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:25.251476 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbaa8cd-d98e-4357-a47f-0905e9731af1 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:25.280707 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-1fbaa8cd-d98e-4357-a47f-0905e9731af1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 20:39:25.280707 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 375/751] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:39:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:39:25.290102 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76169178-6226-4560-b315-b81a8f7d4b68 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:25.474624 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76169178-6226-4560-b315-b81a8f7d4b68 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:25.541206 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717dffb-c68a-4a52-b489-1cb9ad937dc7 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:25.542257 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa3772-f51c-407b-adcb-8689b50793b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:25.542956 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717dffb-c68a-4a52-b489-1cb9ad937dc7 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:25.543343 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa3772-f51c-407b-adcb-8689b50793b3 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:25.543865 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa3772-f51c-407b-adcb-8689b50793b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:25.544309 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717dffb-c68a-4a52-b489-1cb9ad937dc7 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:25.544462 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa3772-f51c-407b-adcb-8689b50793b3 None admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:25.545713 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa3772-f51c-407b-adcb-8689b50793b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:25.546225 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa3772-f51c-407b-adcb-8689b50793b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:25.548862 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa3772-f51c-407b-adcb-8689b50793b3 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:25.549997 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 376/752] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:25 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:39:25.559150 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee017c-b7bf-4e4a-bc48-3ca39c9e0038 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:25.560076 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee017c-b7bf-4e4a-bc48-3ca39c9e0038 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:25.560782 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee017c-b7bf-4e4a-bc48-3ca39c9e0038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:25.577741 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 377/753] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 20:39:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:25.595029 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa3772-f51c-407b-adcb-8689b50793b3 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:25.600117 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-40ee017c-b7bf-4e4a-bc48-3ca39c9e0038 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:25.602227 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-40ee017c-b7bf-4e4a-bc48-3ca39c9e0038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:25.727545 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa3772-f51c-407b-adcb-8689b50793b3 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:25.766859 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f08434-a558-4852-81c8-72e1a8d7ef4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:25.767774 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f08434-a558-4852-81c8-72e1a8d7ef4d None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:25.768987 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f08434-a558-4852-81c8-72e1a8d7ef4d None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:25.770078 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f08434-a558-4852-81c8-72e1a8d7ef4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:25.771082 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f08434-a558-4852-81c8-72e1a8d7ef4d None admin] RBAC: Adding query filter params (role.id=8fe105eeb7bf4856a94b0633bd781414, scope.project.id=c55c2ee59af14cf8a7e4275de4f43037, user.id=91d70db11d2d4923943bc6479bc49206) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:25.771552 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f08434-a558-4852-81c8-72e1a8d7ef4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:25.773171 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f08434-a558-4852-81c8-72e1a8d7ef4d None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:25.780124 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 378/754] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:39:25 2022] GET /identity/v3/role_assignments?user.id=91d70db11d2d4923943bc6479bc49206&scope.project.id=c55c2ee59af14cf8a7e4275de4f43037&role.id=8fe105eeb7bf4856a94b0633bd781414 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:25.833019 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 377/755] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:39:25.905392 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f08434-a558-4852-81c8-72e1a8d7ef4d None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:26.033629 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f08434-a558-4852-81c8-72e1a8d7ef4d None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:26.075332 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddbf254-1cc4-4b71-bed1-7fcf9c5ee3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:26.076418 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbf254-1cc4-4b71-bed1-7fcf9c5ee3ea None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:26.076833 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbf254-1cc4-4b71-bed1-7fcf9c5ee3ea None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:26.077268 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbf254-1cc4-4b71-bed1-7fcf9c5ee3ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:26.090410 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddbf254-1cc4-4b71-bed1-7fcf9c5ee3ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:39:26.098171 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-fddbf254-1cc4-4b71-bed1-7fcf9c5ee3ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 20:39:26.099990 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 379/756] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 20:39:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:39:26.108590 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee017c-b7bf-4e4a-bc48-3ca39c9e0038 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:26.335427 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee017c-b7bf-4e4a-bc48-3ca39c9e0038 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:26.415258 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91bec6e-56bb-4beb-90d6-f33c8443af2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:26.416438 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bec6e-56bb-4beb-90d6-f33c8443af2a None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:26.416928 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bec6e-56bb-4beb-90d6-f33c8443af2a None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:26.417424 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bec6e-56bb-4beb-90d6-f33c8443af2a None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:26.418833 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91bec6e-56bb-4beb-90d6-f33c8443af2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:26.419382 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91bec6e-56bb-4beb-90d6-f33c8443af2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:26.422011 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91bec6e-56bb-4beb-90d6-f33c8443af2a None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:26.447701 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 378/757] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:39:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:26.457381 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddbf254-1cc4-4b71-bed1-7fcf9c5ee3ea None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:26.584421 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddbf254-1cc4-4b71-bed1-7fcf9c5ee3ea None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:26.622356 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7a01a-db33-4d51-aecd-559231729c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:26.623417 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7a01a-db33-4d51-aecd-559231729c4d None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:26.623973 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7a01a-db33-4d51-aecd-559231729c4d None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:26.624387 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7a01a-db33-4d51-aecd-559231729c4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:26.637470 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e7a01a-db33-4d51-aecd-559231729c4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:26.639182 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e7a01a-db33-4d51-aecd-559231729c4d None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:26.658178 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-a7e7a01a-db33-4d51-aecd-559231729c4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:26.661324 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 380/758] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:26.670117 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91bec6e-56bb-4beb-90d6-f33c8443af2a None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:26.701454 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5f9c7-44dc-4ea0-9f46-2913cfaa2c5e None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:26.701964 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5f9c7-44dc-4ea0-9f46-2913cfaa2c5e None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:26.702406 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5f9c7-44dc-4ea0-9f46-2913cfaa2c5e None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:26.705309 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 381/759] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:39:26.713214 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9b7fb-12a3-4bcb-816a-ea9006b39a77 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:26.713770 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9b7fb-12a3-4bcb-816a-ea9006b39a77 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:26.714423 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9b7fb-12a3-4bcb-816a-ea9006b39a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:26.736140 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-a3a9b7fb-12a3-4bcb-816a-ea9006b39a77 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:26.739229 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-a3a9b7fb-12a3-4bcb-816a-ea9006b39a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:26.826367 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91bec6e-56bb-4beb-90d6-f33c8443af2a None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:26.875296 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac0544-b033-4033-b6a2-02be97daa236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:26.875932 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac0544-b033-4033-b6a2-02be97daa236 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:26.876215 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac0544-b033-4033-b6a2-02be97daa236 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:26.876517 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac0544-b033-4033-b6a2-02be97daa236 None admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:26.877295 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac0544-b033-4033-b6a2-02be97daa236 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:26.878339 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac0544-b033-4033-b6a2-02be97daa236 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:26.879904 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac0544-b033-4033-b6a2-02be97daa236 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:26.893476 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 379/760] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:26.901679 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac0544-b033-4033-b6a2-02be97daa236 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:26.950544 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 382/761] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:39:26.987888 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9b7fb-12a3-4bcb-816a-ea9006b39a77 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:27.070905 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac0544-b033-4033-b6a2-02be97daa236 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:27.118176 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ff83e-1b91-451e-bb35-c3b27893663e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:27.122349 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ff83e-1b91-451e-bb35-c3b27893663e None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:27.123878 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ff83e-1b91-451e-bb35-c3b27893663e None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:27.124238 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ff83e-1b91-451e-bb35-c3b27893663e None admin] PATH_INFO: `/v3/users/nova` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:27.133320 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ff83e-1b91-451e-bb35-c3b27893663e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:27.134739 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ff83e-1b91-451e-bb35-c3b27893663e None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:27.157175 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-0b0ff83e-1b91-451e-bb35-c3b27893663e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 20:39:27.160589 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 380/762] 10.222.0.49 () {56 vars in 1093 bytes} [Fri Oct 28 20:39:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:39:27.174577 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ff83e-1b91-451e-bb35-c3b27893663e None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:27.275215 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9b7fb-12a3-4bcb-816a-ea9006b39a77 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:27.340234 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51ac2e-9136-43ad-b54a-042020e92a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:27.342097 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51ac2e-9136-43ad-b54a-042020e92a34 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:27.342926 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51ac2e-9136-43ad-b54a-042020e92a34 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:27.343696 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51ac2e-9136-43ad-b54a-042020e92a34 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:27.345280 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca51ac2e-9136-43ad-b54a-042020e92a34 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:27.349489 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca51ac2e-9136-43ad-b54a-042020e92a34 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:27.379043 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-ca51ac2e-9136-43ad-b54a-042020e92a34 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 20:39:27.388148 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 383/763] 10.222.0.49 () {56 vars in 1129 bytes} [Fri Oct 28 20:39:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:39:27.388148 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c83b5c-cc4e-49d5-9739-6597f3706e69 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:27.388148 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c83b5c-cc4e-49d5-9739-6597f3706e69 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:27.388148 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c83b5c-cc4e-49d5-9739-6597f3706e69 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:27.395819 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 384/764] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:27 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:39:27.397188 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c83b5c-cc4e-49d5-9739-6597f3706e69 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:27.404874 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ff83e-1b91-451e-bb35-c3b27893663e None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:27.468105 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025e460-d6d7-490e-8269-a9eb1fa2d2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:27.469603 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025e460-d6d7-490e-8269-a9eb1fa2d2d3 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:27.471183 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025e460-d6d7-490e-8269-a9eb1fa2d2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:27.471943 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025e460-d6d7-490e-8269-a9eb1fa2d2d3 None admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:27.473849 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2025e460-d6d7-490e-8269-a9eb1fa2d2d3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:27.474631 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2025e460-d6d7-490e-8269-a9eb1fa2d2d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:27.477669 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2025e460-d6d7-490e-8269-a9eb1fa2d2d3 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:27.524331 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 381/765] 10.222.0.49 () {56 vars in 1133 bytes} [Fri Oct 28 20:39:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:27.526244 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e71673-744c-418d-a421-6ea734cb02fb None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:27.526697 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e71673-744c-418d-a421-6ea734cb02fb None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:27.527171 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e71673-744c-418d-a421-6ea734cb02fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:27.554520 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-f5e71673-744c-418d-a421-6ea734cb02fb None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:27.555851 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-f5e71673-744c-418d-a421-6ea734cb02fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:27.587830 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c83b5c-cc4e-49d5-9739-6597f3706e69 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:27.633295 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 382/766] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:39:27.634436 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e71673-744c-418d-a421-6ea734cb02fb None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:27.659594 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098c1ea-c1ab-4166-af0d-6864a4460dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:27.660777 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098c1ea-c1ab-4166-af0d-6864a4460dbf None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:27.661109 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098c1ea-c1ab-4166-af0d-6864a4460dbf None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:27.661377 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098c1ea-c1ab-4166-af0d-6864a4460dbf None admin] PATH_INFO: `/v3/services` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:27.667763 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098c1ea-c1ab-4166-af0d-6864a4460dbf None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:27.667763 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098c1ea-c1ab-4166-af0d-6864a4460dbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:27.667763 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098c1ea-c1ab-4166-af0d-6864a4460dbf None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:27.669126 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 385/767] 10.222.0.49 () {56 vars in 1124 bytes} [Fri Oct 28 20:39:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:27.675833 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098c1ea-c1ab-4166-af0d-6864a4460dbf None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:27.782375 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098c1ea-c1ab-4166-af0d-6864a4460dbf None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:27.810943 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e71673-744c-418d-a421-6ea734cb02fb None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:27.821224 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa055ad5-8647-4a62-ab30-11a31f456c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:27.821948 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa055ad5-8647-4a62-ab30-11a31f456c8a None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:27.822221 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa055ad5-8647-4a62-ab30-11a31f456c8a None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:27.822538 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa055ad5-8647-4a62-ab30-11a31f456c8a None admin] PATH_INFO: `/v3/services` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:27.823260 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa055ad5-8647-4a62-ab30-11a31f456c8a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:27.823555 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa055ad5-8647-4a62-ab30-11a31f456c8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:27.824990 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa055ad5-8647-4a62-ab30-11a31f456c8a None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:27.835962 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 386/768] 10.222.0.49 () {56 vars in 1124 bytes} [Fri Oct 28 20:39:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:39:27.837168 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa055ad5-8647-4a62-ab30-11a31f456c8a None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:27.879993 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4010f0-b277-45e9-9e44-7e9b39069fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:27.881842 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4010f0-b277-45e9-9e44-7e9b39069fd9 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:27.882650 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4010f0-b277-45e9-9e44-7e9b39069fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:27.883400 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4010f0-b277-45e9-9e44-7e9b39069fd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:27.902913 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4010f0-b277-45e9-9e44-7e9b39069fd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:27.906136 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4010f0-b277-45e9-9e44-7e9b39069fd9 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:27.941196 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-3a4010f0-b277-45e9-9e44-7e9b39069fd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:27.944544 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 383/769] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:27.946365 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4010f0-b277-45e9-9e44-7e9b39069fd9 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:27.951688 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa055ad5-8647-4a62-ab30-11a31f456c8a None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:27.991082 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2bd0d-a73b-4d6e-9c44-99a3b7c834b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:27.991944 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2bd0d-a73b-4d6e-9c44-99a3b7c834b5 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:27.992235 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2bd0d-a73b-4d6e-9c44-99a3b7c834b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:27.992478 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2bd0d-a73b-4d6e-9c44-99a3b7c834b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:28.013178 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc2bd0d-a73b-4d6e-9c44-99a3b7c834b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:39:28.021555 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-ddc2bd0d-a73b-4d6e-9c44-99a3b7c834b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 20:39:28.023208 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 387/770] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 20:39:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:28.024055 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2bd0d-a73b-4d6e-9c44-99a3b7c834b5 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:28.095360 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4010f0-b277-45e9-9e44-7e9b39069fd9 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:28.135677 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2bd0d-a73b-4d6e-9c44-99a3b7c834b5 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:28.140782 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f60c00-c3a4-4a04-abb9-b141d88bbb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:28.141555 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f60c00-c3a4-4a04-abb9-b141d88bbb10 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:28.141888 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f60c00-c3a4-4a04-abb9-b141d88bbb10 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:28.142218 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f60c00-c3a4-4a04-abb9-b141d88bbb10 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:28.143714 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f60c00-c3a4-4a04-abb9-b141d88bbb10 None admin] RBAC: Adding query filter params (interface=public, service_id=2bc8c10481004bf38a3db1533eeb6b4f, region_id=RegionOne) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:28.144375 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f60c00-c3a4-4a04-abb9-b141d88bbb10 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:28.146063 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f60c00-c3a4-4a04-abb9-b141d88bbb10 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:28.159476 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 384/771] 10.222.0.49 () {56 vars in 1251 bytes} [Fri Oct 28 20:39:27 2022] GET /identity/v3/endpoints?service_id=2bc8c10481004bf38a3db1533eeb6b4f&interface=public®ion_id=RegionOne => generated 194 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:28.161096 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f60c00-c3a4-4a04-abb9-b141d88bbb10 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:28.180829 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242f4fb-9cb2-437f-8710-f53c871b03c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:28.181501 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242f4fb-9cb2-437f-8710-f53c871b03c4 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:28.181778 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242f4fb-9cb2-437f-8710-f53c871b03c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:28.182243 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242f4fb-9cb2-437f-8710-f53c871b03c4 None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:28.183328 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242f4fb-9cb2-437f-8710-f53c871b03c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:28.183638 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242f4fb-9cb2-437f-8710-f53c871b03c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:28.185332 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242f4fb-9cb2-437f-8710-f53c871b03c4 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:28.204708 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 388/772] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:28.206010 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242f4fb-9cb2-437f-8710-f53c871b03c4 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:28.288461 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f60c00-c3a4-4a04-abb9-b141d88bbb10 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:28.334861 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541fb7cb-6503-466c-a570-dd568baf6172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:28.335846 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fb7cb-6503-466c-a570-dd568baf6172 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:28.336147 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fb7cb-6503-466c-a570-dd568baf6172 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:28.336423 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fb7cb-6503-466c-a570-dd568baf6172 None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:28.337189 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541fb7cb-6503-466c-a570-dd568baf6172 None admin] RBAC: Adding query filter params (name=service) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:28.337488 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541fb7cb-6503-466c-a570-dd568baf6172 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:28.338916 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541fb7cb-6503-466c-a570-dd568baf6172 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:28.350271 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 385/773] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 20:39:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:28.351206 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541fb7cb-6503-466c-a570-dd568baf6172 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:28.360749 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242f4fb-9cb2-437f-8710-f53c871b03c4 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:28.402937 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260806e1-2c72-473a-88c4-c5ac0f140308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:28.404218 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260806e1-2c72-473a-88c4-c5ac0f140308 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:28.404799 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260806e1-2c72-473a-88c4-c5ac0f140308 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:28.405292 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260806e1-2c72-473a-88c4-c5ac0f140308 None admin] PATH_INFO: `/v3/services` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:28.406302 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260806e1-2c72-473a-88c4-c5ac0f140308 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:28.408044 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260806e1-2c72-473a-88c4-c5ac0f140308 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:28.423871 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 389/774] 10.222.0.49 () {56 vars in 1087 bytes} [Fri Oct 28 20:39:28 2022] GET /identity/v3/services => generated 772 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:28.425876 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260806e1-2c72-473a-88c4-c5ac0f140308 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:28.494040 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541fb7cb-6503-466c-a570-dd568baf6172 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:28.542069 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744373a-2988-4a35-96f1-446969c93223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:28.542888 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744373a-2988-4a35-96f1-446969c93223 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:28.543169 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744373a-2988-4a35-96f1-446969c93223 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:28.543443 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744373a-2988-4a35-96f1-446969c93223 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:28.558108 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744373a-2988-4a35-96f1-446969c93223 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:28.559671 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744373a-2988-4a35-96f1-446969c93223 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:28.593075 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-7744373a-2988-4a35-96f1-446969c93223 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 20:39:28.594873 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 386/775] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:39:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:28.600869 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744373a-2988-4a35-96f1-446969c93223 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:28.696435 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260806e1-2c72-473a-88c4-c5ac0f140308 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:28.773890 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe14bd3-ee01-463d-8dd5-9fd22e2817d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:28.775270 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe14bd3-ee01-463d-8dd5-9fd22e2817d2 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:28.775768 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe14bd3-ee01-463d-8dd5-9fd22e2817d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:28.776296 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe14bd3-ee01-463d-8dd5-9fd22e2817d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:28.798133 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe14bd3-ee01-463d-8dd5-9fd22e2817d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:28.801601 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe14bd3-ee01-463d-8dd5-9fd22e2817d2 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:28.822048 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744373a-2988-4a35-96f1-446969c93223 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:28.837867 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-8fe14bd3-ee01-463d-8dd5-9fd22e2817d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:28.840780 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 390/776] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:28.843221 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b3ee9-401c-4d92-a2b1-41703779c4a6 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:28.843721 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b3ee9-401c-4d92-a2b1-41703779c4a6 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:28.852393 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b3ee9-401c-4d92-a2b1-41703779c4a6 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:28.856846 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 391/777] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:28 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:39:28.858463 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b3ee9-401c-4d92-a2b1-41703779c4a6 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:28.868094 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2cca5c-66dc-4ab7-a4a2-37257607264a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:28.868869 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cca5c-66dc-4ab7-a4a2-37257607264a None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:28.869223 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cca5c-66dc-4ab7-a4a2-37257607264a None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:28.869569 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cca5c-66dc-4ab7-a4a2-37257607264a None admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:28.870448 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2cca5c-66dc-4ab7-a4a2-37257607264a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:28.870829 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2cca5c-66dc-4ab7-a4a2-37257607264a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:28.872516 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2cca5c-66dc-4ab7-a4a2-37257607264a None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:28.886602 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 387/778] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 20:39:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:28.893540 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6688e4e-f4c7-4a1c-9f5e-cda89721d08f None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:28.894172 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6688e4e-f4c7-4a1c-9f5e-cda89721d08f None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:28.894745 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6688e4e-f4c7-4a1c-9f5e-cda89721d08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:28.924910 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-f6688e4e-f4c7-4a1c-9f5e-cda89721d08f None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:28.927210 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-f6688e4e-f4c7-4a1c-9f5e-cda89721d08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:28.988607 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b3ee9-401c-4d92-a2b1-41703779c4a6 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:29.031017 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e1a87-ebb9-46c8-8ec0-d7c1641904d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:29.031611 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e1a87-ebb9-46c8-8ec0-d7c1641904d8 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:29.031924 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e1a87-ebb9-46c8-8ec0-d7c1641904d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:29.032198 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e1a87-ebb9-46c8-8ec0-d7c1641904d8 None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:29.032941 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e1a87-ebb9-46c8-8ec0-d7c1641904d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:29.033248 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e1a87-ebb9-46c8-8ec0-d7c1641904d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:29.035693 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e1a87-ebb9-46c8-8ec0-d7c1641904d8 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:29.054527 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 392/779] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:29.055603 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e1a87-ebb9-46c8-8ec0-d7c1641904d8 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:29.067837 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 388/780] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:39:29.068769 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6688e4e-f4c7-4a1c-9f5e-cda89721d08f None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:29.245559 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e1a87-ebb9-46c8-8ec0-d7c1641904d8 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:29.284583 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6688e4e-f4c7-4a1c-9f5e-cda89721d08f None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:29.315609 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb784672-4819-4d29-be4a-6e700721bf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:29.317355 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb784672-4819-4d29-be4a-6e700721bf57 None admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:29.317834 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb784672-4819-4d29-be4a-6e700721bf57 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:29.318320 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb784672-4819-4d29-be4a-6e700721bf57 None admin] PATH_INFO: `/v3/projects/c55c2ee59af14cf8a7e4275de4f43037/users/04bc6ee009e34a5f82e2807db51523d3/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:29.322258 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb784672-4819-4d29-be4a-6e700721bf57 None admin] RBAC: Authorizing `identity:create_grant(project_id=c55c2ee59af14cf8a7e4275de4f43037, user_id=04bc6ee009e34a5f82e2807db51523d3, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:29.325083 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb784672-4819-4d29-be4a-6e700721bf57 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:29.356485 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d62b2-fbe5-4a57-bf5e-09bce6fb05da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:29.358557 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d62b2-fbe5-4a57-bf5e-09bce6fb05da None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:29.359445 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d62b2-fbe5-4a57-bf5e-09bce6fb05da None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:29.360362 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 393/781] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 20:39:29 2022] PUT /identity/v3/projects/c55c2ee59af14cf8a7e4275de4f43037/users/04bc6ee009e34a5f82e2807db51523d3/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:39:29.360730 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d62b2-fbe5-4a57-bf5e-09bce6fb05da None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:29.363186 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbcd1f-b937-4c54-b2b6-2dff94b2f329 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:29.363651 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbcd1f-b937-4c54-b2b6-2dff94b2f329 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:29.364277 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbcd1f-b937-4c54-b2b6-2dff94b2f329 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:29.376630 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d62b2-fbe5-4a57-bf5e-09bce6fb05da None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:29.379298 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 394/782] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:29 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:39:29.380869 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbcd1f-b937-4c54-b2b6-2dff94b2f329 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:29.381761 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d62b2-fbe5-4a57-bf5e-09bce6fb05da None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:29.412798 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-835d62b2-fbe5-4a57-bf5e-09bce6fb05da None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 20:39:29.423195 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 389/783] 10.222.0.49 () {56 vars in 1117 bytes} [Fri Oct 28 20:39:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:29.427373 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201e7e6-076c-45d6-affb-99f0304c57b5 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:29.428395 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201e7e6-076c-45d6-affb-99f0304c57b5 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:29.429223 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201e7e6-076c-45d6-affb-99f0304c57b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:29.469055 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-3201e7e6-076c-45d6-affb-99f0304c57b5 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:29.472761 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-3201e7e6-076c-45d6-affb-99f0304c57b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:29.633861 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 390/784] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:39:29.637690 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201e7e6-076c-45d6-affb-99f0304c57b5 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:29.688281 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbcd1f-b937-4c54-b2b6-2dff94b2f329 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:29.747941 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87f552-9e63-4b9e-9a2b-f2ffac7fda45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:29.750146 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87f552-9e63-4b9e-9a2b-f2ffac7fda45 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:29.750662 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87f552-9e63-4b9e-9a2b-f2ffac7fda45 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:29.751428 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87f552-9e63-4b9e-9a2b-f2ffac7fda45 None admin] PATH_INFO: `/v3/services/network` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:29.754018 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e87f552-9e63-4b9e-9a2b-f2ffac7fda45 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:29.757214 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e87f552-9e63-4b9e-9a2b-f2ffac7fda45 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:29.786516 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-1e87f552-9e63-4b9e-9a2b-f2ffac7fda45 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 20:39:29.788214 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 395/785] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:39:29 2022] GET /identity/v3/services/network => generated 88 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:29.789090 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87f552-9e63-4b9e-9a2b-f2ffac7fda45 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:29.798862 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201e7e6-076c-45d6-affb-99f0304c57b5 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:29.862802 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf86fab-3854-4268-801a-307fc8969cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:29.865200 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf86fab-3854-4268-801a-307fc8969cc3 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:29.865952 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf86fab-3854-4268-801a-307fc8969cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:29.866728 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf86fab-3854-4268-801a-307fc8969cc3 None admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:29.868978 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf86fab-3854-4268-801a-307fc8969cc3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:29.870468 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf86fab-3854-4268-801a-307fc8969cc3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:29.874270 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf86fab-3854-4268-801a-307fc8969cc3 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:29.900756 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87f552-9e63-4b9e-9a2b-f2ffac7fda45 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:29.914623 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 391/786] 10.222.0.49 () {56 vars in 1149 bytes} [Fri Oct 28 20:39:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:29.915969 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf86fab-3854-4268-801a-307fc8969cc3 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:29.938522 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea34a11-6601-483b-9454-6ea950f21a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:29.939345 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea34a11-6601-483b-9454-6ea950f21a79 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:29.939704 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea34a11-6601-483b-9454-6ea950f21a79 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:29.940144 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea34a11-6601-483b-9454-6ea950f21a79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:29.951688 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea34a11-6601-483b-9454-6ea950f21a79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:39:29.959302 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-6ea34a11-6601-483b-9454-6ea950f21a79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 20:39:29.960864 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 396/787] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 20:39:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:29.961667 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea34a11-6601-483b-9454-6ea950f21a79 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:30.029532 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf86fab-3854-4268-801a-307fc8969cc3 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:30.067916 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60890053-5042-4da6-8dd3-5657b769331f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:30.068985 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60890053-5042-4da6-8dd3-5657b769331f None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:30.069478 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60890053-5042-4da6-8dd3-5657b769331f None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:30.069960 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60890053-5042-4da6-8dd3-5657b769331f None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:30.070355 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea34a11-6601-483b-9454-6ea950f21a79 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:30.071101 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60890053-5042-4da6-8dd3-5657b769331f None admin] RBAC: Adding query filter params (name=network) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:30.071598 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60890053-5042-4da6-8dd3-5657b769331f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:30.073339 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60890053-5042-4da6-8dd3-5657b769331f None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:30.078938 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 392/788] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Oct 28 20:39:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:30.080962 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60890053-5042-4da6-8dd3-5657b769331f None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:30.106910 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88d099-364b-4ca8-b7b3-d2ce38fabe18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:30.107716 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88d099-364b-4ca8-b7b3-d2ce38fabe18 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:30.108021 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88d099-364b-4ca8-b7b3-d2ce38fabe18 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:30.108292 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88d099-364b-4ca8-b7b3-d2ce38fabe18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:30.120390 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb88d099-364b-4ca8-b7b3-d2ce38fabe18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:30.121883 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb88d099-364b-4ca8-b7b3-d2ce38fabe18 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:30.140604 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-eb88d099-364b-4ca8-b7b3-d2ce38fabe18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:30.147276 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 397/789] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:30.147276 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88d099-364b-4ca8-b7b3-d2ce38fabe18 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:30.197637 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60890053-5042-4da6-8dd3-5657b769331f None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:30.239841 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5eee4-38c4-4e94-bcc6-732b88662492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:30.240969 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5eee4-38c4-4e94-bcc6-732b88662492 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:30.241493 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5eee4-38c4-4e94-bcc6-732b88662492 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:30.241972 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5eee4-38c4-4e94-bcc6-732b88662492 None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:30.243253 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5eee4-38c4-4e94-bcc6-732b88662492 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:30.243817 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5eee4-38c4-4e94-bcc6-732b88662492 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:30.245418 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5eee4-38c4-4e94-bcc6-732b88662492 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:30.255933 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 393/790] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:39:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:30.256516 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88d099-364b-4ca8-b7b3-d2ce38fabe18 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:30.257400 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5eee4-38c4-4e94-bcc6-732b88662492 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:30.295232 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b778f-0eca-4e4f-a38b-541bb609b1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:30.295949 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b778f-0eca-4e4f-a38b-541bb609b1ea None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:30.296229 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b778f-0eca-4e4f-a38b-541bb609b1ea None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:30.296495 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b778f-0eca-4e4f-a38b-541bb609b1ea None admin] PATH_INFO: `/v3/services` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:30.297253 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b778f-0eca-4e4f-a38b-541bb609b1ea None admin] RBAC: Adding query filter params (type=network) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:30.297641 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b778f-0eca-4e4f-a38b-541bb609b1ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:30.299108 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b778f-0eca-4e4f-a38b-541bb609b1ea None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:30.305288 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 398/791] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Oct 28 20:39:30 2022] GET /identity/v3/services?type=network => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:30.306165 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b778f-0eca-4e4f-a38b-541bb609b1ea None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:30.381020 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5eee4-38c4-4e94-bcc6-732b88662492 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:30.418565 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f316db-d013-4898-bc92-1038e90db969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:30.419615 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f316db-d013-4898-bc92-1038e90db969 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:30.420118 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f316db-d013-4898-bc92-1038e90db969 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:30.420601 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f316db-d013-4898-bc92-1038e90db969 None admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:30.421514 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f316db-d013-4898-bc92-1038e90db969 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:30.422010 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b778f-0eca-4e4f-a38b-541bb609b1ea None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:30.422209 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f316db-d013-4898-bc92-1038e90db969 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:30.423823 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f316db-d013-4898-bc92-1038e90db969 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:30.442247 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 394/792] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:30.443554 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f316db-d013-4898-bc92-1038e90db969 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:30.458832 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6bc9f8-dae1-49e2-9edd-f30fdc6e46f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:30.459652 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bc9f8-dae1-49e2-9edd-f30fdc6e46f4 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:30.459995 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bc9f8-dae1-49e2-9edd-f30fdc6e46f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:30.460271 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bc9f8-dae1-49e2-9edd-f30fdc6e46f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:30.472873 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6bc9f8-dae1-49e2-9edd-f30fdc6e46f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:30.474366 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6bc9f8-dae1-49e2-9edd-f30fdc6e46f4 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:30.492769 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-dd6bc9f8-dae1-49e2-9edd-f30fdc6e46f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:30.494328 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 399/793] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:30.495141 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6bc9f8-dae1-49e2-9edd-f30fdc6e46f4 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:30.609293 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6bc9f8-dae1-49e2-9edd-f30fdc6e46f4 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:30.624345 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f316db-d013-4898-bc92-1038e90db969 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:30.651393 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d485220-a753-4ba1-98fb-169a8db1d870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:30.652318 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d485220-a753-4ba1-98fb-169a8db1d870 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:30.652606 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d485220-a753-4ba1-98fb-169a8db1d870 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:30.652869 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d485220-a753-4ba1-98fb-169a8db1d870 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:30.661042 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d485220-a753-4ba1-98fb-169a8db1d870 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:30.662613 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d485220-a753-4ba1-98fb-169a8db1d870 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:30.678914 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-8d485220-a753-4ba1-98fb-169a8db1d870 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 20:39:30.684399 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 400/794] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:39:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:30.685048 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d485220-a753-4ba1-98fb-169a8db1d870 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:30.697231 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c63e71-ebbf-4063-9c6b-0471b2156fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:30.697915 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c63e71-ebbf-4063-9c6b-0471b2156fc7 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:30.698191 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c63e71-ebbf-4063-9c6b-0471b2156fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:30.698486 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c63e71-ebbf-4063-9c6b-0471b2156fc7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:30.699338 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c63e71-ebbf-4063-9c6b-0471b2156fc7 None admin] RBAC: Adding query filter params (interface=public, service_id=0da9b7bdf21c4f298e8d086eb660263a, region_id=RegionOne) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:30.699657 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c63e71-ebbf-4063-9c6b-0471b2156fc7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:30.701183 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c63e71-ebbf-4063-9c6b-0471b2156fc7 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:30.708982 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 395/795] 10.222.0.49 () {56 vars in 1251 bytes} [Fri Oct 28 20:39:30 2022] GET /identity/v3/endpoints?service_id=0da9b7bdf21c4f298e8d086eb660263a&interface=public®ion_id=RegionOne => generated 194 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:30.709771 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c63e71-ebbf-4063-9c6b-0471b2156fc7 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:30.858949 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c63e71-ebbf-4063-9c6b-0471b2156fc7 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:30.905114 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067cb580-d78c-4310-a8a1-bdf8b592636f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:30.906113 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067cb580-d78c-4310-a8a1-bdf8b592636f None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:30.906113 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067cb580-d78c-4310-a8a1-bdf8b592636f None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:30.906356 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067cb580-d78c-4310-a8a1-bdf8b592636f None admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:30.907202 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067cb580-d78c-4310-a8a1-bdf8b592636f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:30.907517 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067cb580-d78c-4310-a8a1-bdf8b592636f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:30.909591 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067cb580-d78c-4310-a8a1-bdf8b592636f None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:30.912206 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d485220-a753-4ba1-98fb-169a8db1d870 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:30.923522 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 396/796] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 20:39:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:30.925069 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067cb580-d78c-4310-a8a1-bdf8b592636f None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:30.981758 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cf5a7-dcef-43a2-94b6-e5968f3e648a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:30.983393 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cf5a7-dcef-43a2-94b6-e5968f3e648a None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:30.984940 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cf5a7-dcef-43a2-94b6-e5968f3e648a None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:30.986218 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cf5a7-dcef-43a2-94b6-e5968f3e648a None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:30.988983 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79cf5a7-dcef-43a2-94b6-e5968f3e648a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:30.989836 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79cf5a7-dcef-43a2-94b6-e5968f3e648a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:30.992787 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79cf5a7-dcef-43a2-94b6-e5968f3e648a None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:31.015336 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 401/797] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:31.017263 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cf5a7-dcef-43a2-94b6-e5968f3e648a None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:31.040515 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067cb580-d78c-4310-a8a1-bdf8b592636f None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:31.077724 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432a362-2a5a-4343-9f1d-b3905dd9a434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:31.078488 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432a362-2a5a-4343-9f1d-b3905dd9a434 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:31.078770 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432a362-2a5a-4343-9f1d-b3905dd9a434 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:31.079037 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432a362-2a5a-4343-9f1d-b3905dd9a434 None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:31.079733 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1432a362-2a5a-4343-9f1d-b3905dd9a434 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:31.081788 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1432a362-2a5a-4343-9f1d-b3905dd9a434 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:31.092141 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 397/798] 10.222.0.49 () {56 vars in 1087 bytes} [Fri Oct 28 20:39:30 2022] GET /identity/v3/services => generated 772 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:31.093149 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432a362-2a5a-4343-9f1d-b3905dd9a434 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:31.212426 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cf5a7-dcef-43a2-94b6-e5968f3e648a None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:31.312598 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61828a70-a611-4c2e-999d-598e50105b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:31.315444 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61828a70-a611-4c2e-999d-598e50105b29 None admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:31.316426 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61828a70-a611-4c2e-999d-598e50105b29 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:31.317148 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61828a70-a611-4c2e-999d-598e50105b29 None admin] PATH_INFO: `/v3/projects/c55c2ee59af14cf8a7e4275de4f43037/users/78cde480dd8b4a85ac30895026bfc406/roles/7190d40a528146289333f0b9c16a6370` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:31.322209 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432a362-2a5a-4343-9f1d-b3905dd9a434 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:31.347438 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61828a70-a611-4c2e-999d-598e50105b29 None admin] RBAC: Authorizing `identity:create_grant(project_id=c55c2ee59af14cf8a7e4275de4f43037, user_id=78cde480dd8b4a85ac30895026bfc406, role_id=7190d40a528146289333f0b9c16a6370)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:31.350914 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61828a70-a611-4c2e-999d-598e50105b29 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:31.386993 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 402/799] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 20:39:31 2022] PUT /identity/v3/projects/c55c2ee59af14cf8a7e4275de4f43037/users/78cde480dd8b4a85ac30895026bfc406/roles/7190d40a528146289333f0b9c16a6370 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:39:31.426855 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8743d-4b67-4493-8e6c-dcd6fe250c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:31.428740 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8743d-4b67-4493-8e6c-dcd6fe250c46 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:31.429628 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8743d-4b67-4493-8e6c-dcd6fe250c46 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:31.430267 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8743d-4b67-4493-8e6c-dcd6fe250c46 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:31.448649 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb8743d-4b67-4493-8e6c-dcd6fe250c46 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:31.452191 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb8743d-4b67-4493-8e6c-dcd6fe250c46 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:31.482322 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-bfb8743d-4b67-4493-8e6c-dcd6fe250c46 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 20:39:31.485933 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 398/800] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 20:39:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:31.492998 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61828a70-a611-4c2e-999d-598e50105b29 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:31.694878 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61828a70-a611-4c2e-999d-598e50105b29 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:31.747871 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f217801-91f5-4921-bd79-63bf33befd2d None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:31.749315 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f217801-91f5-4921-bd79-63bf33befd2d None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:31.751491 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f217801-91f5-4921-bd79-63bf33befd2d None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:31.757531 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 399/801] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:31 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:39:31.761560 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0cfa9-a9a5-4ad2-9cd1-0d1e5684853f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:31.762239 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0cfa9-a9a5-4ad2-9cd1-0d1e5684853f None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:31.762518 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0cfa9-a9a5-4ad2-9cd1-0d1e5684853f None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:31.762763 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0cfa9-a9a5-4ad2-9cd1-0d1e5684853f None admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:31.763615 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d0cfa9-a9a5-4ad2-9cd1-0d1e5684853f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:31.763952 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d0cfa9-a9a5-4ad2-9cd1-0d1e5684853f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:31.765433 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d0cfa9-a9a5-4ad2-9cd1-0d1e5684853f None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:31.773111 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa0df0-b6fa-4ef8-98af-7a91dc42fe0e None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:31.773492 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa0df0-b6fa-4ef8-98af-7a91dc42fe0e None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:31.773637 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa0df0-b6fa-4ef8-98af-7a91dc42fe0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:31.805780 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 403/802] 10.222.0.49 () {56 vars in 1135 bytes} [Fri Oct 28 20:39:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:31.812436 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0cfa9-a9a5-4ad2-9cd1-0d1e5684853f None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:31.819659 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-18fa0df0-b6fa-4ef8-98af-7a91dc42fe0e None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:31.820893 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-18fa0df0-b6fa-4ef8-98af-7a91dc42fe0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:31.972135 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 400/803] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 20:39:32.008591 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0cfa9-a9a5-4ad2-9cd1-0d1e5684853f None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:32.058281 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa0df0-b6fa-4ef8-98af-7a91dc42fe0e None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:32.072396 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c371920-9745-4d4e-a96c-cc8cd9a8a95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:32.073201 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c371920-9745-4d4e-a96c-cc8cd9a8a95d None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:32.073472 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c371920-9745-4d4e-a96c-cc8cd9a8a95d None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:32.073741 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c371920-9745-4d4e-a96c-cc8cd9a8a95d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:32.098443 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c371920-9745-4d4e-a96c-cc8cd9a8a95d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:32.099952 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c371920-9745-4d4e-a96c-cc8cd9a8a95d None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:32.122811 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-3c371920-9745-4d4e-a96c-cc8cd9a8a95d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:32.124442 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 404/804] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:32.130470 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c371920-9745-4d4e-a96c-cc8cd9a8a95d None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:32.321060 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa0df0-b6fa-4ef8-98af-7a91dc42fe0e None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:32.363901 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c371920-9745-4d4e-a96c-cc8cd9a8a95d None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:32.392681 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef031f31-bbf7-4b9f-90e2-76706a89c919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:32.394149 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef031f31-bbf7-4b9f-90e2-76706a89c919 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:32.394615 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef031f31-bbf7-4b9f-90e2-76706a89c919 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:32.395084 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef031f31-bbf7-4b9f-90e2-76706a89c919 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:32.396432 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef031f31-bbf7-4b9f-90e2-76706a89c919 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:32.399009 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef031f31-bbf7-4b9f-90e2-76706a89c919 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:32.410854 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06cc5f-9942-4bb9-8361-0ab5ee1b0a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:32.411936 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06cc5f-9942-4bb9-8361-0ab5ee1b0a5b None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:32.412415 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06cc5f-9942-4bb9-8361-0ab5ee1b0a5b None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:32.412911 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06cc5f-9942-4bb9-8361-0ab5ee1b0a5b None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:32.413858 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06cc5f-9942-4bb9-8361-0ab5ee1b0a5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:32.414392 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06cc5f-9942-4bb9-8361-0ab5ee1b0a5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:32.416131 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06cc5f-9942-4bb9-8361-0ab5ee1b0a5b None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:32.422296 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-ef031f31-bbf7-4b9f-90e2-76706a89c919 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 20:39:32.426176 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 401/805] 10.222.0.49 () {56 vars in 1129 bytes} [Fri Oct 28 20:39:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:32.428064 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46389c56-ad9f-46f4-8494-e6e1da3c5cb7 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:32.428595 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46389c56-ad9f-46f4-8494-e6e1da3c5cb7 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:32.429416 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46389c56-ad9f-46f4-8494-e6e1da3c5cb7 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:32.437092 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 402/806] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:39:32.437092 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46389c56-ad9f-46f4-8494-e6e1da3c5cb7 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:32.437786 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 405/807] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:39:32.440122 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686d93a-6333-489c-b1bc-5d8c07e121ec None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:32.441658 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686d93a-6333-489c-b1bc-5d8c07e121ec None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:32.442144 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686d93a-6333-489c-b1bc-5d8c07e121ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:32.469057 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-f686d93a-6333-489c-b1bc-5d8c07e121ec None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:32.471413 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-f686d93a-6333-489c-b1bc-5d8c07e121ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:32.581272 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46389c56-ad9f-46f4-8494-e6e1da3c5cb7 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:32.603887 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 406/808] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:39:32.606194 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686d93a-6333-489c-b1bc-5d8c07e121ec None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:32.625258 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e9f83-3fce-4f67-bc5f-d1cfbb85c256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:32.626326 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e9f83-3fce-4f67-bc5f-d1cfbb85c256 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:32.626823 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e9f83-3fce-4f67-bc5f-d1cfbb85c256 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:32.628036 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e9f83-3fce-4f67-bc5f-d1cfbb85c256 None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:32.629045 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e9f83-3fce-4f67-bc5f-d1cfbb85c256 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:32.629538 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e9f83-3fce-4f67-bc5f-d1cfbb85c256 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:32.631275 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e9f83-3fce-4f67-bc5f-d1cfbb85c256 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:32.637252 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 403/809] 10.222.0.49 () {56 vars in 1124 bytes} [Fri Oct 28 20:39:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:32.642453 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e9f83-3fce-4f67-bc5f-d1cfbb85c256 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:32.791284 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686d93a-6333-489c-b1bc-5d8c07e121ec None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:32.798136 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e9f83-3fce-4f67-bc5f-d1cfbb85c256 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:32.837962 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ddd93-84ed-4a08-a3f0-5b4cac4fadf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:32.839430 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ddd93-84ed-4a08-a3f0-5b4cac4fadf7 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:32.839953 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ddd93-84ed-4a08-a3f0-5b4cac4fadf7 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:32.840438 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ddd93-84ed-4a08-a3f0-5b4cac4fadf7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:32.851090 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ddd93-84ed-4a08-a3f0-5b4cac4fadf7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:32.853224 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ddd93-84ed-4a08-a3f0-5b4cac4fadf7 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:32.863376 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec589e-1da0-40cc-b77b-dce07f5debac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:32.864637 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec589e-1da0-40cc-b77b-dce07f5debac None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:32.865185 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec589e-1da0-40cc-b77b-dce07f5debac None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:32.865684 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec589e-1da0-40cc-b77b-dce07f5debac None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:32.867004 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec589e-1da0-40cc-b77b-dce07f5debac None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:32.867554 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec589e-1da0-40cc-b77b-dce07f5debac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:32.870302 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec589e-1da0-40cc-b77b-dce07f5debac None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:32.870718 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-9f2ddd93-84ed-4a08-a3f0-5b4cac4fadf7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 20:39:32.877261 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 407/810] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:39:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:32.880198 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ddd93-84ed-4a08-a3f0-5b4cac4fadf7 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:32.887287 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 404/811] 10.222.0.49 () {56 vars in 1124 bytes} [Fri Oct 28 20:39:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:32.888597 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec589e-1da0-40cc-b77b-dce07f5debac None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:33.007222 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec589e-1da0-40cc-b77b-dce07f5debac None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:33.046236 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06238f55-95f9-4341-96d4-068cc51a8a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:33.047327 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06238f55-95f9-4341-96d4-068cc51a8a2c None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:33.047902 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06238f55-95f9-4341-96d4-068cc51a8a2c None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:33.048404 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06238f55-95f9-4341-96d4-068cc51a8a2c None admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:33.049611 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06238f55-95f9-4341-96d4-068cc51a8a2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:33.050232 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06238f55-95f9-4341-96d4-068cc51a8a2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:33.052059 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06238f55-95f9-4341-96d4-068cc51a8a2c None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:33.060513 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ddd93-84ed-4a08-a3f0-5b4cac4fadf7 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:33.071865 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 405/812] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 20:39:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:33.073174 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06238f55-95f9-4341-96d4-068cc51a8a2c None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:33.123121 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf45f72-49a4-405a-bae3-b8aaccfdb1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:33.124561 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf45f72-49a4-405a-bae3-b8aaccfdb1f2 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:33.125049 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf45f72-49a4-405a-bae3-b8aaccfdb1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:33.125521 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf45f72-49a4-405a-bae3-b8aaccfdb1f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:33.143421 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf45f72-49a4-405a-bae3-b8aaccfdb1f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:39:33.155096 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-bcf45f72-49a4-405a-bae3-b8aaccfdb1f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 20:39:33.163005 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 408/813] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 20:39:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:33.163005 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf45f72-49a4-405a-bae3-b8aaccfdb1f2 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:33.235985 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06238f55-95f9-4341-96d4-068cc51a8a2c None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:33.280946 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b207a-b221-48d9-834c-993fa8a88f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:33.282418 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b207a-b221-48d9-834c-993fa8a88f2a None admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:33.282966 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b207a-b221-48d9-834c-993fa8a88f2a None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:33.284033 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b207a-b221-48d9-834c-993fa8a88f2a None admin] PATH_INFO: `/v3/endpoints` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:33.285635 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b207a-b221-48d9-834c-993fa8a88f2a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:33.287358 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b207a-b221-48d9-834c-993fa8a88f2a None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:33.315475 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 406/814] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:39:33 2022] POST /identity/v3/endpoints => generated 346 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:39:33.317321 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b207a-b221-48d9-834c-993fa8a88f2a None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:33.342456 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf45f72-49a4-405a-bae3-b8aaccfdb1f2 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:33.422700 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2325e-4a7b-41e5-9a42-3a5ee0c414b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:33.425486 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2325e-4a7b-41e5-9a42-3a5ee0c414b6 None admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:33.425885 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2325e-4a7b-41e5-9a42-3a5ee0c414b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:33.426288 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2325e-4a7b-41e5-9a42-3a5ee0c414b6 None admin] PATH_INFO: `/v3/projects/c55c2ee59af14cf8a7e4275de4f43037/users/91d70db11d2d4923943bc6479bc49206/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:33.430151 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2325e-4a7b-41e5-9a42-3a5ee0c414b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=c55c2ee59af14cf8a7e4275de4f43037, user_id=91d70db11d2d4923943bc6479bc49206, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:33.433001 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2325e-4a7b-41e5-9a42-3a5ee0c414b6 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:33.461715 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b207a-b221-48d9-834c-993fa8a88f2a None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:33.473710 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 409/815] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 20:39:33 2022] PUT /identity/v3/projects/c55c2ee59af14cf8a7e4275de4f43037/users/91d70db11d2d4923943bc6479bc49206/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:39:33.553455 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ff01a-b04a-4dbd-93b7-fae49bf514cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:33.554159 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ff01a-b04a-4dbd-93b7-fae49bf514cb None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:33.554437 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ff01a-b04a-4dbd-93b7-fae49bf514cb None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:33.554708 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ff01a-b04a-4dbd-93b7-fae49bf514cb None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:33.555487 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ff01a-b04a-4dbd-93b7-fae49bf514cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:33.555816 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ff01a-b04a-4dbd-93b7-fae49bf514cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:33.557271 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ff01a-b04a-4dbd-93b7-fae49bf514cb None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:33.574257 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 407/816] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:39:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:33.581302 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2325e-4a7b-41e5-9a42-3a5ee0c414b6 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:33.808251 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2325e-4a7b-41e5-9a42-3a5ee0c414b6 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:33.873318 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81ddbf-9772-45de-ae7f-82b91f30b87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:33.874744 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81ddbf-9772-45de-ae7f-82b91f30b87b None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:33.875242 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81ddbf-9772-45de-ae7f-82b91f30b87b None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:33.875727 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81ddbf-9772-45de-ae7f-82b91f30b87b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:33.897306 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a81ddbf-9772-45de-ae7f-82b91f30b87b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:33.900047 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a81ddbf-9772-45de-ae7f-82b91f30b87b None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:33.933345 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-3a81ddbf-9772-45de-ae7f-82b91f30b87b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:33.936162 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 410/817] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:33.945197 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ff01a-b04a-4dbd-93b7-fae49bf514cb None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:34.116147 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ff01a-b04a-4dbd-93b7-fae49bf514cb None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:34.207092 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007f3eb-7a65-4ebb-b8bb-f2e1d48b4dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:34.208218 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007f3eb-7a65-4ebb-b8bb-f2e1d48b4dfd None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:34.208708 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007f3eb-7a65-4ebb-b8bb-f2e1d48b4dfd None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:34.209184 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007f3eb-7a65-4ebb-b8bb-f2e1d48b4dfd None admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:34.210513 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007f3eb-7a65-4ebb-b8bb-f2e1d48b4dfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:34.211051 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007f3eb-7a65-4ebb-b8bb-f2e1d48b4dfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:34.213632 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007f3eb-7a65-4ebb-b8bb-f2e1d48b4dfd None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:34.245793 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 408/818] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:39:34.251667 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81ddbf-9772-45de-ae7f-82b91f30b87b None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:34.370349 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81ddbf-9772-45de-ae7f-82b91f30b87b None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:34.415118 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b190e0-8dc4-43d6-9ae2-5460b0a3da56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:34.416348 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b190e0-8dc4-43d6-9ae2-5460b0a3da56 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:34.416835 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b190e0-8dc4-43d6-9ae2-5460b0a3da56 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:34.417318 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b190e0-8dc4-43d6-9ae2-5460b0a3da56 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:34.427097 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dfb95-a239-4cdf-9d9e-3dae494585fc None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:34.427413 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dfb95-a239-4cdf-9d9e-3dae494585fc None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:34.427646 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dfb95-a239-4cdf-9d9e-3dae494585fc None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:34.427985 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b190e0-8dc4-43d6-9ae2-5460b0a3da56 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:34.429697 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b190e0-8dc4-43d6-9ae2-5460b0a3da56 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:34.429836 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 409/819] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:39:34.437081 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615db8e-fe41-4b03-8e74-461b1e108d9f None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:34.437301 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615db8e-fe41-4b03-8e74-461b1e108d9f None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:34.437670 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615db8e-fe41-4b03-8e74-461b1e108d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:34.454791 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-b1b190e0-8dc4-43d6-9ae2-5460b0a3da56 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 20:39:34.461713 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 411/820] 10.222.0.49 () {56 vars in 1093 bytes} [Fri Oct 28 20:39:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:34.462664 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b190e0-8dc4-43d6-9ae2-5460b0a3da56 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:34.472603 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-9615db8e-fe41-4b03-8e74-461b1e108d9f None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:34.477921 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-9615db8e-fe41-4b03-8e74-461b1e108d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:34.605418 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 410/821] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:39:34.659867 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b190e0-8dc4-43d6-9ae2-5460b0a3da56 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:34.664343 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615db8e-fe41-4b03-8e74-461b1e108d9f None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:34.742071 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53b3a6-4436-4a1a-88c5-7ea0ea2ae089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:34.743123 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53b3a6-4436-4a1a-88c5-7ea0ea2ae089 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:34.743621 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53b3a6-4436-4a1a-88c5-7ea0ea2ae089 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:34.744133 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53b3a6-4436-4a1a-88c5-7ea0ea2ae089 None admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:34.745139 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53b3a6-4436-4a1a-88c5-7ea0ea2ae089 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:34.745595 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53b3a6-4436-4a1a-88c5-7ea0ea2ae089 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:34.747222 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53b3a6-4436-4a1a-88c5-7ea0ea2ae089 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:34.782384 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 412/822] 10.222.0.49 () {56 vars in 1133 bytes} [Fri Oct 28 20:39:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:34.789877 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53b3a6-4436-4a1a-88c5-7ea0ea2ae089 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:34.854857 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615db8e-fe41-4b03-8e74-461b1e108d9f None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:34.935947 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe455742-7a9e-42c0-b1f3-b8dfd4f009e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:34.937017 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe455742-7a9e-42c0-b1f3-b8dfd4f009e8 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:34.937441 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe455742-7a9e-42c0-b1f3-b8dfd4f009e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:34.937874 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe455742-7a9e-42c0-b1f3-b8dfd4f009e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:34.960176 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe455742-7a9e-42c0-b1f3-b8dfd4f009e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:39:34.976590 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53b3a6-4436-4a1a-88c5-7ea0ea2ae089 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:34.978708 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-fe455742-7a9e-42c0-b1f3-b8dfd4f009e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 20:39:34.986576 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 411/823] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 20:39:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:34.989671 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe455742-7a9e-42c0-b1f3-b8dfd4f009e8 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:35.042558 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f914eb-32b2-42bf-9cb5-ffea0bd43b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:35.043411 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f914eb-32b2-42bf-9cb5-ffea0bd43b96 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:35.043833 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f914eb-32b2-42bf-9cb5-ffea0bd43b96 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:35.044161 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f914eb-32b2-42bf-9cb5-ffea0bd43b96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:35.127117 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f914eb-32b2-42bf-9cb5-ffea0bd43b96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:35.129147 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f914eb-32b2-42bf-9cb5-ffea0bd43b96 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:35.194007 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe455742-7a9e-42c0-b1f3-b8dfd4f009e8 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:35.237984 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c1689-d272-49e1-9b42-6edc821d2a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:35.239130 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c1689-d272-49e1-9b42-6edc821d2a70 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:35.239615 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c1689-d272-49e1-9b42-6edc821d2a70 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:35.240123 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c1689-d272-49e1-9b42-6edc821d2a70 None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:35.247769 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 413/824] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:39:34 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 20:39:35.247769 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed76a36-d3f7-4580-a03e-081ba0e1593a None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:35.247769 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed76a36-d3f7-4580-a03e-081ba0e1593a None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:35.247769 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed76a36-d3f7-4580-a03e-081ba0e1593a None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:35.247769 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 414/825] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:39:35.247769 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed76a36-d3f7-4580-a03e-081ba0e1593a None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:35.248799 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c1689-d272-49e1-9b42-6edc821d2a70 None admin] RBAC: Adding query filter params (name=service) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:35.249417 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c1689-d272-49e1-9b42-6edc821d2a70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:35.251137 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c1689-d272-49e1-9b42-6edc821d2a70 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:35.263624 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 412/826] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 20:39:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:39:35.265377 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75437928-8c75-467d-85a3-f5a668d30c13 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:35.265908 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75437928-8c75-467d-85a3-f5a668d30c13 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:35.266404 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75437928-8c75-467d-85a3-f5a668d30c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:35.291454 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-75437928-8c75-467d-85a3-f5a668d30c13 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:35.293136 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-75437928-8c75-467d-85a3-f5a668d30c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:35.359186 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed76a36-d3f7-4580-a03e-081ba0e1593a None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:35.376078 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 413/827] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:39:35.377632 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75437928-8c75-467d-85a3-f5a668d30c13 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:35.396812 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c6b05c-f360-4ce6-a0a0-6964ef0d08ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:35.397873 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6b05c-f360-4ce6-a0a0-6964ef0d08ba None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:35.397873 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6b05c-f360-4ce6-a0a0-6964ef0d08ba None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:35.398147 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6b05c-f360-4ce6-a0a0-6964ef0d08ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:35.411797 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c6b05c-f360-4ce6-a0a0-6964ef0d08ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:35.411993 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c6b05c-f360-4ce6-a0a0-6964ef0d08ba None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:35.435003 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-29c6b05c-f360-4ce6-a0a0-6964ef0d08ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:35.441320 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 415/828] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:35.441320 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c6b05c-f360-4ce6-a0a0-6964ef0d08ba None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:35.514697 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75437928-8c75-467d-85a3-f5a668d30c13 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:35.550691 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c6b05c-f360-4ce6-a0a0-6964ef0d08ba None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:35.556752 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b9f15-f017-4aef-a353-dfb4be7f5572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:35.557923 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b9f15-f017-4aef-a353-dfb4be7f5572 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:35.558402 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b9f15-f017-4aef-a353-dfb4be7f5572 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:35.558898 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b9f15-f017-4aef-a353-dfb4be7f5572 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:35.571609 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b9f15-f017-4aef-a353-dfb4be7f5572 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:35.573622 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b9f15-f017-4aef-a353-dfb4be7f5572 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:35.591381 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e457f-b286-42e8-b629-260a779fe617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:35.592245 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e457f-b286-42e8-b629-260a779fe617 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:35.592523 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e457f-b286-42e8-b629-260a779fe617 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:35.592787 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e457f-b286-42e8-b629-260a779fe617 None admin] PATH_INFO: `/v3/services/network` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:35.593457 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e457f-b286-42e8-b629-260a779fe617 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:35.594767 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-c31b9f15-f017-4aef-a353-dfb4be7f5572 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:35.594901 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e457f-b286-42e8-b629-260a779fe617 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:35.597283 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 414/829] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:35.598431 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b9f15-f017-4aef-a353-dfb4be7f5572 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:35.607720 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-ff0e457f-b286-42e8-b629-260a779fe617 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 20:39:35.608984 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 416/830] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:39:35 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:35.609805 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e457f-b286-42e8-b629-260a779fe617 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:35.714350 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b9f15-f017-4aef-a353-dfb4be7f5572 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:35.719536 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e457f-b286-42e8-b629-260a779fe617 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:35.756910 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22acf6-86da-4db6-af03-0aa1635d5128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:35.758055 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22acf6-86da-4db6-af03-0aa1635d5128 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:35.758310 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af8f10-50e8-42e3-ad84-fbbb31721774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:35.758827 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22acf6-86da-4db6-af03-0aa1635d5128 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:35.759002 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af8f10-50e8-42e3-ad84-fbbb31721774 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:35.759241 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af8f10-50e8-42e3-ad84-fbbb31721774 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:35.759506 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af8f10-50e8-42e3-ad84-fbbb31721774 None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:35.759943 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22acf6-86da-4db6-af03-0aa1635d5128 None admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:35.760264 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af8f10-50e8-42e3-ad84-fbbb31721774 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:35.760562 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af8f10-50e8-42e3-ad84-fbbb31721774 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:35.761285 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22acf6-86da-4db6-af03-0aa1635d5128 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:35.761797 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22acf6-86da-4db6-af03-0aa1635d5128 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:35.761960 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af8f10-50e8-42e3-ad84-fbbb31721774 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:35.763522 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22acf6-86da-4db6-af03-0aa1635d5128 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:35.776256 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 417/831] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:35.777036 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af8f10-50e8-42e3-ad84-fbbb31721774 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:35.782305 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 415/832] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:35.784452 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22acf6-86da-4db6-af03-0aa1635d5128 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:35.887162 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af8f10-50e8-42e3-ad84-fbbb31721774 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:35.896124 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22acf6-86da-4db6-af03-0aa1635d5128 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:35.924663 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0bbd8-9cfa-49bb-a797-19dd40e346d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:35.925483 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0bbd8-9cfa-49bb-a797-19dd40e346d9 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:35.926042 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0bbd8-9cfa-49bb-a797-19dd40e346d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:35.926042 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0bbd8-9cfa-49bb-a797-19dd40e346d9 None admin] PATH_INFO: `/v3/services` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:35.926718 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0bbd8-9cfa-49bb-a797-19dd40e346d9 None admin] RBAC: Adding query filter params (name=network) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:35.927015 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0bbd8-9cfa-49bb-a797-19dd40e346d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:35.928448 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0bbd8-9cfa-49bb-a797-19dd40e346d9 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:35.933894 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 418/833] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Oct 28 20:39:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:35.934822 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0bbd8-9cfa-49bb-a797-19dd40e346d9 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:35.935530 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361843d3-5c9b-4364-a5ea-71a3e7e2d451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:35.936666 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361843d3-5c9b-4364-a5ea-71a3e7e2d451 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:35.937154 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361843d3-5c9b-4364-a5ea-71a3e7e2d451 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:35.937625 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361843d3-5c9b-4364-a5ea-71a3e7e2d451 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:35.947070 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361843d3-5c9b-4364-a5ea-71a3e7e2d451 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:35.948981 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361843d3-5c9b-4364-a5ea-71a3e7e2d451 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:35.963960 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-361843d3-5c9b-4364-a5ea-71a3e7e2d451 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 20:39:35.970494 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 416/834] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:39:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:39:35.972370 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361843d3-5c9b-4364-a5ea-71a3e7e2d451 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:36.044609 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0bbd8-9cfa-49bb-a797-19dd40e346d9 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:36.082232 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f2d04-755b-463f-bf55-9bf8f2b0cba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:36.083314 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f2d04-755b-463f-bf55-9bf8f2b0cba6 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:36.083314 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f2d04-755b-463f-bf55-9bf8f2b0cba6 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:36.083587 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f2d04-755b-463f-bf55-9bf8f2b0cba6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:36.086556 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361843d3-5c9b-4364-a5ea-71a3e7e2d451 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:36.092007 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f2d04-755b-463f-bf55-9bf8f2b0cba6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:36.093496 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f2d04-755b-463f-bf55-9bf8f2b0cba6 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:36.108670 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-402f2d04-755b-463f-bf55-9bf8f2b0cba6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 20:39:36.110658 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 419/835] 10.222.0.49 () {56 vars in 1117 bytes} [Fri Oct 28 20:39:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:36.111076 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f2d04-755b-463f-bf55-9bf8f2b0cba6 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:36.126520 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfcf64-b4aa-4b1e-a143-286e23e110e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:36.128255 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfcf64-b4aa-4b1e-a143-286e23e110e6 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:36.128853 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfcf64-b4aa-4b1e-a143-286e23e110e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:36.129375 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfcf64-b4aa-4b1e-a143-286e23e110e6 None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:36.130355 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccfcf64-b4aa-4b1e-a143-286e23e110e6 None admin] RBAC: Adding query filter params (type=network) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:36.130873 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccfcf64-b4aa-4b1e-a143-286e23e110e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:36.132911 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccfcf64-b4aa-4b1e-a143-286e23e110e6 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:36.139294 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 417/836] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Oct 28 20:39:35 2022] GET /identity/v3/services?type=network => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:36.140603 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfcf64-b4aa-4b1e-a143-286e23e110e6 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:36.268823 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfcf64-b4aa-4b1e-a143-286e23e110e6 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:36.288424 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f2d04-755b-463f-bf55-9bf8f2b0cba6 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:36.311111 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99310e-bc5d-4a19-afd9-419a89e22a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:36.312230 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99310e-bc5d-4a19-afd9-419a89e22a47 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:36.312745 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99310e-bc5d-4a19-afd9-419a89e22a47 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:36.313258 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99310e-bc5d-4a19-afd9-419a89e22a47 None admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:36.314375 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec99310e-bc5d-4a19-afd9-419a89e22a47 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:36.315829 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec99310e-bc5d-4a19-afd9-419a89e22a47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:36.317486 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec99310e-bc5d-4a19-afd9-419a89e22a47 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:36.339028 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 418/837] 10.222.0.49 () {56 vars in 1149 bytes} [Fri Oct 28 20:39:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:36.340286 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99310e-bc5d-4a19-afd9-419a89e22a47 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:36.349720 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44cc15-1a47-41a8-b543-df50e2598a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:36.350902 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44cc15-1a47-41a8-b543-df50e2598a7f None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:36.351279 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44cc15-1a47-41a8-b543-df50e2598a7f None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:36.351783 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44cc15-1a47-41a8-b543-df50e2598a7f None admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:36.353200 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44cc15-1a47-41a8-b543-df50e2598a7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:36.354108 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44cc15-1a47-41a8-b543-df50e2598a7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:36.356415 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44cc15-1a47-41a8-b543-df50e2598a7f None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:36.385676 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 420/838] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 20:39:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:36.385676 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44cc15-1a47-41a8-b543-df50e2598a7f None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:36.462031 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99310e-bc5d-4a19-afd9-419a89e22a47 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:36.503231 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b423db-f646-41b2-824c-1db975d40e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:36.504344 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b423db-f646-41b2-824c-1db975d40e2f None admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:36.504850 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b423db-f646-41b2-824c-1db975d40e2f None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:36.505337 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b423db-f646-41b2-824c-1db975d40e2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:36.506299 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b423db-f646-41b2-824c-1db975d40e2f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:36.508025 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b423db-f646-41b2-824c-1db975d40e2f None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:36.531034 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 419/839] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:39:36 2022] POST /identity/v3/endpoints => generated 327 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:39:36.532442 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b423db-f646-41b2-824c-1db975d40e2f None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:36.650095 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44cc15-1a47-41a8-b543-df50e2598a7f None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:36.679326 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b423db-f646-41b2-824c-1db975d40e2f None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:36.723816 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83632489-ab0d-4da7-8bbe-e34fc5f8a459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:36.726220 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83632489-ab0d-4da7-8bbe-e34fc5f8a459 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:36.726971 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83632489-ab0d-4da7-8bbe-e34fc5f8a459 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:36.728862 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83632489-ab0d-4da7-8bbe-e34fc5f8a459 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:36.730024 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83632489-ab0d-4da7-8bbe-e34fc5f8a459 None admin] RBAC: Adding query filter params (role.id=8fe105eeb7bf4856a94b0633bd781414, scope.project.id=c55c2ee59af14cf8a7e4275de4f43037, user.id=04bc6ee009e34a5f82e2807db51523d3) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:36.730660 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83632489-ab0d-4da7-8bbe-e34fc5f8a459 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:36.734230 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83632489-ab0d-4da7-8bbe-e34fc5f8a459 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:36.753278 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 420/840] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:39:36 2022] GET /identity/v3/role_assignments?user.id=04bc6ee009e34a5f82e2807db51523d3&scope.project.id=c55c2ee59af14cf8a7e4275de4f43037&role.id=8fe105eeb7bf4856a94b0633bd781414 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:36.753936 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aab662-3e96-4e2e-8732-a130fa13600f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:36.754914 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aab662-3e96-4e2e-8732-a130fa13600f None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:36.755396 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aab662-3e96-4e2e-8732-a130fa13600f None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:36.755896 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aab662-3e96-4e2e-8732-a130fa13600f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:36.853076 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aab662-3e96-4e2e-8732-a130fa13600f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:36.854995 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aab662-3e96-4e2e-8732-a130fa13600f None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:36.999203 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 421/841] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:39:36 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 20:39:37.005721 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83632489-ab0d-4da7-8bbe-e34fc5f8a459 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:37.043577 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb56c94-a9ae-43aa-a118-9d6c1bc2724a None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:37.043935 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb56c94-a9ae-43aa-a118-9d6c1bc2724a None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:37.044200 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb56c94-a9ae-43aa-a118-9d6c1bc2724a None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:37.046288 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 422/842] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:39:37.052567 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee238622-ce7d-473a-b388-c4b0af563249 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:37.052891 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee238622-ce7d-473a-b388-c4b0af563249 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:37.053109 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee238622-ce7d-473a-b388-c4b0af563249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:37.076771 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-ee238622-ce7d-473a-b388-c4b0af563249 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:37.079240 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-ee238622-ce7d-473a-b388-c4b0af563249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:37.155068 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83632489-ab0d-4da7-8bbe-e34fc5f8a459 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:37.228283 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3368fd-bbb5-4dab-98a3-1b7022c38e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:37.228283 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3368fd-bbb5-4dab-98a3-1b7022c38e81 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:37.228283 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3368fd-bbb5-4dab-98a3-1b7022c38e81 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:37.228283 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3368fd-bbb5-4dab-98a3-1b7022c38e81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:37.236254 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 423/843] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:37 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:39:37.240687 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3368fd-bbb5-4dab-98a3-1b7022c38e81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:37.242181 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3368fd-bbb5-4dab-98a3-1b7022c38e81 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:37.260370 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-8c3368fd-bbb5-4dab-98a3-1b7022c38e81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:37.261907 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 421/844] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:37.268286 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee238622-ce7d-473a-b388-c4b0af563249 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:37.276974 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3368fd-bbb5-4dab-98a3-1b7022c38e81 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:37.397227 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee238622-ce7d-473a-b388-c4b0af563249 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:37.442517 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7927e-c947-48bd-8392-ce17ae9ef42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:37.443660 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7927e-c947-48bd-8392-ce17ae9ef42f None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:37.444201 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7927e-c947-48bd-8392-ce17ae9ef42f None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:37.444777 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7927e-c947-48bd-8392-ce17ae9ef42f None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:37.446182 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7927e-c947-48bd-8392-ce17ae9ef42f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:37.446742 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7927e-c947-48bd-8392-ce17ae9ef42f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:37.449281 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7927e-c947-48bd-8392-ce17ae9ef42f None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:37.451193 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3368fd-bbb5-4dab-98a3-1b7022c38e81 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:37.476257 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 424/845] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:37.480621 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7927e-c947-48bd-8392-ce17ae9ef42f None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:37.496777 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543b561-c0f4-4341-bfac-073648e6dd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:37.498191 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543b561-c0f4-4341-bfac-073648e6dd11 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:37.498480 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543b561-c0f4-4341-bfac-073648e6dd11 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:37.498751 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543b561-c0f4-4341-bfac-073648e6dd11 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:37.499424 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543b561-c0f4-4341-bfac-073648e6dd11 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:37.501350 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543b561-c0f4-4341-bfac-073648e6dd11 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:37.516091 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-3543b561-c0f4-4341-bfac-073648e6dd11 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 20:39:37.517702 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 422/846] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 20:39:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:39:37.519458 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b960873-d0c3-4679-b2d9-08a0c5065f37 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:37.519757 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b960873-d0c3-4679-b2d9-08a0c5065f37 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:37.520711 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b960873-d0c3-4679-b2d9-08a0c5065f37 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:37.522901 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 423/847] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:39:37.523683 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b960873-d0c3-4679-b2d9-08a0c5065f37 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:37.619444 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7927e-c947-48bd-8392-ce17ae9ef42f None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:37.641395 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b960873-d0c3-4679-b2d9-08a0c5065f37 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:37.656270 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2d607-4d2c-4a9e-b850-b7ed2ba92479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:37.657064 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2d607-4d2c-4a9e-b850-b7ed2ba92479 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:37.657349 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2d607-4d2c-4a9e-b850-b7ed2ba92479 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:37.657621 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2d607-4d2c-4a9e-b850-b7ed2ba92479 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:37.665744 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2d607-4d2c-4a9e-b850-b7ed2ba92479 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:37.667207 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2d607-4d2c-4a9e-b850-b7ed2ba92479 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:37.681667 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2906a8-98a6-488b-89e5-684e613bb273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:37.681883 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-47f2d607-4d2c-4a9e-b850-b7ed2ba92479 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 20:39:37.682324 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2906a8-98a6-488b-89e5-684e613bb273 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:37.682602 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2906a8-98a6-488b-89e5-684e613bb273 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:37.688022 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2906a8-98a6-488b-89e5-684e613bb273 None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:37.688192 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 425/848] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:39:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:39:37.688294 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2906a8-98a6-488b-89e5-684e613bb273 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:37.688294 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2906a8-98a6-488b-89e5-684e613bb273 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:37.688457 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca1c58-3018-446b-adb9-17314ff2059b None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:37.688457 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca1c58-3018-446b-adb9-17314ff2059b None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:37.688457 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca1c58-3018-446b-adb9-17314ff2059b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:37.688701 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2906a8-98a6-488b-89e5-684e613bb273 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:37.693866 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 424/849] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 20:39:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:37.695770 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2906a8-98a6-488b-89e5-684e613bb273 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:37.707397 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-20ca1c58-3018-446b-adb9-17314ff2059b None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:37.708652 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-20ca1c58-3018-446b-adb9-17314ff2059b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:37.778976 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 426/850] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:37 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:39:37.780211 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca1c58-3018-446b-adb9-17314ff2059b None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:37.816113 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2906a8-98a6-488b-89e5-684e613bb273 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:37.859520 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad0cee-aa7b-4086-bda0-55fb798df2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:37.860197 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad0cee-aa7b-4086-bda0-55fb798df2a3 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:37.860473 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad0cee-aa7b-4086-bda0-55fb798df2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:37.860742 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad0cee-aa7b-4086-bda0-55fb798df2a3 None admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:37.862160 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad0cee-aa7b-4086-bda0-55fb798df2a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:37.862405 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad0cee-aa7b-4086-bda0-55fb798df2a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:37.863876 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad0cee-aa7b-4086-bda0-55fb798df2a3 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:37.880893 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 425/851] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 20:39:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:37.880893 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad0cee-aa7b-4086-bda0-55fb798df2a3 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:37.908945 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca1c58-3018-446b-adb9-17314ff2059b None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:37.946930 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6ff6d-bf76-44c5-9823-304743184c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:37.947639 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6ff6d-bf76-44c5-9823-304743184c2f None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:37.947936 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6ff6d-bf76-44c5-9823-304743184c2f None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:37.948210 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6ff6d-bf76-44c5-9823-304743184c2f None admin] PATH_INFO: `/v3/services` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:37.948935 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf6ff6d-bf76-44c5-9823-304743184c2f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:37.949244 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf6ff6d-bf76-44c5-9823-304743184c2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:37.950631 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf6ff6d-bf76-44c5-9823-304743184c2f None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:37.967820 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 427/852] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 20:39:37 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:37.967820 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6ff6d-bf76-44c5-9823-304743184c2f None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:38.012791 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad0cee-aa7b-4086-bda0-55fb798df2a3 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:38.076600 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440760c-1c48-412d-b12a-eb70ae5ca872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:38.077990 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440760c-1c48-412d-b12a-eb70ae5ca872 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:38.078529 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440760c-1c48-412d-b12a-eb70ae5ca872 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:38.079064 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440760c-1c48-412d-b12a-eb70ae5ca872 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:38.099394 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1440760c-1c48-412d-b12a-eb70ae5ca872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:39:38.112395 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-1440760c-1c48-412d-b12a-eb70ae5ca872 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 20:39:38.114982 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 426/853] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 20:39:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:38.121345 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440760c-1c48-412d-b12a-eb70ae5ca872 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:38.149971 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6ff6d-bf76-44c5-9823-304743184c2f None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:38.194396 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcff91-340f-45f3-b917-9955992bb91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:38.195105 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcff91-340f-45f3-b917-9955992bb91d None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:38.195384 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcff91-340f-45f3-b917-9955992bb91d None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:38.195657 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcff91-340f-45f3-b917-9955992bb91d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:38.196592 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dcff91-340f-45f3-b917-9955992bb91d None admin] RBAC: Adding query filter params (role.id=7190d40a528146289333f0b9c16a6370, scope.project.id=c55c2ee59af14cf8a7e4275de4f43037, user.id=78cde480dd8b4a85ac30895026bfc406) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:38.196909 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dcff91-340f-45f3-b917-9955992bb91d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:38.198415 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dcff91-340f-45f3-b917-9955992bb91d None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:38.219050 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 428/854] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:39:37 2022] GET /identity/v3/role_assignments?user.id=78cde480dd8b4a85ac30895026bfc406&scope.project.id=c55c2ee59af14cf8a7e4275de4f43037&role.id=7190d40a528146289333f0b9c16a6370 => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:38.322197 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440760c-1c48-412d-b12a-eb70ae5ca872 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:38.379347 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32d61e-6594-4c08-91bd-aad752870dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:38.379988 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32d61e-6594-4c08-91bd-aad752870dcc None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:38.380268 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32d61e-6594-4c08-91bd-aad752870dcc None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:38.380541 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32d61e-6594-4c08-91bd-aad752870dcc None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:38.381314 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32d61e-6594-4c08-91bd-aad752870dcc None admin] RBAC: Adding query filter params (name=admin) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:38.381617 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32d61e-6594-4c08-91bd-aad752870dcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:38.383149 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32d61e-6594-4c08-91bd-aad752870dcc None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:38.393841 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 427/855] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:39:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:38.400328 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcff91-340f-45f3-b917-9955992bb91d None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:38.575694 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcff91-340f-45f3-b917-9955992bb91d None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:38.620410 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59336d1a-ebb2-4a1f-b587-676e8388b4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:38.621258 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59336d1a-ebb2-4a1f-b587-676e8388b4e2 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:38.621636 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59336d1a-ebb2-4a1f-b587-676e8388b4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:38.621986 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59336d1a-ebb2-4a1f-b587-676e8388b4e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:38.639055 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59336d1a-ebb2-4a1f-b587-676e8388b4e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:38.640480 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59336d1a-ebb2-4a1f-b587-676e8388b4e2 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:38.659787 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-59336d1a-ebb2-4a1f-b587-676e8388b4e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:38.661640 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 429/856] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:39:38.668030 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32d61e-6594-4c08-91bd-aad752870dcc None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:38.810952 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32d61e-6594-4c08-91bd-aad752870dcc None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:38.863062 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e14fb-3cf4-47bd-91a6-fca282fa7922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:38.864236 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e14fb-3cf4-47bd-91a6-fca282fa7922 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:38.864677 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e14fb-3cf4-47bd-91a6-fca282fa7922 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:38.865121 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e14fb-3cf4-47bd-91a6-fca282fa7922 None admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:38.866517 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e14fb-3cf4-47bd-91a6-fca282fa7922 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:38.867076 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e14fb-3cf4-47bd-91a6-fca282fa7922 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:38.869446 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e14fb-3cf4-47bd-91a6-fca282fa7922 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:38.890084 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 428/857] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:39:38.898884 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59336d1a-ebb2-4a1f-b587-676e8388b4e2 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:39.066871 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59336d1a-ebb2-4a1f-b587-676e8388b4e2 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:39.109043 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ee0ec-1eaa-4509-bee5-fd2d2b501ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:39.109877 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ee0ec-1eaa-4509-bee5-fd2d2b501ffb None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:39.110156 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ee0ec-1eaa-4509-bee5-fd2d2b501ffb None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:39.110429 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ee0ec-1eaa-4509-bee5-fd2d2b501ffb None admin] PATH_INFO: `/v3/users/swift` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:39.122769 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ee0ec-1eaa-4509-bee5-fd2d2b501ffb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:39.124684 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ee0ec-1eaa-4509-bee5-fd2d2b501ffb None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:39.141261 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-0d9ee0ec-1eaa-4509-bee5-fd2d2b501ffb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 20:39:39.144135 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 430/858] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 20:39:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:39.152911 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e14fb-3cf4-47bd-91a6-fca282fa7922 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:39.324550 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e14fb-3cf4-47bd-91a6-fca282fa7922 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:39.364112 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ba8d4-dcac-425d-a67d-d3a1d19bb657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:39.365147 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ba8d4-dcac-425d-a67d-d3a1d19bb657 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:39.365626 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ba8d4-dcac-425d-a67d-d3a1d19bb657 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:39.366115 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ba8d4-dcac-425d-a67d-d3a1d19bb657 None admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:39.367183 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ba8d4-dcac-425d-a67d-d3a1d19bb657 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:39.367699 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ba8d4-dcac-425d-a67d-d3a1d19bb657 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:39.369735 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ba8d4-dcac-425d-a67d-d3a1d19bb657 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:39.390103 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 429/859] 10.222.0.49 () {56 vars in 1135 bytes} [Fri Oct 28 20:39:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:39.400097 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ee0ec-1eaa-4509-bee5-fd2d2b501ffb None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:39.582964 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ee0ec-1eaa-4509-bee5-fd2d2b501ffb None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:39.641045 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e09cc-c617-42b7-a32f-c7901e05f6ce None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:39.641495 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1d8cd-c89d-4510-8b15-184789b1097b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:39.642262 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e09cc-c617-42b7-a32f-c7901e05f6ce None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:39.643033 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1d8cd-c89d-4510-8b15-184789b1097b None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:39.643335 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1d8cd-c89d-4510-8b15-184789b1097b None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:39.643652 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1d8cd-c89d-4510-8b15-184789b1097b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:39.644405 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e09cc-c617-42b7-a32f-c7901e05f6ce None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:39.648598 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 430/860] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:39:39.654033 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f29b4-3a3c-4529-a6fc-6732f2a21ce5 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:39.654423 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f29b4-3a3c-4529-a6fc-6732f2a21ce5 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:39.654889 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f29b4-3a3c-4529-a6fc-6732f2a21ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:39.679101 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-7a2f29b4-3a3c-4529-a6fc-6732f2a21ce5 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:39.680986 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-7a2f29b4-3a3c-4529-a6fc-6732f2a21ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:39.770895 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1d8cd-c89d-4510-8b15-184789b1097b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:39.772868 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1d8cd-c89d-4510-8b15-184789b1097b None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:39.783768 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 431/861] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:39 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 20:39:39.803148 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f29b4-3a3c-4529-a6fc-6732f2a21ce5 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:39.914597 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 431/862] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:39:39 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 28 20:39:39.923085 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1d8cd-c89d-4510-8b15-184789b1097b None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:39.972533 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f29b4-3a3c-4529-a6fc-6732f2a21ce5 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:40.027657 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca1fa5-8a63-4085-92bf-bf51e78cf95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:40.029284 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca1fa5-8a63-4085-92bf-bf51e78cf95e None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:40.029928 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca1fa5-8a63-4085-92bf-bf51e78cf95e None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:40.030560 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca1fa5-8a63-4085-92bf-bf51e78cf95e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:40.032057 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca1fa5-8a63-4085-92bf-bf51e78cf95e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:40.035263 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca1fa5-8a63-4085-92bf-bf51e78cf95e None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:40.044145 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1d8cd-c89d-4510-8b15-184789b1097b None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:40.058707 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-d6ca1fa5-8a63-4085-92bf-bf51e78cf95e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 20:39:40.062001 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 432/863] 10.222.0.49 () {56 vars in 1132 bytes} [Fri Oct 28 20:39:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:39:40.069552 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca1fa5-8a63-4085-92bf-bf51e78cf95e None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:40.101443 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1526ea-8ddd-4690-9ace-c115a01cad93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:40.102867 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1526ea-8ddd-4690-9ace-c115a01cad93 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:40.103687 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1526ea-8ddd-4690-9ace-c115a01cad93 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:40.103954 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1526ea-8ddd-4690-9ace-c115a01cad93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:40.124598 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1526ea-8ddd-4690-9ace-c115a01cad93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:40.128126 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1526ea-8ddd-4690-9ace-c115a01cad93 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:40.162629 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-ce1526ea-8ddd-4690-9ace-c115a01cad93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:40.172114 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 432/864] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:40.174347 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1526ea-8ddd-4690-9ace-c115a01cad93 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:40.191872 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca1fa5-8a63-4085-92bf-bf51e78cf95e None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:40.259463 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d3f0a-92cd-42ca-b581-7cd35c04e046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:40.260951 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d3f0a-92cd-42ca-b581-7cd35c04e046 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:40.261454 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d3f0a-92cd-42ca-b581-7cd35c04e046 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:40.261940 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d3f0a-92cd-42ca-b581-7cd35c04e046 None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:40.263285 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d3f0a-92cd-42ca-b581-7cd35c04e046 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:40.263857 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d3f0a-92cd-42ca-b581-7cd35c04e046 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:40.266617 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d3f0a-92cd-42ca-b581-7cd35c04e046 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:40.289948 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 433/865] 10.222.0.49 () {56 vars in 1126 bytes} [Fri Oct 28 20:39:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:40.295140 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d3f0a-92cd-42ca-b581-7cd35c04e046 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:40.318187 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1526ea-8ddd-4690-9ace-c115a01cad93 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:40.366203 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0f700-1d42-4d70-a7f7-185e8a4c6bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:40.367276 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0f700-1d42-4d70-a7f7-185e8a4c6bfb None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:40.367807 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0f700-1d42-4d70-a7f7-185e8a4c6bfb None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:40.368298 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0f700-1d42-4d70-a7f7-185e8a4c6bfb None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:40.369247 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0f700-1d42-4d70-a7f7-185e8a4c6bfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:40.369764 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0f700-1d42-4d70-a7f7-185e8a4c6bfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:40.372131 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0f700-1d42-4d70-a7f7-185e8a4c6bfb None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:40.388570 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 433/866] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:39:40.397444 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0f700-1d42-4d70-a7f7-185e8a4c6bfb None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:40.479175 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d3f0a-92cd-42ca-b581-7cd35c04e046 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:40.534269 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0f700-1d42-4d70-a7f7-185e8a4c6bfb None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:40.550001 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fc21f-4e29-4587-ad5a-db8c2e1b89df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:40.551136 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fc21f-4e29-4587-ad5a-db8c2e1b89df None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:40.551637 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fc21f-4e29-4587-ad5a-db8c2e1b89df None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:40.552135 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fc21f-4e29-4587-ad5a-db8c2e1b89df None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:40.553058 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377fc21f-4e29-4587-ad5a-db8c2e1b89df None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:40.553563 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377fc21f-4e29-4587-ad5a-db8c2e1b89df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:40.555187 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377fc21f-4e29-4587-ad5a-db8c2e1b89df None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:40.566169 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 434/867] 10.222.0.49 () {56 vars in 1126 bytes} [Fri Oct 28 20:39:40 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:39:40.607223 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f57ba7-f93e-416e-be64-196eaafc9b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:40.608631 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f57ba7-f93e-416e-be64-196eaafc9b98 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:40.609111 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f57ba7-f93e-416e-be64-196eaafc9b98 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:40.609603 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f57ba7-f93e-416e-be64-196eaafc9b98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:40.623600 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f57ba7-f93e-416e-be64-196eaafc9b98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:40.626442 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f57ba7-f93e-416e-be64-196eaafc9b98 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:40.659351 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-e5f57ba7-f93e-416e-be64-196eaafc9b98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 20:39:40.662710 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 434/868] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:39:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:40.671775 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fc21f-4e29-4587-ad5a-db8c2e1b89df None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:40.874132 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fc21f-4e29-4587-ad5a-db8c2e1b89df None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:40.940821 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be23b4-a554-408a-b5f2-cabaf8b24c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:40.941159 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be23b4-a554-408a-b5f2-cabaf8b24c1d None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:40.941671 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be23b4-a554-408a-b5f2-cabaf8b24c1d None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:40.942141 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be23b4-a554-408a-b5f2-cabaf8b24c1d None admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:40.943728 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be23b4-a554-408a-b5f2-cabaf8b24c1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:40.944300 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be23b4-a554-408a-b5f2-cabaf8b24c1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:40.947239 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be23b4-a554-408a-b5f2-cabaf8b24c1d None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:40.972694 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 435/869] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 20:39:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:40.982438 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f57ba7-f93e-416e-be64-196eaafc9b98 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:41.132407 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f57ba7-f93e-416e-be64-196eaafc9b98 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:41.175071 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa5020-cbe0-48f1-b90e-cd2249c4322b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:41.175760 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa5020-cbe0-48f1-b90e-cd2249c4322b None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:41.176054 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa5020-cbe0-48f1-b90e-cd2249c4322b None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:41.176345 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa5020-cbe0-48f1-b90e-cd2249c4322b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:41.177185 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa5020-cbe0-48f1-b90e-cd2249c4322b None admin] RBAC: Adding query filter params (role.id=8fe105eeb7bf4856a94b0633bd781414, scope.project.id=c55c2ee59af14cf8a7e4275de4f43037, user.id=91d70db11d2d4923943bc6479bc49206) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:41.177500 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa5020-cbe0-48f1-b90e-cd2249c4322b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:41.179034 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa5020-cbe0-48f1-b90e-cd2249c4322b None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:41.186860 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 435/870] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:39:40 2022] GET /identity/v3/role_assignments?user.id=91d70db11d2d4923943bc6479bc49206&scope.project.id=c55c2ee59af14cf8a7e4275de4f43037&role.id=8fe105eeb7bf4856a94b0633bd781414 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:41.358814 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43995183-0d02-4aff-a05c-d5287001eeb4 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:41.359290 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43995183-0d02-4aff-a05c-d5287001eeb4 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:41.359807 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43995183-0d02-4aff-a05c-d5287001eeb4 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:41.363347 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 436/871] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:39:41.372912 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de13ca-561a-4a63-93ed-91c2c690b43c None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:41.373410 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de13ca-561a-4a63-93ed-91c2c690b43c None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:41.373899 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de13ca-561a-4a63-93ed-91c2c690b43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:41.404786 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-a8de13ca-561a-4a63-93ed-91c2c690b43c None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:41.406780 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-a8de13ca-561a-4a63-93ed-91c2c690b43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:41.491375 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 436/872] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:41 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:39:41.533876 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43995183-0d02-4aff-a05c-d5287001eeb4 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:41.647264 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0e257-d7b7-4f26-935f-c752ae792b6b None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:41.647838 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0e257-d7b7-4f26-935f-c752ae792b6b None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:41.647838 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0e257-d7b7-4f26-935f-c752ae792b6b None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:41.654066 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 437/873] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:39:41.656015 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41a522-fd61-4974-bd49-e5f960d11f91 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:41.656248 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41a522-fd61-4974-bd49-e5f960d11f91 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:41.656528 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41a522-fd61-4974-bd49-e5f960d11f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:41.677020 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-bc41a522-fd61-4974-bd49-e5f960d11f91 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:41.678741 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-bc41a522-fd61-4974-bd49-e5f960d11f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:41.704688 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43995183-0d02-4aff-a05c-d5287001eeb4 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:41.742834 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd684ea-200c-42bb-93e8-b50203b7d542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:41.743507 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd684ea-200c-42bb-93e8-b50203b7d542 None admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:41.743823 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd684ea-200c-42bb-93e8-b50203b7d542 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:41.744081 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd684ea-200c-42bb-93e8-b50203b7d542 None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:41.744827 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd684ea-200c-42bb-93e8-b50203b7d542 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:41.746278 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd684ea-200c-42bb-93e8-b50203b7d542 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:41.766632 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 437/874] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Oct 28 20:39:41 2022] POST /identity/v3/services => generated 251 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:39:41.824618 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 438/875] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:41 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 20:39:41.849735 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd684ea-200c-42bb-93e8-b50203b7d542 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:41.996564 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd684ea-200c-42bb-93e8-b50203b7d542 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:42.065173 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb5d8c-a97d-47e7-8e60-543bf7d9e029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:42.066993 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb5d8c-a97d-47e7-8e60-543bf7d9e029 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:42.067790 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb5d8c-a97d-47e7-8e60-543bf7d9e029 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:42.068541 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb5d8c-a97d-47e7-8e60-543bf7d9e029 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:42.089109 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb5d8c-a97d-47e7-8e60-543bf7d9e029 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:39:42.104727 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-77bb5d8c-a97d-47e7-8e60-543bf7d9e029 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 20:39:42.107853 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 438/876] 10.222.0.49 () {56 vars in 1120 bytes} [Fri Oct 28 20:39:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:42.114892 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41a522-fd61-4974-bd49-e5f960d11f91 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:42.307833 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41a522-fd61-4974-bd49-e5f960d11f91 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:42.377579 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf15ec4-829c-4bf2-aebe-aaae26feb84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:42.378927 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf15ec4-829c-4bf2-aebe-aaae26feb84a None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:42.379399 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf15ec4-829c-4bf2-aebe-aaae26feb84a None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:42.379894 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf15ec4-829c-4bf2-aebe-aaae26feb84a None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:42.381257 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf15ec4-829c-4bf2-aebe-aaae26feb84a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:42.381781 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf15ec4-829c-4bf2-aebe-aaae26feb84a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:42.384322 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf15ec4-829c-4bf2-aebe-aaae26feb84a None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:42.401032 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 439/877] 10.222.0.49 () {56 vars in 1115 bytes} [Fri Oct 28 20:39:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:42.407375 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb5d8c-a97d-47e7-8e60-543bf7d9e029 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:42.523845 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb5d8c-a97d-47e7-8e60-543bf7d9e029 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:42.562922 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc49492-3c0b-4b96-bd7f-30eefe4f457f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:42.565295 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc49492-3c0b-4b96-bd7f-30eefe4f457f None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:42.565789 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc49492-3c0b-4b96-bd7f-30eefe4f457f None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:42.566267 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc49492-3c0b-4b96-bd7f-30eefe4f457f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:42.579011 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc49492-3c0b-4b96-bd7f-30eefe4f457f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:42.581040 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc49492-3c0b-4b96-bd7f-30eefe4f457f None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:42.599664 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-ddc49492-3c0b-4b96-bd7f-30eefe4f457f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:42.606064 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 439/878] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:42.607732 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf15ec4-829c-4bf2-aebe-aaae26feb84a None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:42.789984 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf15ec4-829c-4bf2-aebe-aaae26feb84a None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:42.855981 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dafcb8d-c806-4f27-af3e-cc9e45c7b287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:42.857036 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafcb8d-c806-4f27-af3e-cc9e45c7b287 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:42.857516 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafcb8d-c806-4f27-af3e-cc9e45c7b287 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:42.858004 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafcb8d-c806-4f27-af3e-cc9e45c7b287 None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:42.859284 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dafcb8d-c806-4f27-af3e-cc9e45c7b287 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:42.859834 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dafcb8d-c806-4f27-af3e-cc9e45c7b287 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:42.863040 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dafcb8d-c806-4f27-af3e-cc9e45c7b287 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:42.882968 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 440/879] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:42.888731 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc49492-3c0b-4b96-bd7f-30eefe4f457f None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:42.997886 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc49492-3c0b-4b96-bd7f-30eefe4f457f None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:43.038527 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4df824-4531-46db-b9b6-c78a684d79c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:43.039845 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4df824-4531-46db-b9b6-c78a684d79c9 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:43.040368 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4df824-4531-46db-b9b6-c78a684d79c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:43.040867 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4df824-4531-46db-b9b6-c78a684d79c9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:43.049662 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4df824-4531-46db-b9b6-c78a684d79c9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:43.051471 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4df824-4531-46db-b9b6-c78a684d79c9 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:43.067508 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-3b4df824-4531-46db-b9b6-c78a684d79c9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 20:39:43.074061 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 440/880] 10.222.0.49 () {56 vars in 1117 bytes} [Fri Oct 28 20:39:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:43.075819 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dafcb8d-c806-4f27-af3e-cc9e45c7b287 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:43.251012 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dafcb8d-c806-4f27-af3e-cc9e45c7b287 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:43.317144 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05adecd-88a8-4e33-a3fb-0d5d47661c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:43.318648 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05adecd-88a8-4e33-a3fb-0d5d47661c01 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:43.319124 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05adecd-88a8-4e33-a3fb-0d5d47661c01 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:43.319620 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05adecd-88a8-4e33-a3fb-0d5d47661c01 None admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:43.321291 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05adecd-88a8-4e33-a3fb-0d5d47661c01 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:43.321855 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05adecd-88a8-4e33-a3fb-0d5d47661c01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:43.324667 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05adecd-88a8-4e33-a3fb-0d5d47661c01 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:43.361018 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 441/881] 10.222.0.49 () {56 vars in 1149 bytes} [Fri Oct 28 20:39:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:39:43.367251 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4df824-4531-46db-b9b6-c78a684d79c9 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:43.485740 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4df824-4531-46db-b9b6-c78a684d79c9 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:43.530477 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190e43a-fd5d-4233-931a-c631a45dbf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:43.531145 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190e43a-fd5d-4233-931a-c631a45dbf82 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:43.531427 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190e43a-fd5d-4233-931a-c631a45dbf82 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:43.531697 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190e43a-fd5d-4233-931a-c631a45dbf82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:43.613929 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190e43a-fd5d-4233-931a-c631a45dbf82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:43.615413 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190e43a-fd5d-4233-931a-c631a45dbf82 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:43.804772 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 441/882] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:39:43 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 20:39:43.811231 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05adecd-88a8-4e33-a3fb-0d5d47661c01 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:43.849060 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310ff55-6171-46ba-8774-3fc58313cbd3 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:43.849479 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310ff55-6171-46ba-8774-3fc58313cbd3 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:43.849711 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310ff55-6171-46ba-8774-3fc58313cbd3 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:43.851865 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 442/883] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:39:43.857959 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf3870-4dbe-47ec-8692-12b35b0af728 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:43.857959 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf3870-4dbe-47ec-8692-12b35b0af728 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:43.858340 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf3870-4dbe-47ec-8692-12b35b0af728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:43.883943 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-97cf3870-4dbe-47ec-8692-12b35b0af728 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:43.886583 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-97cf3870-4dbe-47ec-8692-12b35b0af728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:43.985479 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05adecd-88a8-4e33-a3fb-0d5d47661c01 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:43.991953 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 443/884] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:43 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 20:39:44.027609 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf3870-4dbe-47ec-8692-12b35b0af728 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:44.044294 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ccf3c1-a4c0-4cbd-93af-b5172efada1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:44.045127 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ccf3c1-a4c0-4cbd-93af-b5172efada1e None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:44.045404 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ccf3c1-a4c0-4cbd-93af-b5172efada1e None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:44.045680 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ccf3c1-a4c0-4cbd-93af-b5172efada1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:44.060247 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ccf3c1-a4c0-4cbd-93af-b5172efada1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:44.062336 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ccf3c1-a4c0-4cbd-93af-b5172efada1e None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:44.091925 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-c0ccf3c1-a4c0-4cbd-93af-b5172efada1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:44.095435 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 442/885] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:44.101739 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ccf3c1-a4c0-4cbd-93af-b5172efada1e None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:44.243256 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf3870-4dbe-47ec-8692-12b35b0af728 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:44.281173 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ccf3c1-a4c0-4cbd-93af-b5172efada1e None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:44.303848 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd8a6b-db5c-429f-92ce-908dc288093d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:44.304523 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd8a6b-db5c-429f-92ce-908dc288093d None admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:44.304804 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd8a6b-db5c-429f-92ce-908dc288093d None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:44.305081 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd8a6b-db5c-429f-92ce-908dc288093d None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:44.305834 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd8a6b-db5c-429f-92ce-908dc288093d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:44.307241 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd8a6b-db5c-429f-92ce-908dc288093d None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:44.331854 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 444/886] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Oct 28 20:39:44 2022] POST /identity/v3/services => generated 269 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:39:44.331854 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1df36-8f31-4854-a4a3-5b518aa72fa1 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:44.331854 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1df36-8f31-4854-a4a3-5b518aa72fa1 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:44.331854 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1df36-8f31-4854-a4a3-5b518aa72fa1 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:44.331854 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 445/887] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:39:44.340410 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd7b55-8e09-4db7-9702-501cb03372a7 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:44.340976 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd7b55-8e09-4db7-9702-501cb03372a7 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:44.341375 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd7b55-8e09-4db7-9702-501cb03372a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:44.375577 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-49fd7b55-8e09-4db7-9702-501cb03372a7 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:44.380673 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-49fd7b55-8e09-4db7-9702-501cb03372a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:44.391474 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b149cc1-91de-432c-9b88-6a15d84ba4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:44.393398 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b149cc1-91de-432c-9b88-6a15d84ba4f1 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:44.393960 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b149cc1-91de-432c-9b88-6a15d84ba4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:44.394466 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b149cc1-91de-432c-9b88-6a15d84ba4f1 None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:44.396068 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b149cc1-91de-432c-9b88-6a15d84ba4f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:44.397606 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b149cc1-91de-432c-9b88-6a15d84ba4f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:44.401230 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b149cc1-91de-432c-9b88-6a15d84ba4f1 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:44.428716 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 443/888] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:44.437962 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b149cc1-91de-432c-9b88-6a15d84ba4f1 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:44.561858 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 446/889] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:44 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 20:39:44.591924 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a6eea-a6e0-484a-987b-0ef8b4e7755d None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:44.592386 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a6eea-a6e0-484a-987b-0ef8b4e7755d None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:44.592885 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a6eea-a6e0-484a-987b-0ef8b4e7755d None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:44.596826 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 447/890] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:39:44.604652 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a6eea-a6e0-484a-987b-0ef8b4e7755d None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:44.644485 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b149cc1-91de-432c-9b88-6a15d84ba4f1 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:44.692070 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac86778-8948-4833-aff2-5a32015063f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:44.692881 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac86778-8948-4833-aff2-5a32015063f0 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:44.693187 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac86778-8948-4833-aff2-5a32015063f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:44.693476 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac86778-8948-4833-aff2-5a32015063f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:44.702769 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac86778-8948-4833-aff2-5a32015063f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:44.706181 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac86778-8948-4833-aff2-5a32015063f0 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:44.726518 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-3ac86778-8948-4833-aff2-5a32015063f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 20:39:44.735918 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 444/891] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:39:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:39:44.735918 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a99e4a-2136-4aae-83d7-f80f670de259 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:44.735918 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a99e4a-2136-4aae-83d7-f80f670de259 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:44.735918 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a99e4a-2136-4aae-83d7-f80f670de259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:44.747476 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a6eea-a6e0-484a-987b-0ef8b4e7755d None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:44.753439 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-e5a99e4a-2136-4aae-83d7-f80f670de259 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:44.754849 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-e5a99e4a-2136-4aae-83d7-f80f670de259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:44.796306 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b767584-af17-4f9d-b5da-6e7c734b307c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:44.797115 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b767584-af17-4f9d-b5da-6e7c734b307c None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:44.797389 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b767584-af17-4f9d-b5da-6e7c734b307c None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:44.797659 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b767584-af17-4f9d-b5da-6e7c734b307c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:44.798329 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b767584-af17-4f9d-b5da-6e7c734b307c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:44.799841 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b767584-af17-4f9d-b5da-6e7c734b307c None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:44.812015 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-2b767584-af17-4f9d-b5da-6e7c734b307c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 20:39:44.813491 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 448/892] 10.222.0.49 () {56 vars in 1126 bytes} [Fri Oct 28 20:39:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:44.814048 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b767584-af17-4f9d-b5da-6e7c734b307c None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:44.870970 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 445/893] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:44 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:39:44.871714 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a99e4a-2136-4aae-83d7-f80f670de259 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:44.976895 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b767584-af17-4f9d-b5da-6e7c734b307c None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:45.028392 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4135c8-198f-4a14-b8ed-7607787b4b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:45.029484 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4135c8-198f-4a14-b8ed-7607787b4b88 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:45.029977 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4135c8-198f-4a14-b8ed-7607787b4b88 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:45.030247 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a99e4a-2136-4aae-83d7-f80f670de259 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:45.030470 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4135c8-198f-4a14-b8ed-7607787b4b88 None admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:45.031970 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4135c8-198f-4a14-b8ed-7607787b4b88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:45.032532 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4135c8-198f-4a14-b8ed-7607787b4b88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:45.035620 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4135c8-198f-4a14-b8ed-7607787b4b88 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:45.058287 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 449/894] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 20:39:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:45.059867 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4135c8-198f-4a14-b8ed-7607787b4b88 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:45.084772 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d214c6b-073b-4929-a0c8-3de53d561ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:45.085790 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d214c6b-073b-4929-a0c8-3de53d561ae1 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:45.086076 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d214c6b-073b-4929-a0c8-3de53d561ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:45.086334 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d214c6b-073b-4929-a0c8-3de53d561ae1 None admin] PATH_INFO: `/v3/services` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:45.087055 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d214c6b-073b-4929-a0c8-3de53d561ae1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:45.087359 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d214c6b-073b-4929-a0c8-3de53d561ae1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:45.088829 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d214c6b-073b-4929-a0c8-3de53d561ae1 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:45.094272 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 446/895] 10.222.0.49 () {56 vars in 1122 bytes} [Fri Oct 28 20:39:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:45.095100 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d214c6b-073b-4929-a0c8-3de53d561ae1 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:45.240552 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d214c6b-073b-4929-a0c8-3de53d561ae1 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:45.246462 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4135c8-198f-4a14-b8ed-7607787b4b88 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:45.297915 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0309d2-159e-48ac-968f-5a03c4df9d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:45.300418 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0309d2-159e-48ac-968f-5a03c4df9d4f None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:45.300858 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0309d2-159e-48ac-968f-5a03c4df9d4f None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:45.301294 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0309d2-159e-48ac-968f-5a03c4df9d4f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:45.302377 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0309d2-159e-48ac-968f-5a03c4df9d4f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:45.304562 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0309d2-159e-48ac-968f-5a03c4df9d4f None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:45.316827 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1ea10-1229-4f76-b670-a6c3063e4c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:45.317839 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1ea10-1229-4f76-b670-a6c3063e4c53 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:45.318279 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1ea10-1229-4f76-b670-a6c3063e4c53 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:45.318719 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1ea10-1229-4f76-b670-a6c3063e4c53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:45.320240 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1ea10-1229-4f76-b670-a6c3063e4c53 None admin] RBAC: Adding query filter params (role.id=f5ccdb0329bf4a79a4fa1396ad06ab3d, scope.project.id=c55c2ee59af14cf8a7e4275de4f43037, user.id=78cde480dd8b4a85ac30895026bfc406) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:45.320743 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1ea10-1229-4f76-b670-a6c3063e4c53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:45.323332 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1ea10-1229-4f76-b670-a6c3063e4c53 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:45.325158 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-6f0309d2-159e-48ac-968f-5a03c4df9d4f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 20:39:45.332025 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 450/896] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 20:39:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:45.332025 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0309d2-159e-48ac-968f-5a03c4df9d4f None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:45.337869 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 447/897] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:39:45 2022] GET /identity/v3/role_assignments?user.id=78cde480dd8b4a85ac30895026bfc406&scope.project.id=c55c2ee59af14cf8a7e4275de4f43037&role.id=f5ccdb0329bf4a79a4fa1396ad06ab3d => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:45.338997 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1ea10-1229-4f76-b670-a6c3063e4c53 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:45.492996 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0309d2-159e-48ac-968f-5a03c4df9d4f None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:45.511044 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1ea10-1229-4f76-b670-a6c3063e4c53 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:45.556298 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96787203-c3e5-404e-b1db-0ddf00946dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:45.557451 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96787203-c3e5-404e-b1db-0ddf00946dbc None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:45.557934 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96787203-c3e5-404e-b1db-0ddf00946dbc None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:45.558416 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96787203-c3e5-404e-b1db-0ddf00946dbc None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:45.558580 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922edcb-27d1-464b-868a-b5c08aae1c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:45.559246 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922edcb-27d1-464b-868a-b5c08aae1c32 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:45.559598 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922edcb-27d1-464b-868a-b5c08aae1c32 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:45.559838 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96787203-c3e5-404e-b1db-0ddf00946dbc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:45.560078 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922edcb-27d1-464b-868a-b5c08aae1c32 None admin] PATH_INFO: `/v3/services` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:45.560377 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96787203-c3e5-404e-b1db-0ddf00946dbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:45.560905 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9922edcb-27d1-464b-868a-b5c08aae1c32 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:45.561276 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9922edcb-27d1-464b-868a-b5c08aae1c32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:45.562753 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9922edcb-27d1-464b-868a-b5c08aae1c32 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:45.563025 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96787203-c3e5-404e-b1db-0ddf00946dbc None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:45.570233 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 448/898] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 20:39:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:45.573716 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 451/899] 10.222.0.49 () {56 vars in 1122 bytes} [Fri Oct 28 20:39:45 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:45.579312 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922edcb-27d1-464b-868a-b5c08aae1c32 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:45.798718 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922edcb-27d1-464b-868a-b5c08aae1c32 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:45.861921 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef83662-38e7-4b28-bdd9-ebf1c8bfc31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:45.863239 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef83662-38e7-4b28-bdd9-ebf1c8bfc31d None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:45.863761 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef83662-38e7-4b28-bdd9-ebf1c8bfc31d None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:45.864225 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef83662-38e7-4b28-bdd9-ebf1c8bfc31d None admin] PATH_INFO: `/v3/services` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:45.865537 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef83662-38e7-4b28-bdd9-ebf1c8bfc31d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:45.866069 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef83662-38e7-4b28-bdd9-ebf1c8bfc31d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:45.868742 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef83662-38e7-4b28-bdd9-ebf1c8bfc31d None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:45.878833 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 449/900] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 20:39:45 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:39:45.887604 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96787203-c3e5-404e-b1db-0ddf00946dbc None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:46.075365 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96787203-c3e5-404e-b1db-0ddf00946dbc None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:46.114434 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f9aa5-2992-48ac-b90d-8026de430276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:46.115098 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f9aa5-2992-48ac-b90d-8026de430276 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:46.115379 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f9aa5-2992-48ac-b90d-8026de430276 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:46.115654 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f9aa5-2992-48ac-b90d-8026de430276 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:46.116490 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f9aa5-2992-48ac-b90d-8026de430276 None admin] RBAC: Adding query filter params (interface=public, service_id=5e73d8bbfdb346d4bc24254a4581091a, region_id=RegionOne) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:46.116800 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f9aa5-2992-48ac-b90d-8026de430276 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:46.118193 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f9aa5-2992-48ac-b90d-8026de430276 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:46.124248 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 452/901] 10.222.0.49 () {56 vars in 1251 bytes} [Fri Oct 28 20:39:45 2022] GET /identity/v3/endpoints?service_id=5e73d8bbfdb346d4bc24254a4581091a&interface=public®ion_id=RegionOne => generated 194 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:46.132453 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef83662-38e7-4b28-bdd9-ebf1c8bfc31d None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:46.327877 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef83662-38e7-4b28-bdd9-ebf1c8bfc31d None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:46.390736 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b0e14-42a3-4d51-8152-502dd0206f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:46.391852 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b0e14-42a3-4d51-8152-502dd0206f2a None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:46.392432 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b0e14-42a3-4d51-8152-502dd0206f2a None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:46.392905 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b0e14-42a3-4d51-8152-502dd0206f2a None admin] PATH_INFO: `/v3/services` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:46.394163 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b0e14-42a3-4d51-8152-502dd0206f2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:46.396686 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b0e14-42a3-4d51-8152-502dd0206f2a None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:46.407952 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 450/902] 10.222.0.49 () {56 vars in 1087 bytes} [Fri Oct 28 20:39:46 2022] GET /identity/v3/services => generated 1268 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:39:47.300885 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd67efc-49dc-4812-bae1-6233d32218ff None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:47.301532 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd67efc-49dc-4812-bae1-6233d32218ff None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:47.301532 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd67efc-49dc-4812-bae1-6233d32218ff None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:47.303545 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 453/903] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:39:47.309161 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975164a-9783-4c45-b967-100f063fd0e6 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:47.309754 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975164a-9783-4c45-b967-100f063fd0e6 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:47.309754 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975164a-9783-4c45-b967-100f063fd0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:47.327985 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-d975164a-9783-4c45-b967-100f063fd0e6 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:47.329183 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-d975164a-9783-4c45-b967-100f063fd0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:47.407996 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 451/904] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:47 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 20:39:47.431671 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd67efc-49dc-4812-bae1-6233d32218ff None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:47.547839 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd67efc-49dc-4812-bae1-6233d32218ff None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:47.587183 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8da751-d42b-427e-8444-c07675af052f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:47.588051 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8da751-d42b-427e-8444-c07675af052f None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:47.588333 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8da751-d42b-427e-8444-c07675af052f None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:47.588609 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8da751-d42b-427e-8444-c07675af052f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:47.589281 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8da751-d42b-427e-8444-c07675af052f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:47.590712 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8da751-d42b-427e-8444-c07675af052f None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:47.603477 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-7a8da751-d42b-427e-8444-c07675af052f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 20:39:47.605109 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 454/905] 10.222.0.49 () {56 vars in 1132 bytes} [Fri Oct 28 20:39:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:47.615607 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975164a-9783-4c45-b967-100f063fd0e6 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:47.810057 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975164a-9783-4c45-b967-100f063fd0e6 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:47.879083 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af890c-c1dc-49e4-8713-1b2946f6a6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:47.880220 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af890c-c1dc-49e4-8713-1b2946f6a6bf None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:47.880802 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af890c-c1dc-49e4-8713-1b2946f6a6bf None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:47.881288 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af890c-c1dc-49e4-8713-1b2946f6a6bf None admin] PATH_INFO: `/v3/services` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:47.882648 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af890c-c1dc-49e4-8713-1b2946f6a6bf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:47.883182 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af890c-c1dc-49e4-8713-1b2946f6a6bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:47.886018 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af890c-c1dc-49e4-8713-1b2946f6a6bf None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:47.903989 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 452/906] 10.222.0.49 () {56 vars in 1126 bytes} [Fri Oct 28 20:39:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:47.907110 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8da751-d42b-427e-8444-c07675af052f None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:48.089643 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8da751-d42b-427e-8444-c07675af052f None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:48.101556 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6627f3-5aa4-42ea-aa83-0109952f84df None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:48.101556 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6627f3-5aa4-42ea-aa83-0109952f84df None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:48.101556 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6627f3-5aa4-42ea-aa83-0109952f84df None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:48.101556 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 453/907] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:39:48.109641 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887aaec-ce17-418f-badf-a1c1af6f5e51 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:48.109641 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887aaec-ce17-418f-badf-a1c1af6f5e51 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:48.109641 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887aaec-ce17-418f-badf-a1c1af6f5e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:48.129647 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-f887aaec-ce17-418f-badf-a1c1af6f5e51 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:48.130827 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-f887aaec-ce17-418f-badf-a1c1af6f5e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:48.143721 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a73f8-057c-4c7d-bf62-e0ecf4c91fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:48.144815 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a73f8-057c-4c7d-bf62-e0ecf4c91fb1 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:48.144815 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a73f8-057c-4c7d-bf62-e0ecf4c91fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:48.145083 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a73f8-057c-4c7d-bf62-e0ecf4c91fb1 None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:48.145633 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a73f8-057c-4c7d-bf62-e0ecf4c91fb1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:48.145935 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a73f8-057c-4c7d-bf62-e0ecf4c91fb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:48.147325 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a73f8-057c-4c7d-bf62-e0ecf4c91fb1 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:48.159791 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 455/908] 10.222.0.49 () {56 vars in 1126 bytes} [Fri Oct 28 20:39:47 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:48.164545 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a73f8-057c-4c7d-bf62-e0ecf4c91fb1 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:48.290775 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a73f8-057c-4c7d-bf62-e0ecf4c91fb1 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:48.291622 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 454/909] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:48 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 20:39:48.319374 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887aaec-ce17-418f-badf-a1c1af6f5e51 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:48.343790 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99599fb1-1351-4c68-bad6-418cf05f66e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:48.344516 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99599fb1-1351-4c68-bad6-418cf05f66e3 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:48.344633 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99599fb1-1351-4c68-bad6-418cf05f66e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:48.344976 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99599fb1-1351-4c68-bad6-418cf05f66e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:48.345703 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99599fb1-1351-4c68-bad6-418cf05f66e3 None admin] RBAC: Adding query filter params (interface=public, service_id=63ad82ae554849fda86075d0d7ddd344, region_id=RegionOne) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:48.346200 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99599fb1-1351-4c68-bad6-418cf05f66e3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:48.348007 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99599fb1-1351-4c68-bad6-418cf05f66e3 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:48.359588 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 456/910] 10.222.0.49 () {56 vars in 1251 bytes} [Fri Oct 28 20:39:48 2022] GET /identity/v3/endpoints?service_id=63ad82ae554849fda86075d0d7ddd344&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:48.363705 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99599fb1-1351-4c68-bad6-418cf05f66e3 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:48.455707 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887aaec-ce17-418f-badf-a1c1af6f5e51 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:48.489235 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d473f7-fc6f-43ca-af7b-ff257691dd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:48.489886 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d473f7-fc6f-43ca-af7b-ff257691dd62 None admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:48.490149 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d473f7-fc6f-43ca-af7b-ff257691dd62 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:48.490419 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d473f7-fc6f-43ca-af7b-ff257691dd62 None admin] PATH_INFO: `/v3/services` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:48.491160 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d473f7-fc6f-43ca-af7b-ff257691dd62 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:48.492647 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d473f7-fc6f-43ca-af7b-ff257691dd62 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:48.516028 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 455/911] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Oct 28 20:39:48 2022] POST /identity/v3/services => generated 241 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:39:48.569849 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99599fb1-1351-4c68-bad6-418cf05f66e3 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:48.636418 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeda3ee-49f2-489c-8b76-c3ccaa751e72 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:48.637725 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeda3ee-49f2-489c-8b76-c3ccaa751e72 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:48.638639 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeda3ee-49f2-489c-8b76-c3ccaa751e72 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:48.643135 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 456/912] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:39:48.647559 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d8664-c6ac-4d41-8ad4-1c6b9dc10150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:48.649102 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9099d1-db97-4c60-9596-ec5dc1d0b26d None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:48.649384 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9099d1-db97-4c60-9596-ec5dc1d0b26d None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:48.649669 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9099d1-db97-4c60-9596-ec5dc1d0b26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:48.650049 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d8664-c6ac-4d41-8ad4-1c6b9dc10150 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:48.650849 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d8664-c6ac-4d41-8ad4-1c6b9dc10150 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:48.652070 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d8664-c6ac-4d41-8ad4-1c6b9dc10150 None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:48.653976 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d8664-c6ac-4d41-8ad4-1c6b9dc10150 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:48.657135 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d8664-c6ac-4d41-8ad4-1c6b9dc10150 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:48.668517 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-eb9099d1-db97-4c60-9596-ec5dc1d0b26d None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:48.669763 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-eb9099d1-db97-4c60-9596-ec5dc1d0b26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:48.675950 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 457/913] 10.222.0.49 () {56 vars in 1087 bytes} [Fri Oct 28 20:39:48 2022] GET /identity/v3/services => generated 1497 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:39:48.757553 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 457/914] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 20:39:48.782237 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d8664-c6ac-4d41-8ad4-1c6b9dc10150 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:48.975064 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d8664-c6ac-4d41-8ad4-1c6b9dc10150 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:49.036781 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ba154-6009-4529-b048-2241e364b40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:49.038236 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ba154-6009-4529-b048-2241e364b40e None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:49.038752 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ba154-6009-4529-b048-2241e364b40e None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:49.039257 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ba154-6009-4529-b048-2241e364b40e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:49.059354 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ba154-6009-4529-b048-2241e364b40e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:39:49.074362 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-805ba154-6009-4529-b048-2241e364b40e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 20:39:49.076915 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 458/915] 10.222.0.49 () {56 vars in 1120 bytes} [Fri Oct 28 20:39:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:39:49.083167 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9099d1-db97-4c60-9596-ec5dc1d0b26d None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:49.190136 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9099d1-db97-4c60-9596-ec5dc1d0b26d None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:49.231434 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3cbc88-cac5-4856-a414-23b8f4d7fae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:49.232161 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3cbc88-cac5-4856-a414-23b8f4d7fae0 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:49.232443 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3cbc88-cac5-4856-a414-23b8f4d7fae0 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:49.232721 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3cbc88-cac5-4856-a414-23b8f4d7fae0 None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:49.233499 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3cbc88-cac5-4856-a414-23b8f4d7fae0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:49.233804 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3cbc88-cac5-4856-a414-23b8f4d7fae0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:49.235222 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3cbc88-cac5-4856-a414-23b8f4d7fae0 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:49.245781 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 458/916] 10.222.0.49 () {56 vars in 1115 bytes} [Fri Oct 28 20:39:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:49.253268 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ba154-6009-4529-b048-2241e364b40e None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:49.441722 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ba154-6009-4529-b048-2241e364b40e None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:49.510164 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3d8bb-566f-44be-9b43-2f2937abcdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:49.511439 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3d8bb-566f-44be-9b43-2f2937abcdd6 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:49.511971 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3d8bb-566f-44be-9b43-2f2937abcdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:49.512452 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3d8bb-566f-44be-9b43-2f2937abcdd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:49.533343 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3d8bb-566f-44be-9b43-2f2937abcdd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:49.536389 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3d8bb-566f-44be-9b43-2f2937abcdd6 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:49.566661 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-7ba3d8bb-566f-44be-9b43-2f2937abcdd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:49.568447 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 459/917] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:49.574571 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3cbc88-cac5-4856-a414-23b8f4d7fae0 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:49.707063 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3cbc88-cac5-4856-a414-23b8f4d7fae0 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:49.748426 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1156927-28c1-4810-b648-d7e6a217630c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:49.749104 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1156927-28c1-4810-b648-d7e6a217630c None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:49.749379 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1156927-28c1-4810-b648-d7e6a217630c None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:49.749647 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1156927-28c1-4810-b648-d7e6a217630c None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:49.750381 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1156927-28c1-4810-b648-d7e6a217630c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:49.750684 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1156927-28c1-4810-b648-d7e6a217630c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:49.752824 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1156927-28c1-4810-b648-d7e6a217630c None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:49.766728 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 459/918] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:49.772397 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3d8bb-566f-44be-9b43-2f2937abcdd6 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:49.887344 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3d8bb-566f-44be-9b43-2f2937abcdd6 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:49.890072 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e40f2-ca66-4889-8c75-7e6c65e7ff91 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:49.890368 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e40f2-ca66-4889-8c75-7e6c65e7ff91 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:49.890616 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e40f2-ca66-4889-8c75-7e6c65e7ff91 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:49.893936 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 460/919] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:39:49.900325 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dd36f-7e2e-420f-b46d-28217b4c1132 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:49.901140 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dd36f-7e2e-420f-b46d-28217b4c1132 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:49.901826 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dd36f-7e2e-420f-b46d-28217b4c1132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:49.927902 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68ad2c-29bf-4244-9fa6-2fc6c477c5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:49.928724 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68ad2c-29bf-4244-9fa6-2fc6c477c5ec None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:49.929076 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68ad2c-29bf-4244-9fa6-2fc6c477c5ec None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:49.929330 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68ad2c-29bf-4244-9fa6-2fc6c477c5ec None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:49.931825 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-680dd36f-7e2e-420f-b46d-28217b4c1132 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:49.934165 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-680dd36f-7e2e-420f-b46d-28217b4c1132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:49.937885 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c68ad2c-29bf-4244-9fa6-2fc6c477c5ec None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:49.939539 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c68ad2c-29bf-4244-9fa6-2fc6c477c5ec None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:49.954560 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-2c68ad2c-29bf-4244-9fa6-2fc6c477c5ec None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 20:39:49.956748 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 460/920] 10.222.0.49 () {56 vars in 1117 bytes} [Fri Oct 28 20:39:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:49.962525 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68ad2c-29bf-4244-9fa6-2fc6c477c5ec None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:50.074915 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 461/921] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:39:50.117430 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68ad2c-29bf-4244-9fa6-2fc6c477c5ec None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:50.118837 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680dd36f-7e2e-420f-b46d-28217b4c1132 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:50.178956 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d8860-4f23-464a-8c1c-d49f0d2188e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:50.180095 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d8860-4f23-464a-8c1c-d49f0d2188e7 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:50.180542 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d8860-4f23-464a-8c1c-d49f0d2188e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:50.180996 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d8860-4f23-464a-8c1c-d49f0d2188e7 None admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:50.182489 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d8860-4f23-464a-8c1c-d49f0d2188e7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:50.182980 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d8860-4f23-464a-8c1c-d49f0d2188e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:50.185561 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d8860-4f23-464a-8c1c-d49f0d2188e7 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:50.223907 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 461/922] 10.222.0.49 () {56 vars in 1149 bytes} [Fri Oct 28 20:39:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:50.227616 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d8860-4f23-464a-8c1c-d49f0d2188e7 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:50.320380 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680dd36f-7e2e-420f-b46d-28217b4c1132 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:50.379695 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35996f0-c8cc-418c-a95f-5acc161e01b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:50.380898 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35996f0-c8cc-418c-a95f-5acc161e01b1 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:50.381371 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35996f0-c8cc-418c-a95f-5acc161e01b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:50.381841 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35996f0-c8cc-418c-a95f-5acc161e01b1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:50.383220 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35996f0-c8cc-418c-a95f-5acc161e01b1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:50.385525 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35996f0-c8cc-418c-a95f-5acc161e01b1 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:50.406005 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-e35996f0-c8cc-418c-a95f-5acc161e01b1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 20:39:50.409475 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 462/923] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 20:39:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:50.421732 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35996f0-c8cc-418c-a95f-5acc161e01b1 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:50.435303 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d8860-4f23-464a-8c1c-d49f0d2188e7 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:50.508248 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aafae6-a268-4cb2-a94f-068b162ca2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:50.510695 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aafae6-a268-4cb2-a94f-068b162ca2cf None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:50.511431 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aafae6-a268-4cb2-a94f-068b162ca2cf None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:50.512147 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aafae6-a268-4cb2-a94f-068b162ca2cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:50.536573 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aafae6-a268-4cb2-a94f-068b162ca2cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:50.540922 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aafae6-a268-4cb2-a94f-068b162ca2cf None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:50.564619 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-86aafae6-a268-4cb2-a94f-068b162ca2cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:50.566227 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 462/924] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:50.575166 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aafae6-a268-4cb2-a94f-068b162ca2cf None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:50.643375 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35996f0-c8cc-418c-a95f-5acc161e01b1 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:50.709413 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bfbc76-c193-4097-a82f-bb7027b914e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:50.710434 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfbc76-c193-4097-a82f-bb7027b914e1 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:50.710914 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfbc76-c193-4097-a82f-bb7027b914e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:50.711400 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfbc76-c193-4097-a82f-bb7027b914e1 None admin] PATH_INFO: `/v3/services` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:50.713006 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bfbc76-c193-4097-a82f-bb7027b914e1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:50.713391 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bfbc76-c193-4097-a82f-bb7027b914e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:50.716063 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bfbc76-c193-4097-a82f-bb7027b914e1 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:50.732087 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 463/925] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 20:39:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:50.737094 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bfbc76-c193-4097-a82f-bb7027b914e1 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:50.820186 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aafae6-a268-4cb2-a94f-068b162ca2cf None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:50.904831 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0ef05-1048-4a89-94f2-51a072a55521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:50.907429 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0ef05-1048-4a89-94f2-51a072a55521 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:50.908415 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0ef05-1048-4a89-94f2-51a072a55521 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:50.909582 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0ef05-1048-4a89-94f2-51a072a55521 None admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:50.911959 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0ef05-1048-4a89-94f2-51a072a55521 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:50.912894 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0ef05-1048-4a89-94f2-51a072a55521 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:50.916913 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0ef05-1048-4a89-94f2-51a072a55521 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:50.930790 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bfbc76-c193-4097-a82f-bb7027b914e1 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:50.953912 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 463/926] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:39:50.959779 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0ef05-1048-4a89-94f2-51a072a55521 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:51.003734 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e12e3b4-a49b-4432-844f-4decab2cb462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:51.004992 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12e3b4-a49b-4432-844f-4decab2cb462 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:51.005443 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12e3b4-a49b-4432-844f-4decab2cb462 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:51.005898 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12e3b4-a49b-4432-844f-4decab2cb462 None admin] PATH_INFO: `/v3/services` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:51.007633 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e12e3b4-a49b-4432-844f-4decab2cb462 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:51.007955 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e12e3b4-a49b-4432-844f-4decab2cb462 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:51.010729 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e12e3b4-a49b-4432-844f-4decab2cb462 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:51.028018 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 464/927] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 20:39:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:39:51.031156 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e12e3b4-a49b-4432-844f-4decab2cb462 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:51.174691 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0ef05-1048-4a89-94f2-51a072a55521 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:51.246907 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e12e3b4-a49b-4432-844f-4decab2cb462 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:51.255298 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca0bca-2a40-45a0-800e-7f87f8a5335c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:51.256806 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca0bca-2a40-45a0-800e-7f87f8a5335c None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:51.257131 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca0bca-2a40-45a0-800e-7f87f8a5335c None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:51.257403 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca0bca-2a40-45a0-800e-7f87f8a5335c None admin] PATH_INFO: `/v3/projects/service` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:51.272152 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca0bca-2a40-45a0-800e-7f87f8a5335c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:51.275128 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca0bca-2a40-45a0-800e-7f87f8a5335c None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:51.311649 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-07ca0bca-2a40-45a0-800e-7f87f8a5335c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 20:39:51.315814 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 464/928] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:39:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:51.326202 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca0bca-2a40-45a0-800e-7f87f8a5335c None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:51.327940 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991c12a-a902-41d3-9926-079fb303de39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:51.329143 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991c12a-a902-41d3-9926-079fb303de39 None admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:51.330348 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991c12a-a902-41d3-9926-079fb303de39 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:51.330842 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991c12a-a902-41d3-9926-079fb303de39 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:51.332308 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991c12a-a902-41d3-9926-079fb303de39 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:51.335990 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991c12a-a902-41d3-9926-079fb303de39 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:51.383883 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 465/929] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:39:51 2022] POST /identity/v3/endpoints => generated 346 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:39:51.553162 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca0bca-2a40-45a0-800e-7f87f8a5335c None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:51.600119 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879681d-da03-46d1-bb6e-934daa8fe124 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:51.601199 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879681d-da03-46d1-bb6e-934daa8fe124 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:51.602044 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879681d-da03-46d1-bb6e-934daa8fe124 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:51.607145 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 466/930] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:51 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:39:51.617479 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb47541-39f2-42dc-929b-818b3778068e None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:51.618067 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb47541-39f2-42dc-929b-818b3778068e None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:51.618554 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb47541-39f2-42dc-929b-818b3778068e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:51.626177 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f700c61-aa2f-4019-b44e-0d90e1b1e293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:51.628038 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f700c61-aa2f-4019-b44e-0d90e1b1e293 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:51.628496 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f700c61-aa2f-4019-b44e-0d90e1b1e293 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:51.628920 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f700c61-aa2f-4019-b44e-0d90e1b1e293 None admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:51.629908 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f700c61-aa2f-4019-b44e-0d90e1b1e293 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:51.630388 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f700c61-aa2f-4019-b44e-0d90e1b1e293 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:51.632107 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f700c61-aa2f-4019-b44e-0d90e1b1e293 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:51.647534 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 465/931] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 20:39:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:51.650214 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-8eb47541-39f2-42dc-929b-818b3778068e None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:51.652303 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-8eb47541-39f2-42dc-929b-818b3778068e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:51.655967 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f700c61-aa2f-4019-b44e-0d90e1b1e293 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:51.781199 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 467/932] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:39:51.801575 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f700c61-aa2f-4019-b44e-0d90e1b1e293 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:51.822121 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb47541-39f2-42dc-929b-818b3778068e None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:51.871596 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593ce47-04a3-4238-9af6-f235b2a80b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:51.873711 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593ce47-04a3-4238-9af6-f235b2a80b38 None admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:51.874510 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593ce47-04a3-4238-9af6-f235b2a80b38 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:51.875277 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593ce47-04a3-4238-9af6-f235b2a80b38 None admin] PATH_INFO: `/v3/projects/c55c2ee59af14cf8a7e4275de4f43037/users/78cde480dd8b4a85ac30895026bfc406/roles/f5ccdb0329bf4a79a4fa1396ad06ab3d` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:51.880292 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593ce47-04a3-4238-9af6-f235b2a80b38 None admin] RBAC: Authorizing `identity:create_grant(project_id=c55c2ee59af14cf8a7e4275de4f43037, user_id=78cde480dd8b4a85ac30895026bfc406, role_id=f5ccdb0329bf4a79a4fa1396ad06ab3d)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:51.883449 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593ce47-04a3-4238-9af6-f235b2a80b38 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:51.910266 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 466/933] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 20:39:51 2022] PUT /identity/v3/projects/c55c2ee59af14cf8a7e4275de4f43037/users/78cde480dd8b4a85ac30895026bfc406/roles/f5ccdb0329bf4a79a4fa1396ad06ab3d => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:39:51.910266 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16307a2e-8907-4549-a14e-3f5f2a6acb87 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:51.910266 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16307a2e-8907-4549-a14e-3f5f2a6acb87 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:51.910266 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16307a2e-8907-4549-a14e-3f5f2a6acb87 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:51.910266 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 467/934] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:39:51.915934 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597a749-1d8a-499a-a54a-8521a0e40ba7 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:51.916230 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597a749-1d8a-499a-a54a-8521a0e40ba7 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:51.916511 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597a749-1d8a-499a-a54a-8521a0e40ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:51.937547 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-2597a749-1d8a-499a-a54a-8521a0e40ba7 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:51.940130 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-2597a749-1d8a-499a-a54a-8521a0e40ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:52.021090 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb47541-39f2-42dc-929b-818b3778068e None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:52.046485 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 468/935] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 20:39:52.070569 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597a749-1d8a-499a-a54a-8521a0e40ba7 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:52.101479 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb802c8-08e8-4049-9133-3bab59982e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:52.102194 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb802c8-08e8-4049-9133-3bab59982e86 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:52.102470 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb802c8-08e8-4049-9133-3bab59982e86 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:52.102742 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb802c8-08e8-4049-9133-3bab59982e86 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:52.103697 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb802c8-08e8-4049-9133-3bab59982e86 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:52.104878 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb802c8-08e8-4049-9133-3bab59982e86 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:52.117899 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-efb802c8-08e8-4049-9133-3bab59982e86 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 20:39:52.119468 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 468/936] 10.222.0.49 () {56 vars in 1126 bytes} [Fri Oct 28 20:39:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:52.131719 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb802c8-08e8-4049-9133-3bab59982e86 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:52.274240 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597a749-1d8a-499a-a54a-8521a0e40ba7 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:52.284540 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb802c8-08e8-4049-9133-3bab59982e86 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:52.331788 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3318c-e907-4096-be74-c4b4fdc7fcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:52.332523 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3318c-e907-4096-be74-c4b4fdc7fcf6 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:52.332804 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3318c-e907-4096-be74-c4b4fdc7fcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:52.333074 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3318c-e907-4096-be74-c4b4fdc7fcf6 None admin] PATH_INFO: `/v3/services` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:52.333801 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3318c-e907-4096-be74-c4b4fdc7fcf6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:52.334105 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3318c-e907-4096-be74-c4b4fdc7fcf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:52.335788 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3318c-e907-4096-be74-c4b4fdc7fcf6 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:52.343794 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 469/937] 10.222.0.49 () {56 vars in 1122 bytes} [Fri Oct 28 20:39:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:52.346835 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b930ad-2f3c-4e65-98da-43bf41ceeff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:52.347897 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b930ad-2f3c-4e65-98da-43bf41ceeff2 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:52.348327 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b930ad-2f3c-4e65-98da-43bf41ceeff2 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:52.348924 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b930ad-2f3c-4e65-98da-43bf41ceeff2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:52.349799 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b930ad-2f3c-4e65-98da-43bf41ceeff2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:52.351334 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b930ad-2f3c-4e65-98da-43bf41ceeff2 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:52.352571 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3318c-e907-4096-be74-c4b4fdc7fcf6 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:52.367826 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-d0b930ad-2f3c-4e65-98da-43bf41ceeff2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 20:39:52.369399 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 469/938] 10.222.0.49 () {56 vars in 1132 bytes} [Fri Oct 28 20:39:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:39:52.375411 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b930ad-2f3c-4e65-98da-43bf41ceeff2 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:52.488100 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b930ad-2f3c-4e65-98da-43bf41ceeff2 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:52.526289 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207acae-fdfa-4ebd-9a1d-bdd68e6eb9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:52.527126 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207acae-fdfa-4ebd-9a1d-bdd68e6eb9bb None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:52.527419 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207acae-fdfa-4ebd-9a1d-bdd68e6eb9bb None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:52.527703 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207acae-fdfa-4ebd-9a1d-bdd68e6eb9bb None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:52.528433 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207acae-fdfa-4ebd-9a1d-bdd68e6eb9bb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:52.528736 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207acae-fdfa-4ebd-9a1d-bdd68e6eb9bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:52.530206 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207acae-fdfa-4ebd-9a1d-bdd68e6eb9bb None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:52.536685 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 470/939] 10.222.0.49 () {56 vars in 1126 bytes} [Fri Oct 28 20:39:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:52.542385 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207acae-fdfa-4ebd-9a1d-bdd68e6eb9bb None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:52.553022 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3318c-e907-4096-be74-c4b4fdc7fcf6 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:52.617539 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27401ea-a25c-4eab-a881-c84f6932c4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:52.619074 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27401ea-a25c-4eab-a881-c84f6932c4c2 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:52.619923 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27401ea-a25c-4eab-a881-c84f6932c4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:52.620685 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27401ea-a25c-4eab-a881-c84f6932c4c2 None admin] PATH_INFO: `/v3/services` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:52.622333 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27401ea-a25c-4eab-a881-c84f6932c4c2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:52.623159 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27401ea-a25c-4eab-a881-c84f6932c4c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:52.626101 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27401ea-a25c-4eab-a881-c84f6932c4c2 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:52.641619 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 470/940] 10.222.0.49 () {56 vars in 1122 bytes} [Fri Oct 28 20:39:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:39:52.647493 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27401ea-a25c-4eab-a881-c84f6932c4c2 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:52.649143 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207acae-fdfa-4ebd-9a1d-bdd68e6eb9bb None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:52.686498 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b15da-df17-4194-a1b1-701f96d37d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:52.687165 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b15da-df17-4194-a1b1-701f96d37d74 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:52.687434 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b15da-df17-4194-a1b1-701f96d37d74 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:52.687804 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b15da-df17-4194-a1b1-701f96d37d74 None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:52.688524 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b15da-df17-4194-a1b1-701f96d37d74 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:52.688828 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b15da-df17-4194-a1b1-701f96d37d74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:52.690737 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b15da-df17-4194-a1b1-701f96d37d74 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:52.701668 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 471/941] 10.222.0.49 () {56 vars in 1126 bytes} [Fri Oct 28 20:39:52 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:52.702521 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b15da-df17-4194-a1b1-701f96d37d74 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:52.811925 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b15da-df17-4194-a1b1-701f96d37d74 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:52.836315 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27401ea-a25c-4eab-a881-c84f6932c4c2 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:52.850663 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392a255-4d79-454b-b524-4a423a5d756b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:52.851220 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392a255-4d79-454b-b524-4a423a5d756b None admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:52.851501 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392a255-4d79-454b-b524-4a423a5d756b None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:52.851796 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392a255-4d79-454b-b524-4a423a5d756b None admin] PATH_INFO: `/v3/endpoints` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:52.852562 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392a255-4d79-454b-b524-4a423a5d756b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:52.854023 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392a255-4d79-454b-b524-4a423a5d756b None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:52.883788 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 472/942] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:39:52 2022] POST /identity/v3/endpoints => generated 347 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:39:52.916593 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b9090-568e-4022-b631-936550b6acd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:52.918457 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b9090-568e-4022-b631-936550b6acd3 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:52.919256 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b9090-568e-4022-b631-936550b6acd3 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:52.920061 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b9090-568e-4022-b631-936550b6acd3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:52.922197 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b9090-568e-4022-b631-936550b6acd3 None admin] RBAC: Adding query filter params (interface=public, service_id=e9cd9857057e4deca2fc9aea1b820b74, region_id=RegionOne) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:52.923166 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b9090-568e-4022-b631-936550b6acd3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:52.926753 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b9090-568e-4022-b631-936550b6acd3 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:52.940557 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 471/943] 10.222.0.49 () {56 vars in 1251 bytes} [Fri Oct 28 20:39:52 2022] GET /identity/v3/endpoints?service_id=e9cd9857057e4deca2fc9aea1b820b74&interface=public®ion_id=RegionOne => generated 194 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:39:52.950527 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392a255-4d79-454b-b524-4a423a5d756b None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:53.081667 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392a255-4d79-454b-b524-4a423a5d756b None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:53.119176 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d65e0-2285-4b5d-ba5a-e489dfe76a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:53.120056 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d65e0-2285-4b5d-ba5a-e489dfe76a11 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:53.120321 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d65e0-2285-4b5d-ba5a-e489dfe76a11 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:53.120592 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d65e0-2285-4b5d-ba5a-e489dfe76a11 None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:53.121260 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d65e0-2285-4b5d-ba5a-e489dfe76a11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:53.122669 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d65e0-2285-4b5d-ba5a-e489dfe76a11 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:53.130605 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 473/944] 10.222.0.49 () {56 vars in 1087 bytes} [Fri Oct 28 20:39:52 2022] GET /identity/v3/services => generated 1497 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:39:54.639403 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7397e-e67b-4dc8-8d12-3d2dfdf852b8 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:54.640386 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7397e-e67b-4dc8-8d12-3d2dfdf852b8 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:54.640867 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7397e-e67b-4dc8-8d12-3d2dfdf852b8 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:54.644070 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 472/945] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:39:54.650841 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340959db-4ad2-43e4-ad42-b1539838099f None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:54.651334 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340959db-4ad2-43e4-ad42-b1539838099f None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:54.651844 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340959db-4ad2-43e4-ad42-b1539838099f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:54.680528 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-340959db-4ad2-43e4-ad42-b1539838099f None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:54.682443 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-340959db-4ad2-43e4-ad42-b1539838099f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:54.758608 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 474/946] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:39:54.782333 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7397e-e67b-4dc8-8d12-3d2dfdf852b8 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:54.900394 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7397e-e67b-4dc8-8d12-3d2dfdf852b8 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:54.941730 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0eb88-d2b3-48f3-9b0e-00039252a2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:54.942778 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0eb88-d2b3-48f3-9b0e-00039252a2af None admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:54.943252 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0eb88-d2b3-48f3-9b0e-00039252a2af None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:54.943787 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0eb88-d2b3-48f3-9b0e-00039252a2af None admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:54.944704 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e0eb88-d2b3-48f3-9b0e-00039252a2af None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:54.946362 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e0eb88-d2b3-48f3-9b0e-00039252a2af None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:54.948011 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.common [None req-45e0eb88-d2b3-48f3-9b0e-00039252a2af None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 28 20:39:54.969859 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.sql.core [None req-45e0eb88-d2b3-48f3-9b0e-00039252a2af None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 28 20:39:54.969859 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 28 20:39:54.969859 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [parameters: {'id': '738439cf6fb6427f9b8ab0adcbbc9b5c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 28 20:39:54.969859 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91651) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 28 20:39:54.987681 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-45e0eb88-d2b3-48f3-9b0e-00039252a2af None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 738439cf6fb6427f9b8ab0adcbbc9b5c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 738439cf6fb6427f9b8ab0adcbbc9b5c. Oct 28 20:39:54.989929 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 473/947] 10.222.0.49 () {60 vars in 1140 bytes} [Fri Oct 28 20:39:54 2022] POST /identity/v3/projects => generated 262 bytes in 208 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:54.996177 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340959db-4ad2-43e4-ad42-b1539838099f None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:55.105571 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340959db-4ad2-43e4-ad42-b1539838099f None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:55.143725 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29b12a-27af-42d2-a13d-739100970ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:55.144566 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29b12a-27af-42d2-a13d-739100970ef2 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:55.144848 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29b12a-27af-42d2-a13d-739100970ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:55.145126 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29b12a-27af-42d2-a13d-739100970ef2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:55.153092 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f29b12a-27af-42d2-a13d-739100970ef2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:55.154568 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f29b12a-27af-42d2-a13d-739100970ef2 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:55.170122 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-1f29b12a-27af-42d2-a13d-739100970ef2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 20:39:55.171713 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 475/948] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:39:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:55.181430 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0eb88-d2b3-48f3-9b0e-00039252a2af None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:55.318113 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0eb88-d2b3-48f3-9b0e-00039252a2af None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:55.360512 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237b03a-d6d0-4334-aa3b-fa5ae8ef5267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:55.362339 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237b03a-d6d0-4334-aa3b-fa5ae8ef5267 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:55.362843 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237b03a-d6d0-4334-aa3b-fa5ae8ef5267 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:55.363337 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237b03a-d6d0-4334-aa3b-fa5ae8ef5267 None admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:55.364368 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237b03a-d6d0-4334-aa3b-fa5ae8ef5267 None admin] RBAC: Adding query filter params (name=service) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:55.364882 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237b03a-d6d0-4334-aa3b-fa5ae8ef5267 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:55.366827 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237b03a-d6d0-4334-aa3b-fa5ae8ef5267 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:55.390840 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 474/949] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Oct 28 20:39:55 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:55.619523 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc13a67-760c-4219-b28b-782bab506f00 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:55.620377 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc13a67-760c-4219-b28b-782bab506f00 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:55.620933 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc13a67-760c-4219-b28b-782bab506f00 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:55.623508 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 476/950] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:39:55.631219 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d48b4-d149-47f8-9980-ca50823084e9 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:55.631877 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d48b4-d149-47f8-9980-ca50823084e9 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:55.632395 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d48b4-d149-47f8-9980-ca50823084e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:55.655729 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-2b7d48b4-d149-47f8-9980-ca50823084e9 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:55.660088 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-2b7d48b4-d149-47f8-9980-ca50823084e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:55.797767 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 475/951] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 20:39:55.815484 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d23b0b-90ee-4258-8ec5-527d4643c981 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:55.816296 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d23b0b-90ee-4258-8ec5-527d4643c981 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:55.816296 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d23b0b-90ee-4258-8ec5-527d4643c981 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:55.819343 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 477/952] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:39:55.822540 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d48b4-d149-47f8-9980-ca50823084e9 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:55.824197 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbc02f-a8a0-494b-bc09-49d637f9cb8d None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:55.824486 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbc02f-a8a0-494b-bc09-49d637f9cb8d None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:55.824761 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbc02f-a8a0-494b-bc09-49d637f9cb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:55.848282 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-27dbc02f-a8a0-494b-bc09-49d637f9cb8d None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:55.849608 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-27dbc02f-a8a0-494b-bc09-49d637f9cb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:55.932854 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 478/953] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 20:39:55.955801 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbc02f-a8a0-494b-bc09-49d637f9cb8d None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:55.999781 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d48b4-d149-47f8-9980-ca50823084e9 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:56.049219 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e6cd3-8831-42e4-bf0c-5f8888d1e230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:56.050345 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e6cd3-8831-42e4-bf0c-5f8888d1e230 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:56.050686 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e6cd3-8831-42e4-bf0c-5f8888d1e230 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:56.050968 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e6cd3-8831-42e4-bf0c-5f8888d1e230 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:56.065548 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e6cd3-8831-42e4-bf0c-5f8888d1e230 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:39:56.071284 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbc02f-a8a0-494b-bc09-49d637f9cb8d None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:56.075529 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-b02e6cd3-8831-42e4-bf0c-5f8888d1e230 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 20:39:56.083170 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 476/954] 10.222.0.49 () {56 vars in 1120 bytes} [Fri Oct 28 20:39:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:56.084243 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e6cd3-8831-42e4-bf0c-5f8888d1e230 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:56.126478 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9815fd-c79b-4e5a-8660-5fdc019bb2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:56.127878 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9815fd-c79b-4e5a-8660-5fdc019bb2ae None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:56.128166 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9815fd-c79b-4e5a-8660-5fdc019bb2ae None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:56.128475 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9815fd-c79b-4e5a-8660-5fdc019bb2ae None admin] PATH_INFO: `/v3/services/compute` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:56.129566 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9815fd-c79b-4e5a-8660-5fdc019bb2ae None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:56.130618 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9815fd-c79b-4e5a-8660-5fdc019bb2ae None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:56.143372 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-5b9815fd-c79b-4e5a-8660-5fdc019bb2ae None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 20:39:56.144907 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 479/955] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:39:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:39:56.154444 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9815fd-c79b-4e5a-8660-5fdc019bb2ae None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:56.262791 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9815fd-c79b-4e5a-8660-5fdc019bb2ae None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:56.282647 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e6cd3-8831-42e4-bf0c-5f8888d1e230 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:56.302638 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38585b01-0cbc-431b-85e2-211b70b2bb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:56.303315 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38585b01-0cbc-431b-85e2-211b70b2bb68 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:56.303639 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38585b01-0cbc-431b-85e2-211b70b2bb68 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:56.303905 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38585b01-0cbc-431b-85e2-211b70b2bb68 None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:56.304614 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38585b01-0cbc-431b-85e2-211b70b2bb68 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:56.304922 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38585b01-0cbc-431b-85e2-211b70b2bb68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:56.306541 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38585b01-0cbc-431b-85e2-211b70b2bb68 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:56.317408 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 480/956] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Oct 28 20:39:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:39:56.318364 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38585b01-0cbc-431b-85e2-211b70b2bb68 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:56.348293 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f35f97-7596-4bd8-aee6-29f3ea9927eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:56.350080 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f35f97-7596-4bd8-aee6-29f3ea9927eb None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:56.350902 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f35f97-7596-4bd8-aee6-29f3ea9927eb None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:56.351766 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f35f97-7596-4bd8-aee6-29f3ea9927eb None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:56.353455 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f35f97-7596-4bd8-aee6-29f3ea9927eb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:56.354286 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f35f97-7596-4bd8-aee6-29f3ea9927eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:56.357201 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f35f97-7596-4bd8-aee6-29f3ea9927eb None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:56.374025 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 477/957] 10.222.0.49 () {56 vars in 1115 bytes} [Fri Oct 28 20:39:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:56.381395 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f35f97-7596-4bd8-aee6-29f3ea9927eb None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:56.432842 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38585b01-0cbc-431b-85e2-211b70b2bb68 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:56.469517 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf1507-a486-467a-9f13-471105a6e68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:56.470717 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf1507-a486-467a-9f13-471105a6e68d None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:56.471017 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf1507-a486-467a-9f13-471105a6e68d None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:56.471267 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf1507-a486-467a-9f13-471105a6e68d None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:56.472017 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf1507-a486-467a-9f13-471105a6e68d None admin] RBAC: Adding query filter params (type=compute) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:56.472324 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf1507-a486-467a-9f13-471105a6e68d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:56.473789 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf1507-a486-467a-9f13-471105a6e68d None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:56.484271 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 481/958] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Oct 28 20:39:56 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:56.588621 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f35f97-7596-4bd8-aee6-29f3ea9927eb None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:56.601898 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50456ca9-53c4-4fb1-bd76-7314a72c3622 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:56.602404 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50456ca9-53c4-4fb1-bd76-7314a72c3622 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:56.602898 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50456ca9-53c4-4fb1-bd76-7314a72c3622 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:56.612377 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 482/959] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:56 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:39:56.616383 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f5fbb-fe6f-4857-a73f-fa96bf726fe6 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:56.616833 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f5fbb-fe6f-4857-a73f-fa96bf726fe6 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:56.617294 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f5fbb-fe6f-4857-a73f-fa96bf726fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:56.651155 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-466f5fbb-fe6f-4857-a73f-fa96bf726fe6 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:56.654476 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-466f5fbb-fe6f-4857-a73f-fa96bf726fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:56.662036 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de543f45-d1ab-431d-9621-62fb4fe1ff5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:56.663312 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de543f45-d1ab-431d-9621-62fb4fe1ff5e None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:56.663827 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de543f45-d1ab-431d-9621-62fb4fe1ff5e None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:56.664291 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de543f45-d1ab-431d-9621-62fb4fe1ff5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:56.683441 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de543f45-d1ab-431d-9621-62fb4fe1ff5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:56.685672 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de543f45-d1ab-431d-9621-62fb4fe1ff5e None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:56.713182 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-de543f45-d1ab-431d-9621-62fb4fe1ff5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:56.714451 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 478/960] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:56.720471 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de543f45-d1ab-431d-9621-62fb4fe1ff5e None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:56.791967 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 483/961] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:39:56.815421 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f5fbb-fe6f-4857-a73f-fa96bf726fe6 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:56.876032 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de543f45-d1ab-431d-9621-62fb4fe1ff5e None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:56.934448 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad47fe-32fd-474b-88f2-6e1c795d0e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:56.935529 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad47fe-32fd-474b-88f2-6e1c795d0e9a None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:56.936040 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad47fe-32fd-474b-88f2-6e1c795d0e9a None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:56.936535 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad47fe-32fd-474b-88f2-6e1c795d0e9a None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:56.937484 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad47fe-32fd-474b-88f2-6e1c795d0e9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:56.937994 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad47fe-32fd-474b-88f2-6e1c795d0e9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:56.940258 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad47fe-32fd-474b-88f2-6e1c795d0e9a None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:56.959595 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 479/962] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:39:56.961054 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad47fe-32fd-474b-88f2-6e1c795d0e9a None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:57.032103 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f5fbb-fe6f-4857-a73f-fa96bf726fe6 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:57.086233 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f0c38-c11b-47c3-9357-2b0939e85217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:57.087477 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f0c38-c11b-47c3-9357-2b0939e85217 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:57.088020 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f0c38-c11b-47c3-9357-2b0939e85217 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:57.088526 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f0c38-c11b-47c3-9357-2b0939e85217 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:57.089421 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f0c38-c11b-47c3-9357-2b0939e85217 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:57.091131 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f0c38-c11b-47c3-9357-2b0939e85217 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:57.104554 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-999f0c38-c11b-47c3-9357-2b0939e85217 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 20:39:57.112430 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 484/963] 10.222.0.49 () {56 vars in 1126 bytes} [Fri Oct 28 20:39:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:57.113728 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f0c38-c11b-47c3-9357-2b0939e85217 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:57.115810 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad47fe-32fd-474b-88f2-6e1c795d0e9a None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:57.200497 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69825a0-16a4-406c-a395-134599b1e360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:57.201674 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69825a0-16a4-406c-a395-134599b1e360 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:57.202151 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69825a0-16a4-406c-a395-134599b1e360 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:57.202675 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69825a0-16a4-406c-a395-134599b1e360 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:57.212426 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69825a0-16a4-406c-a395-134599b1e360 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:57.214304 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69825a0-16a4-406c-a395-134599b1e360 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:57.234585 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-d69825a0-16a4-406c-a395-134599b1e360 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 20:39:57.242091 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 480/964] 10.222.0.49 () {56 vars in 1117 bytes} [Fri Oct 28 20:39:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:57.243365 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69825a0-16a4-406c-a395-134599b1e360 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:57.272087 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f0c38-c11b-47c3-9357-2b0939e85217 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:57.324477 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a1515-6f7f-4299-bdb6-ad83bc3b6f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:57.325532 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a1515-6f7f-4299-bdb6-ad83bc3b6f41 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:57.326073 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a1515-6f7f-4299-bdb6-ad83bc3b6f41 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:57.326542 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a1515-6f7f-4299-bdb6-ad83bc3b6f41 None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:57.327466 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a1515-6f7f-4299-bdb6-ad83bc3b6f41 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:57.328037 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a1515-6f7f-4299-bdb6-ad83bc3b6f41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:57.330201 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a1515-6f7f-4299-bdb6-ad83bc3b6f41 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:57.341560 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 485/965] 10.222.0.49 () {56 vars in 1122 bytes} [Fri Oct 28 20:39:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:57.342945 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a1515-6f7f-4299-bdb6-ad83bc3b6f41 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:57.401395 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69825a0-16a4-406c-a395-134599b1e360 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:57.442802 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df46cf-eb33-4ac9-92d7-5c9022426124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:57.444660 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df46cf-eb33-4ac9-92d7-5c9022426124 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:57.445837 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df46cf-eb33-4ac9-92d7-5c9022426124 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:57.446812 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df46cf-eb33-4ac9-92d7-5c9022426124 None admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:57.448959 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df46cf-eb33-4ac9-92d7-5c9022426124 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:57.449955 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df46cf-eb33-4ac9-92d7-5c9022426124 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:57.453443 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df46cf-eb33-4ac9-92d7-5c9022426124 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:57.488957 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 481/966] 10.222.0.49 () {56 vars in 1149 bytes} [Fri Oct 28 20:39:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:57.494526 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df46cf-eb33-4ac9-92d7-5c9022426124 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:57.510438 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a1515-6f7f-4299-bdb6-ad83bc3b6f41 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:57.586108 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7332e5c-feb7-419f-8c6d-1676a9fa9455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:57.587199 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7332e5c-feb7-419f-8c6d-1676a9fa9455 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:57.587703 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7332e5c-feb7-419f-8c6d-1676a9fa9455 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:57.588245 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7332e5c-feb7-419f-8c6d-1676a9fa9455 None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:57.589168 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7332e5c-feb7-419f-8c6d-1676a9fa9455 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:57.589670 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7332e5c-feb7-419f-8c6d-1676a9fa9455 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:57.591247 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7332e5c-feb7-419f-8c6d-1676a9fa9455 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:57.602548 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 486/967] 10.222.0.49 () {56 vars in 1122 bytes} [Fri Oct 28 20:39:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:57.603856 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7332e5c-feb7-419f-8c6d-1676a9fa9455 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:57.637381 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df46cf-eb33-4ac9-92d7-5c9022426124 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:57.715354 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0aa86-798a-4caa-b6c0-61714fd15190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:57.716419 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0aa86-798a-4caa-b6c0-61714fd15190 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:57.716563 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0aa86-798a-4caa-b6c0-61714fd15190 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:57.716909 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0aa86-798a-4caa-b6c0-61714fd15190 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:57.739006 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7332e5c-feb7-419f-8c6d-1676a9fa9455 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:57.813947 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4adb5e-0578-45b6-808b-53dbf158dc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:57.815562 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4adb5e-0578-45b6-808b-53dbf158dc4d None admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:57.816236 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4adb5e-0578-45b6-808b-53dbf158dc4d None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:57.817336 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4adb5e-0578-45b6-808b-53dbf158dc4d None admin] PATH_INFO: `/v3/endpoints` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:57.819176 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4adb5e-0578-45b6-808b-53dbf158dc4d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:57.821825 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4adb5e-0578-45b6-808b-53dbf158dc4d None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:57.828846 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce0aa86-798a-4caa-b6c0-61714fd15190 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:57.831648 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce0aa86-798a-4caa-b6c0-61714fd15190 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:57.861654 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 487/968] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:39:57 2022] POST /identity/v3/endpoints => generated 349 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:39:58.020683 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 482/969] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:39:57 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 28 20:39:58.029563 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4adb5e-0578-45b6-808b-53dbf158dc4d None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:58.157443 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4adb5e-0578-45b6-808b-53dbf158dc4d None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:58.197500 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1476cd9-ea27-4e17-b88d-4f475ffa297f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:58.198309 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1476cd9-ea27-4e17-b88d-4f475ffa297f None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:58.198607 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1476cd9-ea27-4e17-b88d-4f475ffa297f None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:58.198841 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1476cd9-ea27-4e17-b88d-4f475ffa297f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:58.211164 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1476cd9-ea27-4e17-b88d-4f475ffa297f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:58.212743 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1476cd9-ea27-4e17-b88d-4f475ffa297f None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:58.232755 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-e1476cd9-ea27-4e17-b88d-4f475ffa297f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:39:58.232755 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 488/970] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:39:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:58.242293 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0aa86-798a-4caa-b6c0-61714fd15190 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:58.429372 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0aa86-798a-4caa-b6c0-61714fd15190 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:58.497441 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38b4b2-cc6e-447d-8f1a-e5ab56bf54a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:58.498520 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38b4b2-cc6e-447d-8f1a-e5ab56bf54a5 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:58.499351 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38b4b2-cc6e-447d-8f1a-e5ab56bf54a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:58.499589 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38b4b2-cc6e-447d-8f1a-e5ab56bf54a5 None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:58.500772 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38b4b2-cc6e-447d-8f1a-e5ab56bf54a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:58.501984 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38b4b2-cc6e-447d-8f1a-e5ab56bf54a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:58.504629 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38b4b2-cc6e-447d-8f1a-e5ab56bf54a5 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:58.526686 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 483/971] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:58.536573 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1476cd9-ea27-4e17-b88d-4f475ffa297f None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:58.711905 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1476cd9-ea27-4e17-b88d-4f475ffa297f None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:58.773079 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1fb3cd-2332-4f6c-95b4-0afa9bece450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:58.774420 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1fb3cd-2332-4f6c-95b4-0afa9bece450 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:58.774898 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1fb3cd-2332-4f6c-95b4-0afa9bece450 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:58.775374 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1fb3cd-2332-4f6c-95b4-0afa9bece450 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:58.790013 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1fb3cd-2332-4f6c-95b4-0afa9bece450 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:58.792741 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1fb3cd-2332-4f6c-95b4-0afa9bece450 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:58.820715 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-8a1fb3cd-2332-4f6c-95b4-0afa9bece450 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 20:39:58.823332 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 489/972] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:39:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:58.833486 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38b4b2-cc6e-447d-8f1a-e5ab56bf54a5 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:59.001588 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7262c-0a8a-4be0-a659-e1b9230523a2 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:59.002009 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7262c-0a8a-4be0-a659-e1b9230523a2 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:59.002493 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7262c-0a8a-4be0-a659-e1b9230523a2 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:59.012235 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 490/973] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:39:58 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:39:59.014520 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0beec-8104-4364-8869-8df41f450065 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:59.015002 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0beec-8104-4364-8869-8df41f450065 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:59.015481 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0beec-8104-4364-8869-8df41f450065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:59.044442 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38b4b2-cc6e-447d-8f1a-e5ab56bf54a5 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:59.047199 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-f0f0beec-8104-4364-8869-8df41f450065 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:39:59.050275 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-f0f0beec-8104-4364-8869-8df41f450065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:39:59.113652 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c96f2d-8e78-4c7e-8fb4-feea36769023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:59.114702 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c96f2d-8e78-4c7e-8fb4-feea36769023 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:59.115193 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c96f2d-8e78-4c7e-8fb4-feea36769023 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:59.115681 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c96f2d-8e78-4c7e-8fb4-feea36769023 None admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:59.117249 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c96f2d-8e78-4c7e-8fb4-feea36769023 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:59.117763 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c96f2d-8e78-4c7e-8fb4-feea36769023 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:59.120515 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c96f2d-8e78-4c7e-8fb4-feea36769023 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:59.145782 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 484/974] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 20:39:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:39:59.154808 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c96f2d-8e78-4c7e-8fb4-feea36769023 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:59.187968 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 491/975] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:39:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 20:39:59.231778 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0beec-8104-4364-8869-8df41f450065 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:59.353108 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c96f2d-8e78-4c7e-8fb4-feea36769023 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:59.410736 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0beec-8104-4364-8869-8df41f450065 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:59.416977 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9ec24-db9c-4751-a62a-98b3d9ad67d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:59.418067 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9ec24-db9c-4751-a62a-98b3d9ad67d1 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:59.418551 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9ec24-db9c-4751-a62a-98b3d9ad67d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:59.419031 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9ec24-db9c-4751-a62a-98b3d9ad67d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:59.420697 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c9ec24-db9c-4751-a62a-98b3d9ad67d1 None admin] RBAC: Adding query filter params (role.id=f5ccdb0329bf4a79a4fa1396ad06ab3d, scope.project.id=c55c2ee59af14cf8a7e4275de4f43037, user.id=78cde480dd8b4a85ac30895026bfc406) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:59.421238 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c9ec24-db9c-4751-a62a-98b3d9ad67d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:59.424648 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c9ec24-db9c-4751-a62a-98b3d9ad67d1 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:59.435710 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 485/976] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:39:59 2022] GET /identity/v3/role_assignments?user.id=78cde480dd8b4a85ac30895026bfc406&scope.project.id=c55c2ee59af14cf8a7e4275de4f43037&role.id=f5ccdb0329bf4a79a4fa1396ad06ab3d => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:39:59.490377 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289a2a0-f366-4f43-9a12-5152946df1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:59.491550 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289a2a0-f366-4f43-9a12-5152946df1a0 None admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:59.492089 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289a2a0-f366-4f43-9a12-5152946df1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:59.492556 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289a2a0-f366-4f43-9a12-5152946df1a0 None admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:59.493899 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289a2a0-f366-4f43-9a12-5152946df1a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:59.496850 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289a2a0-f366-4f43-9a12-5152946df1a0 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:59.499519 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.common [None req-5289a2a0-f366-4f43-9a12-5152946df1a0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 28 20:39:59.522548 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.sql.core [None req-5289a2a0-f366-4f43-9a12-5152946df1a0 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 28 20:39:59.522548 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 28 20:39:59.522548 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [parameters: {'user_id': 'f27e5f804a2a41b081f345d2c557d719', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 28 20:39:59.522548 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91652) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 28 20:39:59.535154 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-5289a2a0-f366-4f43-9a12-5152946df1a0 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 28 20:39:59.538154 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 492/977] 10.222.0.49 () {60 vars in 1131 bytes} [Fri Oct 28 20:39:59 2022] POST /identity/v3/users => generated 160 bytes in 314 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:39:59.547550 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9ec24-db9c-4751-a62a-98b3d9ad67d1 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:59.687983 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9ec24-db9c-4751-a62a-98b3d9ad67d1 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:59.728602 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f30cf-8a68-4d84-8162-74aaa5c086bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:59.729481 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f30cf-8a68-4d84-8162-74aaa5c086bc None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:59.729756 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f30cf-8a68-4d84-8162-74aaa5c086bc None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:59.730030 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f30cf-8a68-4d84-8162-74aaa5c086bc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:59.739232 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f30cf-8a68-4d84-8162-74aaa5c086bc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:59.740740 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f30cf-8a68-4d84-8162-74aaa5c086bc None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:59.756945 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-f86f30cf-8a68-4d84-8162-74aaa5c086bc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 20:39:59.758570 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 486/978] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:39:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:39:59.768452 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289a2a0-f366-4f43-9a12-5152946df1a0 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:39:59.896058 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289a2a0-f366-4f43-9a12-5152946df1a0 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:39:59.933772 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021e613-9d07-4bfd-a194-1c69f5c41892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:39:59.934864 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021e613-9d07-4bfd-a194-1c69f5c41892 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:39:59.935409 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021e613-9d07-4bfd-a194-1c69f5c41892 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:39:59.935883 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021e613-9d07-4bfd-a194-1c69f5c41892 None admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:39:59.936873 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021e613-9d07-4bfd-a194-1c69f5c41892 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:39:59.937355 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021e613-9d07-4bfd-a194-1c69f5c41892 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:39:59.939354 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021e613-9d07-4bfd-a194-1c69f5c41892 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:39:59.982622 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 493/979] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 20:39:59 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:00.639023 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d789807-1b32-4cd3-a2e0-ac9a396eada9 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:00.639517 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d789807-1b32-4cd3-a2e0-ac9a396eada9 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:00.639901 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d789807-1b32-4cd3-a2e0-ac9a396eada9 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:00.643791 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 487/980] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:40:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:40:00.652397 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01851688-d468-43cc-aaa5-2dbb10eda461 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:00.653152 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01851688-d468-43cc-aaa5-2dbb10eda461 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:00.653412 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01851688-d468-43cc-aaa5-2dbb10eda461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:00.679360 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-01851688-d468-43cc-aaa5-2dbb10eda461 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:40:00.681305 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-01851688-d468-43cc-aaa5-2dbb10eda461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:40:00.765035 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 494/981] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:40:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:40:00.790232 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d789807-1b32-4cd3-a2e0-ac9a396eada9 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:00.925037 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d789807-1b32-4cd3-a2e0-ac9a396eada9 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:00.966073 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dee265-0fb3-4e41-a7c8-af2ed5317942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:00.966815 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dee265-0fb3-4e41-a7c8-af2ed5317942 None admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:00.967150 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dee265-0fb3-4e41-a7c8-af2ed5317942 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:00.967477 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dee265-0fb3-4e41-a7c8-af2ed5317942 None admin] PATH_INFO: `/v3/services` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:00.968333 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dee265-0fb3-4e41-a7c8-af2ed5317942 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:00.969839 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dee265-0fb3-4e41-a7c8-af2ed5317942 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:00.995774 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 488/982] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Oct 28 20:40:00 2022] POST /identity/v3/services => generated 242 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:40:01.070508 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239abe7-3e40-42f9-b77d-10d17542ccf9 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:01.070783 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239abe7-3e40-42f9-b77d-10d17542ccf9 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:01.071088 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239abe7-3e40-42f9-b77d-10d17542ccf9 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:01.073355 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 495/983] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:40:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:40:01.079766 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ce3d9-3615-4927-9ae4-6b53fab972e7 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:01.080182 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ce3d9-3615-4927-9ae4-6b53fab972e7 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:01.080427 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ce3d9-3615-4927-9ae4-6b53fab972e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:01.099578 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-083ce3d9-3615-4927-9ae4-6b53fab972e7 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:40:01.100887 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-083ce3d9-3615-4927-9ae4-6b53fab972e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:40:01.191870 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 489/984] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:40:01 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 20:40:01.214230 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239abe7-3e40-42f9-b77d-10d17542ccf9 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:01.332917 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239abe7-3e40-42f9-b77d-10d17542ccf9 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:01.369924 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b666279-d638-435d-bce6-1ef84aa6bdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:01.371144 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b666279-d638-435d-bce6-1ef84aa6bdd9 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:01.371687 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b666279-d638-435d-bce6-1ef84aa6bdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:01.372176 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b666279-d638-435d-bce6-1ef84aa6bdd9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:01.373030 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b666279-d638-435d-bce6-1ef84aa6bdd9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:01.374617 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b666279-d638-435d-bce6-1ef84aa6bdd9 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:01.387162 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-0b666279-d638-435d-bce6-1ef84aa6bdd9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 20:40:01.389068 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 496/985] 10.222.0.49 () {56 vars in 1126 bytes} [Fri Oct 28 20:40:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:40:01.398733 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ce3d9-3615-4927-9ae4-6b53fab972e7 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:01.562318 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ce3d9-3615-4927-9ae4-6b53fab972e7 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:01.617648 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8b227-d40d-4cad-8afc-276be7a45dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:01.618743 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8b227-d40d-4cad-8afc-276be7a45dcd None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:01.619229 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8b227-d40d-4cad-8afc-276be7a45dcd None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:01.619818 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8b227-d40d-4cad-8afc-276be7a45dcd None admin] PATH_INFO: `/v3/services` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:01.621169 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8b227-d40d-4cad-8afc-276be7a45dcd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:01.621620 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8b227-d40d-4cad-8afc-276be7a45dcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:01.624122 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8b227-d40d-4cad-8afc-276be7a45dcd None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:01.637896 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 490/986] 10.222.0.49 () {56 vars in 1122 bytes} [Fri Oct 28 20:40:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:01.639287 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b666279-d638-435d-bce6-1ef84aa6bdd9 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:01.809686 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b666279-d638-435d-bce6-1ef84aa6bdd9 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:01.871836 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abced8-d72d-4010-89cd-4491c9ad7588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:01.872903 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abced8-d72d-4010-89cd-4491c9ad7588 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:01.873391 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abced8-d72d-4010-89cd-4491c9ad7588 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:01.873887 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abced8-d72d-4010-89cd-4491c9ad7588 None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:01.875229 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71abced8-d72d-4010-89cd-4491c9ad7588 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:01.875796 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71abced8-d72d-4010-89cd-4491c9ad7588 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:01.878952 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71abced8-d72d-4010-89cd-4491c9ad7588 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:01.888268 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 497/987] 10.222.0.49 () {56 vars in 1122 bytes} [Fri Oct 28 20:40:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:01.894591 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8b227-d40d-4cad-8afc-276be7a45dcd None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:02.004546 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8b227-d40d-4cad-8afc-276be7a45dcd None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:02.040346 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5f4f3-7e92-4eda-a315-9accb280e073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:02.041189 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5f4f3-7e92-4eda-a315-9accb280e073 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:02.041589 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5f4f3-7e92-4eda-a315-9accb280e073 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:02.041981 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5f4f3-7e92-4eda-a315-9accb280e073 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:02.042900 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5f4f3-7e92-4eda-a315-9accb280e073 None admin] RBAC: Adding query filter params (interface=admin, service_id=e9cd9857057e4deca2fc9aea1b820b74, region_id=RegionOne) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:02.043328 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5f4f3-7e92-4eda-a315-9accb280e073 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:02.044966 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5f4f3-7e92-4eda-a315-9accb280e073 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:02.056104 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 491/988] 10.222.0.49 () {56 vars in 1249 bytes} [Fri Oct 28 20:40:01 2022] GET /identity/v3/endpoints?service_id=e9cd9857057e4deca2fc9aea1b820b74&interface=admin®ion_id=RegionOne => generated 193 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:40:02.057388 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abced8-d72d-4010-89cd-4491c9ad7588 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:02.166244 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abced8-d72d-4010-89cd-4491c9ad7588 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:02.203056 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d3ec7-988a-400b-9a2e-51fc67d93ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:02.203951 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d3ec7-988a-400b-9a2e-51fc67d93ff4 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:02.204425 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d3ec7-988a-400b-9a2e-51fc67d93ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:02.204819 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d3ec7-988a-400b-9a2e-51fc67d93ff4 None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:02.205665 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d3ec7-988a-400b-9a2e-51fc67d93ff4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:02.207220 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d3ec7-988a-400b-9a2e-51fc67d93ff4 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:02.215141 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 498/989] 10.222.0.49 () {56 vars in 1087 bytes} [Fri Oct 28 20:40:02 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:40:02.665493 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac1155-dee1-4a93-a7bc-749d6a285284 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:02.665787 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac1155-dee1-4a93-a7bc-749d6a285284 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:02.666255 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac1155-dee1-4a93-a7bc-749d6a285284 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:02.668262 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 492/990] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:40:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:40:02.674579 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f08133-0e3c-401f-8c92-ea98005abab1 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:02.674862 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f08133-0e3c-401f-8c92-ea98005abab1 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:02.675133 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f08133-0e3c-401f-8c92-ea98005abab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:02.693711 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-83f08133-0e3c-401f-8c92-ea98005abab1 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:40:02.694921 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-83f08133-0e3c-401f-8c92-ea98005abab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:40:02.787384 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 499/991] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:40:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:40:02.826311 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac1155-dee1-4a93-a7bc-749d6a285284 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:02.986290 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac1155-dee1-4a93-a7bc-749d6a285284 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:03.045936 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f70381-2a63-4950-899a-a9da816ed056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:03.046790 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f70381-2a63-4950-899a-a9da816ed056 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:03.047163 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f70381-2a63-4950-899a-a9da816ed056 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:03.047523 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f70381-2a63-4950-899a-a9da816ed056 None admin] PATH_INFO: `/v3/services/image` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:03.048964 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f70381-2a63-4950-899a-a9da816ed056 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:03.050373 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f70381-2a63-4950-899a-a9da816ed056 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:03.067851 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-76f70381-2a63-4950-899a-a9da816ed056 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 20:40:03.075979 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 493/992] 10.222.0.49 () {56 vars in 1105 bytes} [Fri Oct 28 20:40:02 2022] GET /identity/v3/services/image => generated 86 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:40:03.078296 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f08133-0e3c-401f-8c92-ea98005abab1 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:03.262937 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f08133-0e3c-401f-8c92-ea98005abab1 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:03.321986 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80b77e-87ff-4fc2-8b01-6d21ece10c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:03.322727 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80b77e-87ff-4fc2-8b01-6d21ece10c95 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:03.323029 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80b77e-87ff-4fc2-8b01-6d21ece10c95 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:03.323302 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80b77e-87ff-4fc2-8b01-6d21ece10c95 None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:03.324053 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80b77e-87ff-4fc2-8b01-6d21ece10c95 None admin] RBAC: Adding query filter params (name=image) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:03.324397 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80b77e-87ff-4fc2-8b01-6d21ece10c95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:03.326927 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80b77e-87ff-4fc2-8b01-6d21ece10c95 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:03.342134 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 500/993] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:40:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:03.348163 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f70381-2a63-4950-899a-a9da816ed056 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:03.473322 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181a97d-f47c-4b97-bbc1-78ed270e52f3 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:03.473654 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181a97d-f47c-4b97-bbc1-78ed270e52f3 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:03.473879 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181a97d-f47c-4b97-bbc1-78ed270e52f3 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:03.475694 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 501/994] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:40:03.481170 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2576bd7-9a81-4c0c-861f-367ed6ff14ae None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:03.481464 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2576bd7-9a81-4c0c-861f-367ed6ff14ae None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:03.481726 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2576bd7-9a81-4c0c-861f-367ed6ff14ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:03.486249 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f70381-2a63-4950-899a-a9da816ed056 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:03.504082 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-f2576bd7-9a81-4c0c-861f-367ed6ff14ae None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:40:03.505283 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-f2576bd7-9a81-4c0c-861f-367ed6ff14ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:40:03.523925 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f34cbb-0715-49e2-ad4f-7c1a19e0f500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:03.524653 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f34cbb-0715-49e2-ad4f-7c1a19e0f500 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:03.524929 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f34cbb-0715-49e2-ad4f-7c1a19e0f500 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:03.525201 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f34cbb-0715-49e2-ad4f-7c1a19e0f500 None admin] PATH_INFO: `/v3/services` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:03.525914 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f34cbb-0715-49e2-ad4f-7c1a19e0f500 None admin] RBAC: Adding query filter params (type=image) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:03.526219 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f34cbb-0715-49e2-ad4f-7c1a19e0f500 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:03.527603 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f34cbb-0715-49e2-ad4f-7c1a19e0f500 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:03.533330 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 494/995] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:40:03 2022] GET /identity/v3/services?type=image => generated 122 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:40:03.594473 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 502/996] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:40:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 20:40:03.634288 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f34cbb-0715-49e2-ad4f-7c1a19e0f500 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:03.797012 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f34cbb-0715-49e2-ad4f-7c1a19e0f500 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:03.834534 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99177b34-ed92-4993-aa2e-2d113738684f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:03.835534 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99177b34-ed92-4993-aa2e-2d113738684f None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:03.835997 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99177b34-ed92-4993-aa2e-2d113738684f None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:03.836409 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99177b34-ed92-4993-aa2e-2d113738684f None admin] PATH_INFO: `/v3/services/compute` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:03.837251 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99177b34-ed92-4993-aa2e-2d113738684f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:03.838829 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99177b34-ed92-4993-aa2e-2d113738684f None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:03.851810 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-99177b34-ed92-4993-aa2e-2d113738684f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 20:40:03.853388 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 495/997] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:40:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:40:03.860004 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2576bd7-9a81-4c0c-861f-367ed6ff14ae None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:04.039692 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2576bd7-9a81-4c0c-861f-367ed6ff14ae None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:04.098350 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7aa698-acea-46d6-aa1e-8f48e6331af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:04.099297 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7aa698-acea-46d6-aa1e-8f48e6331af5 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:04.099731 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7aa698-acea-46d6-aa1e-8f48e6331af5 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:04.100204 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7aa698-acea-46d6-aa1e-8f48e6331af5 None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:04.101381 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7aa698-acea-46d6-aa1e-8f48e6331af5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:04.101860 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7aa698-acea-46d6-aa1e-8f48e6331af5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:04.104373 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7aa698-acea-46d6-aa1e-8f48e6331af5 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:04.118387 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 503/998] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Oct 28 20:40:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:40:04.120257 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99177b34-ed92-4993-aa2e-2d113738684f None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:04.282473 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99177b34-ed92-4993-aa2e-2d113738684f None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:04.327398 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ed083-35cf-4f14-ba13-5fbe4891a646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:04.328322 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ed083-35cf-4f14-ba13-5fbe4891a646 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:04.328728 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ed083-35cf-4f14-ba13-5fbe4891a646 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:04.329180 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ed083-35cf-4f14-ba13-5fbe4891a646 None admin] PATH_INFO: `/v3/services` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:04.330605 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ed083-35cf-4f14-ba13-5fbe4891a646 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:04.331232 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ed083-35cf-4f14-ba13-5fbe4891a646 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:04.332862 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ed083-35cf-4f14-ba13-5fbe4891a646 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:04.338740 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 496/999] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Oct 28 20:40:04 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:04.344953 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7aa698-acea-46d6-aa1e-8f48e6331af5 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:04.466760 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7aa698-acea-46d6-aa1e-8f48e6331af5 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:04.504362 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ca476-53d9-4631-b113-24f529d97eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:04.505022 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ca476-53d9-4631-b113-24f529d97eac None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:04.505294 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ca476-53d9-4631-b113-24f529d97eac None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:04.505565 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ca476-53d9-4631-b113-24f529d97eac None admin] PATH_INFO: `/v3/endpoints` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:04.506359 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ca476-53d9-4631-b113-24f529d97eac None admin] RBAC: Adding query filter params (interface=public, service_id=fddbb61a76db4f36b9b633e2a5f67932, region_id=RegionOne) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:04.506663 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ca476-53d9-4631-b113-24f529d97eac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:04.508058 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ca476-53d9-4631-b113-24f529d97eac None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:04.513656 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 504/1000] 10.222.0.49 () {56 vars in 1251 bytes} [Fri Oct 28 20:40:04 2022] GET /identity/v3/endpoints?service_id=fddbb61a76db4f36b9b633e2a5f67932&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:04.519328 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ed083-35cf-4f14-ba13-5fbe4891a646 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:04.624493 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ed083-35cf-4f14-ba13-5fbe4891a646 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:04.660525 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd73ab-661e-4859-a36a-5ca731047a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:04.661399 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd73ab-661e-4859-a36a-5ca731047a6a None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:04.661825 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd73ab-661e-4859-a36a-5ca731047a6a None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:04.662251 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd73ab-661e-4859-a36a-5ca731047a6a None admin] PATH_INFO: `/v3/services` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:04.663075 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fd73ab-661e-4859-a36a-5ca731047a6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:04.664713 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fd73ab-661e-4859-a36a-5ca731047a6a None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:04.671875 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 497/1001] 10.222.0.49 () {56 vars in 1087 bytes} [Fri Oct 28 20:40:04 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:40:05.022497 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a295ed-593f-440d-b2e9-37b179376f14 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:05.022967 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a295ed-593f-440d-b2e9-37b179376f14 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:05.023358 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a295ed-593f-440d-b2e9-37b179376f14 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:05.026404 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 505/1002] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:40:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:40:05.036443 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41c390-ef02-4234-b9a7-eb91cc3aded1 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:05.036881 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41c390-ef02-4234-b9a7-eb91cc3aded1 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:05.037336 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41c390-ef02-4234-b9a7-eb91cc3aded1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:05.064705 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-1a41c390-ef02-4234-b9a7-eb91cc3aded1 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:40:05.066695 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-1a41c390-ef02-4234-b9a7-eb91cc3aded1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:40:05.155672 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 498/1003] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:40:05 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 20:40:05.181501 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a295ed-593f-440d-b2e9-37b179376f14 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:05.336556 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a295ed-593f-440d-b2e9-37b179376f14 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:05.373283 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd42d6-4781-4783-83f2-a46435d61445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:05.374127 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd42d6-4781-4783-83f2-a46435d61445 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:05.374400 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd42d6-4781-4783-83f2-a46435d61445 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:05.374673 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd42d6-4781-4783-83f2-a46435d61445 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:05.375362 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd42d6-4781-4783-83f2-a46435d61445 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:05.377328 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd42d6-4781-4783-83f2-a46435d61445 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:05.389617 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-7fbd42d6-4781-4783-83f2-a46435d61445 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 20:40:05.391123 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 506/1004] 10.222.0.49 () {56 vars in 1126 bytes} [Fri Oct 28 20:40:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:40:05.398408 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41c390-ef02-4234-b9a7-eb91cc3aded1 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:05.544931 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41c390-ef02-4234-b9a7-eb91cc3aded1 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:05.582566 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b341f-6cac-4caa-be10-d623e71c407b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:05.583377 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b341f-6cac-4caa-be10-d623e71c407b None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:05.583659 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b341f-6cac-4caa-be10-d623e71c407b None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:05.583966 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b341f-6cac-4caa-be10-d623e71c407b None admin] PATH_INFO: `/v3/services` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:05.584698 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b341f-6cac-4caa-be10-d623e71c407b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:05.585028 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b341f-6cac-4caa-be10-d623e71c407b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:05.586500 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b341f-6cac-4caa-be10-d623e71c407b None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:05.592380 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 499/1005] 10.222.0.49 () {56 vars in 1122 bytes} [Fri Oct 28 20:40:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:40:05.599661 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd42d6-4781-4783-83f2-a46435d61445 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:05.722029 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd42d6-4781-4783-83f2-a46435d61445 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:05.756515 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7d95e-d5f0-4469-ac33-13db95466513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:05.757825 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7d95e-d5f0-4469-ac33-13db95466513 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:05.758238 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7d95e-d5f0-4469-ac33-13db95466513 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:05.758522 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7d95e-d5f0-4469-ac33-13db95466513 None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:05.759268 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df7d95e-d5f0-4469-ac33-13db95466513 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:05.759576 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df7d95e-d5f0-4469-ac33-13db95466513 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:05.761381 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df7d95e-d5f0-4469-ac33-13db95466513 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:05.773281 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 507/1006] 10.222.0.49 () {56 vars in 1122 bytes} [Fri Oct 28 20:40:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:40:05.774851 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b341f-6cac-4caa-be10-d623e71c407b None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:05.887517 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b341f-6cac-4caa-be10-d623e71c407b None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:05.931171 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26882771-9b83-4ace-9f00-581a00608dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:05.931866 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26882771-9b83-4ace-9f00-581a00608dfd None admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:05.932202 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26882771-9b83-4ace-9f00-581a00608dfd None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:05.932476 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26882771-9b83-4ace-9f00-581a00608dfd None admin] PATH_INFO: `/v3/endpoints` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:05.933285 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26882771-9b83-4ace-9f00-581a00608dfd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:05.934671 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26882771-9b83-4ace-9f00-581a00608dfd None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:05.951959 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 500/1007] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:40:05 2022] POST /identity/v3/endpoints => generated 325 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:40:06.044173 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e42e1a-c0e7-4164-b190-4f10d646faa5 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:06.044511 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e42e1a-c0e7-4164-b190-4f10d646faa5 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:06.044723 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e42e1a-c0e7-4164-b190-4f10d646faa5 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:06.046812 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 508/1008] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:40:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:40:06.053695 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a91f1-4d1c-472d-b5a1-38b8efe999b1 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:06.054009 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a91f1-4d1c-472d-b5a1-38b8efe999b1 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:06.054243 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a91f1-4d1c-472d-b5a1-38b8efe999b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:06.073906 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-816a91f1-4d1c-472d-b5a1-38b8efe999b1 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:40:06.075141 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-816a91f1-4d1c-472d-b5a1-38b8efe999b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:40:06.162866 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 501/1009] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:40:06 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:40:06.187541 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e42e1a-c0e7-4164-b190-4f10d646faa5 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:06.297781 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e42e1a-c0e7-4164-b190-4f10d646faa5 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:06.333499 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd9a8b-6de8-44db-992c-7fb778fb4ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:06.334161 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd9a8b-6de8-44db-992c-7fb778fb4ab1 None admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:06.334437 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd9a8b-6de8-44db-992c-7fb778fb4ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:06.334701 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd9a8b-6de8-44db-992c-7fb778fb4ab1 None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:06.335417 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd9a8b-6de8-44db-992c-7fb778fb4ab1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:06.336828 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd9a8b-6de8-44db-992c-7fb778fb4ab1 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:06.351988 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 509/1010] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Oct 28 20:40:06 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:40:07.431600 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf7a63-2f87-4ad1-83e8-6bb233876fa4 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:07.432330 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf7a63-2f87-4ad1-83e8-6bb233876fa4 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:07.432330 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf7a63-2f87-4ad1-83e8-6bb233876fa4 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:07.434158 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 502/1011] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:40:07.440273 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f0461-a0b1-4f94-bbfe-bea10c718b2b None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:07.440811 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f0461-a0b1-4f94-bbfe-bea10c718b2b None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:07.441024 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f0461-a0b1-4f94-bbfe-bea10c718b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:07.458340 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-562f0461-a0b1-4f94-bbfe-bea10c718b2b None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:40:07.459534 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-562f0461-a0b1-4f94-bbfe-bea10c718b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:40:07.540911 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 510/1012] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:40:07 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:40:07.564692 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf7a63-2f87-4ad1-83e8-6bb233876fa4 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:07.713652 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf7a63-2f87-4ad1-83e8-6bb233876fa4 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:07.771623 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888a138-e8f2-4e56-9fb9-38e91450e0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:07.773042 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888a138-e8f2-4e56-9fb9-38e91450e0f9 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:07.773450 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888a138-e8f2-4e56-9fb9-38e91450e0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:07.773729 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888a138-e8f2-4e56-9fb9-38e91450e0f9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:07.775028 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888a138-e8f2-4e56-9fb9-38e91450e0f9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:07.777687 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888a138-e8f2-4e56-9fb9-38e91450e0f9 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:07.800590 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-2888a138-e8f2-4e56-9fb9-38e91450e0f9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 20:40:07.807727 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 503/1013] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:40:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:40:07.809360 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f0461-a0b1-4f94-bbfe-bea10c718b2b None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:07.923459 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f0461-a0b1-4f94-bbfe-bea10c718b2b None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:07.965995 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76bcd3-ad26-4759-ab99-d6fffa086865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:07.966668 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76bcd3-ad26-4759-ab99-d6fffa086865 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:07.966947 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76bcd3-ad26-4759-ab99-d6fffa086865 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:07.967216 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76bcd3-ad26-4759-ab99-d6fffa086865 None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:07.967968 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76bcd3-ad26-4759-ab99-d6fffa086865 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:07.968271 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76bcd3-ad26-4759-ab99-d6fffa086865 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:07.969671 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76bcd3-ad26-4759-ab99-d6fffa086865 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:07.976034 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 511/1014] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Oct 28 20:40:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:07.981771 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888a138-e8f2-4e56-9fb9-38e91450e0f9 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:08.117770 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888a138-e8f2-4e56-9fb9-38e91450e0f9 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:08.175819 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329abe9f-bb3d-41af-863a-2280353befa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:08.176865 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329abe9f-bb3d-41af-863a-2280353befa6 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:08.177373 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329abe9f-bb3d-41af-863a-2280353befa6 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:08.177879 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329abe9f-bb3d-41af-863a-2280353befa6 None admin] PATH_INFO: `/v3/services` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:08.179196 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329abe9f-bb3d-41af-863a-2280353befa6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:08.179605 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329abe9f-bb3d-41af-863a-2280353befa6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:08.181352 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329abe9f-bb3d-41af-863a-2280353befa6 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:08.188408 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 504/1015] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Oct 28 20:40:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:40:08.196522 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76bcd3-ad26-4759-ab99-d6fffa086865 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:08.311885 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76bcd3-ad26-4759-ab99-d6fffa086865 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:08.353336 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a045d27-3c9f-4fb8-afa9-ab61cf76870e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:08.354010 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a045d27-3c9f-4fb8-afa9-ab61cf76870e None admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:08.354292 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a045d27-3c9f-4fb8-afa9-ab61cf76870e None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:08.354568 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a045d27-3c9f-4fb8-afa9-ab61cf76870e None admin] PATH_INFO: `/v3/endpoints` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:08.355325 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a045d27-3c9f-4fb8-afa9-ab61cf76870e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:08.356759 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a045d27-3c9f-4fb8-afa9-ab61cf76870e None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:08.388527 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 512/1016] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:40:08 2022] POST /identity/v3/endpoints => generated 334 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:40:08.888515 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80851069-d787-480e-aa09-8d93e0e3529d None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:08.889260 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80851069-d787-480e-aa09-8d93e0e3529d None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:08.889260 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80851069-d787-480e-aa09-8d93e0e3529d None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:08.891263 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 505/1017] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:40:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:40:08.897134 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc96e5-c5c6-4af9-ac42-7579f5757c6b None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:08.897993 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc96e5-c5c6-4af9-ac42-7579f5757c6b None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:08.897993 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc96e5-c5c6-4af9-ac42-7579f5757c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:08.917374 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-77cc96e5-c5c6-4af9-ac42-7579f5757c6b None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:40:08.918625 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-77cc96e5-c5c6-4af9-ac42-7579f5757c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:40:09.006524 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 513/1018] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:40:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:40:09.029468 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80851069-d787-480e-aa09-8d93e0e3529d None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:09.167601 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80851069-d787-480e-aa09-8d93e0e3529d None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:09.205468 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af4649-5cf3-4d95-85da-42a4842b6a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:09.206310 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af4649-5cf3-4d95-85da-42a4842b6a51 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:09.206601 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af4649-5cf3-4d95-85da-42a4842b6a51 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:09.206870 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af4649-5cf3-4d95-85da-42a4842b6a51 None admin] PATH_INFO: `/v3/services/image` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:09.207504 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af4649-5cf3-4d95-85da-42a4842b6a51 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:09.208922 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af4649-5cf3-4d95-85da-42a4842b6a51 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:09.221200 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-99af4649-5cf3-4d95-85da-42a4842b6a51 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 20:40:09.224157 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 506/1019] 10.222.0.49 () {56 vars in 1105 bytes} [Fri Oct 28 20:40:09 2022] GET /identity/v3/services/image => generated 86 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:40:09.227664 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc96e5-c5c6-4af9-ac42-7579f5757c6b None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:09.331861 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac05b9-2d29-4c42-b641-aa33bdf28159 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:09.332441 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac05b9-2d29-4c42-b641-aa33bdf28159 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:09.332930 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac05b9-2d29-4c42-b641-aa33bdf28159 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:09.336417 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 507/1020] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:40:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:40:09.341879 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc96e5-c5c6-4af9-ac42-7579f5757c6b None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:09.345439 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66511b2b-74ff-41c5-afdc-b1206bc7dfe2 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:09.345945 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66511b2b-74ff-41c5-afdc-b1206bc7dfe2 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:09.346270 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66511b2b-74ff-41c5-afdc-b1206bc7dfe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:09.372480 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-66511b2b-74ff-41c5-afdc-b1206bc7dfe2 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:40:09.374585 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-66511b2b-74ff-41c5-afdc-b1206bc7dfe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:40:09.377547 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca5559-3120-4d0a-8c28-c49ad0c8da2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:09.378225 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca5559-3120-4d0a-8c28-c49ad0c8da2c None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:09.378507 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca5559-3120-4d0a-8c28-c49ad0c8da2c None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:09.378781 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca5559-3120-4d0a-8c28-c49ad0c8da2c None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:09.379526 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca5559-3120-4d0a-8c28-c49ad0c8da2c None admin] RBAC: Adding query filter params (name=image) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:09.379859 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca5559-3120-4d0a-8c28-c49ad0c8da2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:09.381249 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca5559-3120-4d0a-8c28-c49ad0c8da2c None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:09.391443 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 514/1021] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:40:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:09.392701 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca5559-3120-4d0a-8c28-c49ad0c8da2c None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:09.451500 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 508/1022] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:40:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:40:09.476866 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66511b2b-74ff-41c5-afdc-b1206bc7dfe2 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:09.525617 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca5559-3120-4d0a-8c28-c49ad0c8da2c None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:09.568091 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812625fd-9789-4a24-9ac1-25d2f75cd195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:09.568757 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812625fd-9789-4a24-9ac1-25d2f75cd195 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:09.569031 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812625fd-9789-4a24-9ac1-25d2f75cd195 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:09.569298 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812625fd-9789-4a24-9ac1-25d2f75cd195 None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:09.570004 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812625fd-9789-4a24-9ac1-25d2f75cd195 None admin] RBAC: Adding query filter params (type=image) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:09.570304 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812625fd-9789-4a24-9ac1-25d2f75cd195 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:09.571675 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812625fd-9789-4a24-9ac1-25d2f75cd195 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:09.577024 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 515/1023] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:40:09 2022] GET /identity/v3/services?type=image => generated 350 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:40:09.583803 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812625fd-9789-4a24-9ac1-25d2f75cd195 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:09.590729 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66511b2b-74ff-41c5-afdc-b1206bc7dfe2 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:09.634536 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275bb7e-636c-465a-856b-bdfe9dcb02e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:09.635375 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275bb7e-636c-465a-856b-bdfe9dcb02e5 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:09.635663 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275bb7e-636c-465a-856b-bdfe9dcb02e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:09.635969 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275bb7e-636c-465a-856b-bdfe9dcb02e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:09.637335 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275bb7e-636c-465a-856b-bdfe9dcb02e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:09.638853 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275bb7e-636c-465a-856b-bdfe9dcb02e5 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:09.643793 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 509/1024] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:40:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:09.646919 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275bb7e-636c-465a-856b-bdfe9dcb02e5 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:09.711582 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812625fd-9789-4a24-9ac1-25d2f75cd195 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:09.752073 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433e8ff-fe5e-46df-8714-e7f1c431dd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:09.752776 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433e8ff-fe5e-46df-8714-e7f1c431dd04 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:09.753108 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433e8ff-fe5e-46df-8714-e7f1c431dd04 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:09.753389 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433e8ff-fe5e-46df-8714-e7f1c431dd04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:09.754219 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433e8ff-fe5e-46df-8714-e7f1c431dd04 None admin] RBAC: Adding query filter params (interface=public, service_id=79e27fd202a24d1bb5afa8caecd5d836, region_id=RegionOne) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:09.754556 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433e8ff-fe5e-46df-8714-e7f1c431dd04 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:09.756043 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433e8ff-fe5e-46df-8714-e7f1c431dd04 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:09.761986 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 516/1025] 10.222.0.49 () {56 vars in 1251 bytes} [Fri Oct 28 20:40:09 2022] GET /identity/v3/endpoints?service_id=79e27fd202a24d1bb5afa8caecd5d836&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:40:09.765371 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275bb7e-636c-465a-856b-bdfe9dcb02e5 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:09.768035 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433e8ff-fe5e-46df-8714-e7f1c431dd04 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:09.807597 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450da6c-817e-4dec-a7da-79fc7034c5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:09.808350 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450da6c-817e-4dec-a7da-79fc7034c5b2 None admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:09.808634 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450da6c-817e-4dec-a7da-79fc7034c5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:09.808904 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450da6c-817e-4dec-a7da-79fc7034c5b2 None admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:09.809624 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450da6c-817e-4dec-a7da-79fc7034c5b2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:09.811089 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450da6c-817e-4dec-a7da-79fc7034c5b2 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:09.844526 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 510/1026] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Oct 28 20:40:09 2022] POST /identity/v3/projects => generated 311 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:40:10.017764 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433e8ff-fe5e-46df-8714-e7f1c431dd04 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:10.056482 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e6d17-5b06-4508-b3d6-8d5fc03ddbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:10.057168 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e6d17-5b06-4508-b3d6-8d5fc03ddbc6 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:10.057442 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e6d17-5b06-4508-b3d6-8d5fc03ddbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:10.057714 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e6d17-5b06-4508-b3d6-8d5fc03ddbc6 None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:10.058395 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e6d17-5b06-4508-b3d6-8d5fc03ddbc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:10.059775 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e6d17-5b06-4508-b3d6-8d5fc03ddbc6 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:10.067533 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 517/1027] 10.222.0.49 () {56 vars in 1087 bytes} [Fri Oct 28 20:40:09 2022] GET /identity/v3/services => generated 1957 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:40:12.282078 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cb3d2-8d2f-416c-9733-84df026a8b7a None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:12.282078 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cb3d2-8d2f-416c-9733-84df026a8b7a None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:12.283144 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cb3d2-8d2f-416c-9733-84df026a8b7a None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:12.285134 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 511/1028] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:40:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:40:12.291312 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33424182-3ebb-41af-8f8e-45a2d89f687c None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:12.291922 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33424182-3ebb-41af-8f8e-45a2d89f687c None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:12.291922 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33424182-3ebb-41af-8f8e-45a2d89f687c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:12.309355 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-33424182-3ebb-41af-8f8e-45a2d89f687c None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:40:12.310565 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-33424182-3ebb-41af-8f8e-45a2d89f687c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:40:12.398808 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 518/1029] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:40:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 20:40:12.425792 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085cb3d2-8d2f-416c-9733-84df026a8b7a None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:12.497607 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07d2a7-cb4d-4800-a6cb-bc12ae6e8642 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:12.497906 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07d2a7-cb4d-4800-a6cb-bc12ae6e8642 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:12.498088 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07d2a7-cb4d-4800-a6cb-bc12ae6e8642 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:12.500070 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 519/1030] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:40:12.506103 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc939238-7513-4856-9313-5c46f9cb4130 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:12.506374 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc939238-7513-4856-9313-5c46f9cb4130 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:12.506724 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc939238-7513-4856-9313-5c46f9cb4130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:12.530029 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-dc939238-7513-4856-9313-5c46f9cb4130 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:40:12.532027 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-dc939238-7513-4856-9313-5c46f9cb4130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:40:12.550891 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085cb3d2-8d2f-416c-9733-84df026a8b7a None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:12.588005 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032874fe-73ad-40d4-99df-0c31d7adc5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:12.588882 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032874fe-73ad-40d4-99df-0c31d7adc5f0 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:12.589181 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032874fe-73ad-40d4-99df-0c31d7adc5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:12.589434 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032874fe-73ad-40d4-99df-0c31d7adc5f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:12.590666 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032874fe-73ad-40d4-99df-0c31d7adc5f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:12.592188 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032874fe-73ad-40d4-99df-0c31d7adc5f0 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:12.594101 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 512/1031] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:40:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:40:12.600392 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032874fe-73ad-40d4-99df-0c31d7adc5f0 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:12.623846 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 520/1032] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:40:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:40:12.666393 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc939238-7513-4856-9313-5c46f9cb4130 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:12.756468 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032874fe-73ad-40d4-99df-0c31d7adc5f0 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:12.792552 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e17d44-8ecf-4559-9094-2ad7eb7e17f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:12.793215 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e17d44-8ecf-4559-9094-2ad7eb7e17f5 None admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:12.793489 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e17d44-8ecf-4559-9094-2ad7eb7e17f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:12.793759 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e17d44-8ecf-4559-9094-2ad7eb7e17f5 None admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:12.794501 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e17d44-8ecf-4559-9094-2ad7eb7e17f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:12.795961 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e17d44-8ecf-4559-9094-2ad7eb7e17f5 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:12.806476 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc939238-7513-4856-9313-5c46f9cb4130 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:12.818425 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 513/1033] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Oct 28 20:40:12 2022] POST /identity/v3/users => generated 285 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:40:12.818425 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472c6ea-3255-46ce-a4fa-a8aaf76899ca None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:12.818425 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472c6ea-3255-46ce-a4fa-a8aaf76899ca None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:12.818425 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472c6ea-3255-46ce-a4fa-a8aaf76899ca None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:12.818425 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 514/1034] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:40:12.828661 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d032900-5b3c-4a84-b1e7-12856828497a None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:12.829022 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d032900-5b3c-4a84-b1e7-12856828497a None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:12.829469 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d032900-5b3c-4a84-b1e7-12856828497a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:12.865233 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-3d032900-5b3c-4a84-b1e7-12856828497a None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:40:12.867065 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-3d032900-5b3c-4a84-b1e7-12856828497a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:40:12.875060 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb3a5b-d71c-4b8b-91aa-47c00e5478d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:12.876484 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb3a5b-d71c-4b8b-91aa-47c00e5478d0 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:12.876956 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb3a5b-d71c-4b8b-91aa-47c00e5478d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:12.877401 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb3a5b-d71c-4b8b-91aa-47c00e5478d0 None admin] PATH_INFO: `/v3/services/image` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:12.878787 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb3a5b-d71c-4b8b-91aa-47c00e5478d0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:12.882044 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb3a5b-d71c-4b8b-91aa-47c00e5478d0 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:12.900417 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-c1fb3a5b-d71c-4b8b-91aa-47c00e5478d0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 20:40:12.902598 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 521/1035] 10.222.0.49 () {56 vars in 1105 bytes} [Fri Oct 28 20:40:12 2022] GET /identity/v3/services/image => generated 86 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:40:12.913042 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb3a5b-d71c-4b8b-91aa-47c00e5478d0 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:12.999974 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 515/1036] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:40:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 20:40:13.032663 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d032900-5b3c-4a84-b1e7-12856828497a None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:13.051264 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb3a5b-d71c-4b8b-91aa-47c00e5478d0 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:13.108865 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a6713-f8c9-45da-bd1b-7ac2c5d54cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:13.110033 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a6713-f8c9-45da-bd1b-7ac2c5d54cbd None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:13.111086 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a6713-f8c9-45da-bd1b-7ac2c5d54cbd None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:13.111572 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a6713-f8c9-45da-bd1b-7ac2c5d54cbd None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:13.112961 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a6713-f8c9-45da-bd1b-7ac2c5d54cbd None admin] RBAC: Adding query filter params (name=image) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:13.113486 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a6713-f8c9-45da-bd1b-7ac2c5d54cbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:13.116064 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a6713-f8c9-45da-bd1b-7ac2c5d54cbd None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:13.124876 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 522/1037] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:40:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:13.134354 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a6713-f8c9-45da-bd1b-7ac2c5d54cbd None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:13.167614 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d032900-5b3c-4a84-b1e7-12856828497a None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:13.212582 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e686f55-84fc-4eef-bbea-6de3a511fef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:13.213809 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e686f55-84fc-4eef-bbea-6de3a511fef7 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:13.214094 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e686f55-84fc-4eef-bbea-6de3a511fef7 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:13.214363 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e686f55-84fc-4eef-bbea-6de3a511fef7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:13.234333 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e686f55-84fc-4eef-bbea-6de3a511fef7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:40:13.238768 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-6e686f55-84fc-4eef-bbea-6de3a511fef7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 20:40:13.244857 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 516/1038] 10.222.0.49 () {56 vars in 1120 bytes} [Fri Oct 28 20:40:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:40:13.245970 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e686f55-84fc-4eef-bbea-6de3a511fef7 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:13.275729 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a6713-f8c9-45da-bd1b-7ac2c5d54cbd None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:13.327068 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27666581-e629-4ea3-9d87-0d476286b0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:13.328097 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27666581-e629-4ea3-9d87-0d476286b0b3 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:13.328097 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27666581-e629-4ea3-9d87-0d476286b0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:13.328379 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27666581-e629-4ea3-9d87-0d476286b0b3 None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:13.329480 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27666581-e629-4ea3-9d87-0d476286b0b3 None admin] RBAC: Adding query filter params (type=image) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:13.330291 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27666581-e629-4ea3-9d87-0d476286b0b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:13.331699 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27666581-e629-4ea3-9d87-0d476286b0b3 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:13.338455 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 523/1039] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:40:13 2022] GET /identity/v3/services?type=image => generated 350 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:13.345777 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27666581-e629-4ea3-9d87-0d476286b0b3 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:13.374982 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e686f55-84fc-4eef-bbea-6de3a511fef7 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:13.411443 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781eff0-524b-460d-8c25-646b19d25fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:13.412136 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781eff0-524b-460d-8c25-646b19d25fda None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:13.412462 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781eff0-524b-460d-8c25-646b19d25fda None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:13.412728 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781eff0-524b-460d-8c25-646b19d25fda None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:13.413430 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781eff0-524b-460d-8c25-646b19d25fda None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:13.413733 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781eff0-524b-460d-8c25-646b19d25fda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:13.415119 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781eff0-524b-460d-8c25-646b19d25fda None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:13.425218 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 517/1040] 10.222.0.49 () {56 vars in 1115 bytes} [Fri Oct 28 20:40:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:13.433345 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781eff0-524b-460d-8c25-646b19d25fda None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:13.484497 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27666581-e629-4ea3-9d87-0d476286b0b3 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:13.528878 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac37783-6414-433d-a09a-eff2021dd548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:13.529547 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac37783-6414-433d-a09a-eff2021dd548 None admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:13.529827 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac37783-6414-433d-a09a-eff2021dd548 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:13.530091 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac37783-6414-433d-a09a-eff2021dd548 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:13.530869 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac37783-6414-433d-a09a-eff2021dd548 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:13.533027 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac37783-6414-433d-a09a-eff2021dd548 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:13.567779 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 524/1041] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:40:13 2022] POST /identity/v3/endpoints => generated 327 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:40:13.584970 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781eff0-524b-460d-8c25-646b19d25fda None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:13.645807 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e202c3-664e-4220-8164-ab0c57e449df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:13.646805 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e202c3-664e-4220-8164-ab0c57e449df None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:13.647169 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e202c3-664e-4220-8164-ab0c57e449df None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:13.647446 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e202c3-664e-4220-8164-ab0c57e449df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:13.663416 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e202c3-664e-4220-8164-ab0c57e449df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:13.665219 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e202c3-664e-4220-8164-ab0c57e449df None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:13.689154 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-c4e202c3-664e-4220-8164-ab0c57e449df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:40:13.690802 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 518/1042] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:40:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:40:13.698823 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac37783-6414-433d-a09a-eff2021dd548 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:13.868705 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac37783-6414-433d-a09a-eff2021dd548 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:13.911410 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f404a7-42d4-4295-8cd4-acc5ec9b144c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:13.912110 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f404a7-42d4-4295-8cd4-acc5ec9b144c None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:13.912563 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f404a7-42d4-4295-8cd4-acc5ec9b144c None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:13.912850 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f404a7-42d4-4295-8cd4-acc5ec9b144c None admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:13.913718 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f404a7-42d4-4295-8cd4-acc5ec9b144c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:13.914030 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f404a7-42d4-4295-8cd4-acc5ec9b144c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:13.915461 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f404a7-42d4-4295-8cd4-acc5ec9b144c None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:13.930295 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 525/1043] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:40:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:40:13.936716 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e202c3-664e-4220-8164-ab0c57e449df None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:14.092678 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e202c3-664e-4220-8164-ab0c57e449df None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:14.142478 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7c862-eedf-4d6e-b03e-50a13637abca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:14.143207 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7c862-eedf-4d6e-b03e-50a13637abca None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:14.143481 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7c862-eedf-4d6e-b03e-50a13637abca None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:14.143768 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7c862-eedf-4d6e-b03e-50a13637abca None admin] PATH_INFO: `/v3/users/nova` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:14.153226 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7c862-eedf-4d6e-b03e-50a13637abca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:14.154897 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7c862-eedf-4d6e-b03e-50a13637abca None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:14.170454 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-c1d7c862-eedf-4d6e-b03e-50a13637abca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 20:40:14.171986 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 519/1044] 10.222.0.49 () {56 vars in 1093 bytes} [Fri Oct 28 20:40:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:40:14.178403 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f404a7-42d4-4295-8cd4-acc5ec9b144c None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:14.278348 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f404a7-42d4-4295-8cd4-acc5ec9b144c None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:14.312486 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5bebe-844b-471c-a961-5d936ea114dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:14.313147 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5bebe-844b-471c-a961-5d936ea114dd None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:14.314052 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5bebe-844b-471c-a961-5d936ea114dd None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:14.314293 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5bebe-844b-471c-a961-5d936ea114dd None admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:14.315132 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5bebe-844b-471c-a961-5d936ea114dd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:14.315430 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5bebe-844b-471c-a961-5d936ea114dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:14.316901 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5bebe-844b-471c-a961-5d936ea114dd None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:14.335053 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 526/1045] 10.222.0.49 () {56 vars in 1133 bytes} [Fri Oct 28 20:40:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:14.340854 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7c862-eedf-4d6e-b03e-50a13637abca None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:14.442291 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7c862-eedf-4d6e-b03e-50a13637abca None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:14.489089 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b568dfd-dc7d-4060-9a79-011792abab0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:14.489799 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b568dfd-dc7d-4060-9a79-011792abab0d None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:14.490079 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b568dfd-dc7d-4060-9a79-011792abab0d None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:14.490349 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b568dfd-dc7d-4060-9a79-011792abab0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:14.583822 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b568dfd-dc7d-4060-9a79-011792abab0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:14.586501 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b568dfd-dc7d-4060-9a79-011792abab0d None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:14.774670 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 520/1046] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:40:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 28 20:40:14.784748 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5bebe-844b-471c-a961-5d936ea114dd None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:14.948185 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5bebe-844b-471c-a961-5d936ea114dd None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:15.008066 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfa9a1-f543-4368-8620-47023098ecb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:15.009369 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfa9a1-f543-4368-8620-47023098ecb3 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:15.009849 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfa9a1-f543-4368-8620-47023098ecb3 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:15.010323 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfa9a1-f543-4368-8620-47023098ecb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:15.028806 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdfa9a1-f543-4368-8620-47023098ecb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:15.031409 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdfa9a1-f543-4368-8620-47023098ecb3 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:15.063318 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-dcdfa9a1-f543-4368-8620-47023098ecb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:40:15.070178 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 527/1047] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:40:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:40:15.072283 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b568dfd-dc7d-4060-9a79-011792abab0d None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:15.241747 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b568dfd-dc7d-4060-9a79-011792abab0d None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:15.299836 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171b312-3d12-4f3c-8c25-c68364e2d3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:15.300815 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171b312-3d12-4f3c-8c25-c68364e2d3b7 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:15.301291 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171b312-3d12-4f3c-8c25-c68364e2d3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:15.301766 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171b312-3d12-4f3c-8c25-c68364e2d3b7 None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:15.303068 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171b312-3d12-4f3c-8c25-c68364e2d3b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:15.303584 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171b312-3d12-4f3c-8c25-c68364e2d3b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:15.306153 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171b312-3d12-4f3c-8c25-c68364e2d3b7 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:15.331681 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 521/1048] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:15.333082 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfa9a1-f543-4368-8620-47023098ecb3 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:15.440478 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfa9a1-f543-4368-8620-47023098ecb3 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:15.474404 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459914e-6d76-4880-becf-7bd5bdbc39a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:15.475200 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459914e-6d76-4880-becf-7bd5bdbc39a0 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:15.475474 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459914e-6d76-4880-becf-7bd5bdbc39a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:15.475753 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459914e-6d76-4880-becf-7bd5bdbc39a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:15.482607 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459914e-6d76-4880-becf-7bd5bdbc39a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:15.484209 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459914e-6d76-4880-becf-7bd5bdbc39a0 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:15.498764 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-1459914e-6d76-4880-becf-7bd5bdbc39a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 20:40:15.504208 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 528/1049] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:40:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:40:15.506769 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171b312-3d12-4f3c-8c25-c68364e2d3b7 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:15.615422 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171b312-3d12-4f3c-8c25-c68364e2d3b7 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:15.651300 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb7907-d112-4832-85f0-776f065c7583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:15.652004 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb7907-d112-4832-85f0-776f065c7583 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:15.652277 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb7907-d112-4832-85f0-776f065c7583 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:15.652543 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb7907-d112-4832-85f0-776f065c7583 None admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:15.653332 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb7907-d112-4832-85f0-776f065c7583 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:15.653630 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb7907-d112-4832-85f0-776f065c7583 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:15.655072 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb7907-d112-4832-85f0-776f065c7583 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:15.675307 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 522/1050] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 20:40:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:15.677927 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459914e-6d76-4880-becf-7bd5bdbc39a0 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:15.704656 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c40e6-e128-4f5c-9394-8423c53baea3 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:15.705149 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c40e6-e128-4f5c-9394-8423c53baea3 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:15.705498 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c40e6-e128-4f5c-9394-8423c53baea3 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:15.707337 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 523/1051] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:40:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:40:15.715236 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c9e17-f9c1-42d8-8c5c-44116e80d787 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:15.715597 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c9e17-f9c1-42d8-8c5c-44116e80d787 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:15.715880 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c9e17-f9c1-42d8-8c5c-44116e80d787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:15.818980 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459914e-6d76-4880-becf-7bd5bdbc39a0 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:15.864116 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22792316-56c4-4f90-a03b-154a73406dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:15.864785 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22792316-56c4-4f90-a03b-154a73406dc6 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:15.865058 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22792316-56c4-4f90-a03b-154a73406dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:15.865319 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22792316-56c4-4f90-a03b-154a73406dc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:15.866233 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22792316-56c4-4f90-a03b-154a73406dc6 None admin] RBAC: Adding query filter params (role.id=f5ccdb0329bf4a79a4fa1396ad06ab3d, scope.project.id=c55c2ee59af14cf8a7e4275de4f43037, user.id=04bc6ee009e34a5f82e2807db51523d3) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:15.866497 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22792316-56c4-4f90-a03b-154a73406dc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:15.867954 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22792316-56c4-4f90-a03b-154a73406dc6 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:15.874250 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 529/1052] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:40:15 2022] GET /identity/v3/role_assignments?user.id=04bc6ee009e34a5f82e2807db51523d3&scope.project.id=c55c2ee59af14cf8a7e4275de4f43037&role.id=f5ccdb0329bf4a79a4fa1396ad06ab3d => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:40:15.885870 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-c88c9e17-f9c1-42d8-8c5c-44116e80d787 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:40:15.888140 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-c88c9e17-f9c1-42d8-8c5c-44116e80d787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:40:15.990945 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 524/1053] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:40:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:40:16.034064 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22792316-56c4-4f90-a03b-154a73406dc6 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:16.153423 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22792316-56c4-4f90-a03b-154a73406dc6 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:16.191830 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559099e-0903-44e3-81e3-2ccc1626e9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:16.192645 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559099e-0903-44e3-81e3-2ccc1626e9c0 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:16.192926 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559099e-0903-44e3-81e3-2ccc1626e9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:16.193195 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559099e-0903-44e3-81e3-2ccc1626e9c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:16.204230 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f559099e-0903-44e3-81e3-2ccc1626e9c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:40:16.211119 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-f559099e-0903-44e3-81e3-2ccc1626e9c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 20:40:16.212535 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 530/1054] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 20:40:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:40:16.218398 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c9e17-f9c1-42d8-8c5c-44116e80d787 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:16.341998 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f1c0b-a5c3-4666-b095-2a0bc9e5bfdd None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:16.342294 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f1c0b-a5c3-4666-b095-2a0bc9e5bfdd None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:16.342568 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f1c0b-a5c3-4666-b095-2a0bc9e5bfdd None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:16.344399 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 531/1055] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:40:16.350734 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43515b16-6bd2-4daf-8008-a025bc74395e None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:16.351085 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43515b16-6bd2-4daf-8008-a025bc74395e None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:16.351324 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43515b16-6bd2-4daf-8008-a025bc74395e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:16.369115 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-43515b16-6bd2-4daf-8008-a025bc74395e None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:40:16.369554 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c9e17-f9c1-42d8-8c5c-44116e80d787 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:16.370304 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-43515b16-6bd2-4daf-8008-a025bc74395e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:40:16.420957 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14a0f7-ef8c-4676-936a-8b68960a7f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:16.421543 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14a0f7-ef8c-4676-936a-8b68960a7f89 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:16.421819 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14a0f7-ef8c-4676-936a-8b68960a7f89 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:16.422088 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14a0f7-ef8c-4676-936a-8b68960a7f89 None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:16.423366 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14a0f7-ef8c-4676-936a-8b68960a7f89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:16.423366 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14a0f7-ef8c-4676-936a-8b68960a7f89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:16.425080 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14a0f7-ef8c-4676-936a-8b68960a7f89 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:16.434561 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 525/1056] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:40:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:16.440644 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14a0f7-ef8c-4676-936a-8b68960a7f89 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:16.471814 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 532/1057] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:40:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 20:40:16.502826 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43515b16-6bd2-4daf-8008-a025bc74395e None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:16.554379 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14a0f7-ef8c-4676-936a-8b68960a7f89 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:16.599852 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97593e7-cbbd-4fbc-b48f-2f1207786984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:16.600746 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97593e7-cbbd-4fbc-b48f-2f1207786984 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:16.601023 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97593e7-cbbd-4fbc-b48f-2f1207786984 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:16.601300 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97593e7-cbbd-4fbc-b48f-2f1207786984 None admin] PATH_INFO: `/v3/users/253e8204b5cc43c49ec63bb6e9aa49eb` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:16.617866 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97593e7-cbbd-4fbc-b48f-2f1207786984 None admin] RBAC: Authorizing `identity:get_user(user_id=253e8204b5cc43c49ec63bb6e9aa49eb)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:16.619355 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97593e7-cbbd-4fbc-b48f-2f1207786984 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:16.621249 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 526/1058] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:40:16 2022] GET /identity/v3/users/253e8204b5cc43c49ec63bb6e9aa49eb => generated 285 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:40:16.627703 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97593e7-cbbd-4fbc-b48f-2f1207786984 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:16.678290 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43515b16-6bd2-4daf-8008-a025bc74395e None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:16.724861 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c652768-fc98-4fa5-93d9-4f475ca449bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:16.725928 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c652768-fc98-4fa5-93d9-4f475ca449bd None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:16.726387 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c652768-fc98-4fa5-93d9-4f475ca449bd None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:16.726827 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c652768-fc98-4fa5-93d9-4f475ca449bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:16.751534 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97593e7-cbbd-4fbc-b48f-2f1207786984 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:16.808156 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943552c-d826-4a2a-ae4b-6cda12cc90e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:16.808826 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943552c-d826-4a2a-ae4b-6cda12cc90e3 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:16.809095 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943552c-d826-4a2a-ae4b-6cda12cc90e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:16.809367 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943552c-d826-4a2a-ae4b-6cda12cc90e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:16.826859 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c652768-fc98-4fa5-93d9-4f475ca449bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:16.830072 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c652768-fc98-4fa5-93d9-4f475ca449bd None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:16.919552 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943552c-d826-4a2a-ae4b-6cda12cc90e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:16.921949 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943552c-d826-4a2a-ae4b-6cda12cc90e3 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:16.975802 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 533/1059] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:40:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 20:40:16.981726 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c652768-fc98-4fa5-93d9-4f475ca449bd None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:17.039785 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 527/1060] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:40:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 28 20:40:17.043475 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943552c-d826-4a2a-ae4b-6cda12cc90e3 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:17.107902 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c652768-fc98-4fa5-93d9-4f475ca449bd None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:17.147234 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926fffcb-83d2-4e0e-9718-f68cc01b6ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:17.148099 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926fffcb-83d2-4e0e-9718-f68cc01b6ca9 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:17.148404 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926fffcb-83d2-4e0e-9718-f68cc01b6ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:17.148680 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926fffcb-83d2-4e0e-9718-f68cc01b6ca9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:17.164102 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926fffcb-83d2-4e0e-9718-f68cc01b6ca9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:17.164913 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943552c-d826-4a2a-ae4b-6cda12cc90e3 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:17.165561 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926fffcb-83d2-4e0e-9718-f68cc01b6ca9 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:17.184370 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-926fffcb-83d2-4e0e-9718-f68cc01b6ca9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:40:17.187310 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 534/1061] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:40:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:40:17.197179 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926fffcb-83d2-4e0e-9718-f68cc01b6ca9 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:17.212310 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6de426-c1e2-4cc5-9468-d33ae11453fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:17.213173 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6de426-c1e2-4cc5-9468-d33ae11453fb None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:17.213441 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6de426-c1e2-4cc5-9468-d33ae11453fb None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:17.213704 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6de426-c1e2-4cc5-9468-d33ae11453fb None admin] PATH_INFO: `/v3/projects/6f165bba556242ee9c6b8c010680c663` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:17.215033 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6de426-c1e2-4cc5-9468-d33ae11453fb None admin] RBAC: Authorizing `identity:get_project(project_id=6f165bba556242ee9c6b8c010680c663)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:17.216498 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6de426-c1e2-4cc5-9468-d33ae11453fb None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:17.224682 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 528/1062] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:40:17 2022] GET /identity/v3/projects/6f165bba556242ee9c6b8c010680c663 => generated 311 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:40:17.225342 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6de426-c1e2-4cc5-9468-d33ae11453fb None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:17.323549 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926fffcb-83d2-4e0e-9718-f68cc01b6ca9 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:17.347004 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6de426-c1e2-4cc5-9468-d33ae11453fb None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:17.363290 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b57ad-2422-4c7d-8686-d6603a2cf572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:17.363849 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b57ad-2422-4c7d-8686-d6603a2cf572 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:17.364395 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b57ad-2422-4c7d-8686-d6603a2cf572 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:17.364395 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b57ad-2422-4c7d-8686-d6603a2cf572 None admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:17.365107 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b57ad-2422-4c7d-8686-d6603a2cf572 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:17.365419 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b57ad-2422-4c7d-8686-d6603a2cf572 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:17.366783 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b57ad-2422-4c7d-8686-d6603a2cf572 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:17.381573 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 535/1063] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:17.384975 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8bd00-254c-42a8-aab2-bd45b3161f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:17.386138 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8bd00-254c-42a8-aab2-bd45b3161f4b None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:17.386501 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8bd00-254c-42a8-aab2-bd45b3161f4b None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:17.387115 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8bd00-254c-42a8-aab2-bd45b3161f4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:17.388017 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b8bd00-254c-42a8-aab2-bd45b3161f4b None admin] RBAC: Adding query filter params (role.id=8fe105eeb7bf4856a94b0633bd781414, scope.project.id=6f165bba556242ee9c6b8c010680c663, user.id=253e8204b5cc43c49ec63bb6e9aa49eb) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:17.388455 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b8bd00-254c-42a8-aab2-bd45b3161f4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:17.390194 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b8bd00-254c-42a8-aab2-bd45b3161f4b None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:17.398231 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 529/1064] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:40:17 2022] GET /identity/v3/role_assignments?user.id=253e8204b5cc43c49ec63bb6e9aa49eb&scope.project.id=6f165bba556242ee9c6b8c010680c663&role.id=8fe105eeb7bf4856a94b0633bd781414 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:40:18.378523 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40859f-cd16-4262-badc-0ea6d62597a6 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:18.379308 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40859f-cd16-4262-badc-0ea6d62597a6 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:18.379486 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40859f-cd16-4262-badc-0ea6d62597a6 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:18.381405 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 536/1065] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:40:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:40:18.386834 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64cbf7-9ce9-40a9-ac68-3886bb7eeb33 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:18.387292 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64cbf7-9ce9-40a9-ac68-3886bb7eeb33 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:18.387381 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64cbf7-9ce9-40a9-ac68-3886bb7eeb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:18.404955 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-ea64cbf7-9ce9-40a9-ac68-3886bb7eeb33 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:40:18.406120 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-ea64cbf7-9ce9-40a9-ac68-3886bb7eeb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:40:18.479993 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 530/1066] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:40:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:40:18.504364 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40859f-cd16-4262-badc-0ea6d62597a6 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:18.613418 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40859f-cd16-4262-badc-0ea6d62597a6 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:18.648127 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b59a6-e453-45a4-ace0-1f1c5a648142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:18.648958 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b59a6-e453-45a4-ace0-1f1c5a648142 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:18.649232 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b59a6-e453-45a4-ace0-1f1c5a648142 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:18.649497 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b59a6-e453-45a4-ace0-1f1c5a648142 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:18.661095 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b59a6-e453-45a4-ace0-1f1c5a648142 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:40:18.668632 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-ac4b59a6-e453-45a4-ace0-1f1c5a648142 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 20:40:18.669874 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 537/1067] 10.222.0.49 () {56 vars in 1120 bytes} [Fri Oct 28 20:40:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:40:18.676889 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64cbf7-9ce9-40a9-ac68-3886bb7eeb33 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:18.775855 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64cbf7-9ce9-40a9-ac68-3886bb7eeb33 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:18.813026 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70ffa0-b436-4b79-b27f-03c39bae5bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:18.813736 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70ffa0-b436-4b79-b27f-03c39bae5bb4 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:18.814000 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70ffa0-b436-4b79-b27f-03c39bae5bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:18.814313 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70ffa0-b436-4b79-b27f-03c39bae5bb4 None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:18.815015 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de70ffa0-b436-4b79-b27f-03c39bae5bb4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:18.815316 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de70ffa0-b436-4b79-b27f-03c39bae5bb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:18.816726 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de70ffa0-b436-4b79-b27f-03c39bae5bb4 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:18.825117 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 531/1068] 10.222.0.49 () {56 vars in 1115 bytes} [Fri Oct 28 20:40:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:18.831271 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b59a6-e453-45a4-ace0-1f1c5a648142 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:18.938594 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b59a6-e453-45a4-ace0-1f1c5a648142 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:18.973242 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d67629-8a82-48b6-b579-c5bde58104c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:18.974028 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d67629-8a82-48b6-b579-c5bde58104c8 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:18.974306 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d67629-8a82-48b6-b579-c5bde58104c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:18.974575 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d67629-8a82-48b6-b579-c5bde58104c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:18.985805 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d67629-8a82-48b6-b579-c5bde58104c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:18.987260 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d67629-8a82-48b6-b579-c5bde58104c8 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:19.003962 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-75d67629-8a82-48b6-b579-c5bde58104c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:40:19.005185 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 538/1069] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:40:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:40:19.011051 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70ffa0-b436-4b79-b27f-03c39bae5bb4 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:19.160762 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70ffa0-b436-4b79-b27f-03c39bae5bb4 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:19.195307 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e457a0d-3539-42ad-a319-fab406621240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:19.196007 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e457a0d-3539-42ad-a319-fab406621240 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:19.196273 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e457a0d-3539-42ad-a319-fab406621240 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:19.196547 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e457a0d-3539-42ad-a319-fab406621240 None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:19.197274 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e457a0d-3539-42ad-a319-fab406621240 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:19.197578 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e457a0d-3539-42ad-a319-fab406621240 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:19.198939 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e457a0d-3539-42ad-a319-fab406621240 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:19.211856 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 532/1070] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:19.217702 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d67629-8a82-48b6-b579-c5bde58104c8 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:19.338599 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d67629-8a82-48b6-b579-c5bde58104c8 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:19.394179 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b62623-ca96-4976-bb7e-5fc235f98bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:19.395508 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b62623-ca96-4976-bb7e-5fc235f98bbf None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:19.396046 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b62623-ca96-4976-bb7e-5fc235f98bbf None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:19.396547 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b62623-ca96-4976-bb7e-5fc235f98bbf None admin] PATH_INFO: `/v3/users/nova` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:19.411371 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b62623-ca96-4976-bb7e-5fc235f98bbf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:19.414056 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b62623-ca96-4976-bb7e-5fc235f98bbf None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:19.435088 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-a3b62623-ca96-4976-bb7e-5fc235f98bbf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 20:40:19.436406 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 539/1071] 10.222.0.49 () {56 vars in 1093 bytes} [Fri Oct 28 20:40:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:40:19.443394 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e457a0d-3539-42ad-a319-fab406621240 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:19.546322 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e457a0d-3539-42ad-a319-fab406621240 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:19.583261 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7648d7a0-8fad-4f55-aaf1-7a21cf1210a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:19.584090 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648d7a0-8fad-4f55-aaf1-7a21cf1210a9 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:19.584362 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648d7a0-8fad-4f55-aaf1-7a21cf1210a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:19.584627 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648d7a0-8fad-4f55-aaf1-7a21cf1210a9 None admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:19.585455 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7648d7a0-8fad-4f55-aaf1-7a21cf1210a9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:19.585756 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7648d7a0-8fad-4f55-aaf1-7a21cf1210a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:19.587196 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7648d7a0-8fad-4f55-aaf1-7a21cf1210a9 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:19.606749 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 533/1072] 10.222.0.49 () {56 vars in 1133 bytes} [Fri Oct 28 20:40:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:19.613798 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b62623-ca96-4976-bb7e-5fc235f98bbf None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:19.734201 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b62623-ca96-4976-bb7e-5fc235f98bbf None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:19.769180 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075c119-2712-436d-901c-e16d53369ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:19.769991 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075c119-2712-436d-901c-e16d53369ee6 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:19.770269 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075c119-2712-436d-901c-e16d53369ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:19.770542 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075c119-2712-436d-901c-e16d53369ee6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:19.783230 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075c119-2712-436d-901c-e16d53369ee6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:19.785241 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075c119-2712-436d-901c-e16d53369ee6 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:19.804646 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-7075c119-2712-436d-901c-e16d53369ee6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:40:19.805718 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9185c-2d3d-4706-8652-0067b47ffa3a None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:19.806004 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9185c-2d3d-4706-8652-0067b47ffa3a None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:19.806177 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 540/1073] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:40:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:40:19.806305 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9185c-2d3d-4706-8652-0067b47ffa3a None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:19.808073 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 534/1074] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:40:19.811665 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075c119-2712-436d-901c-e16d53369ee6 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:19.813478 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d2b83-21da-44dd-8386-696fc42890e2 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:19.813824 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d2b83-21da-44dd-8386-696fc42890e2 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:19.814164 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d2b83-21da-44dd-8386-696fc42890e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:19.832235 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-c42d2b83-21da-44dd-8386-696fc42890e2 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:40:19.833459 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-c42d2b83-21da-44dd-8386-696fc42890e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:40:19.904427 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 535/1075] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:40:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 20:40:19.917975 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075c119-2712-436d-901c-e16d53369ee6 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:19.928642 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d2b83-21da-44dd-8386-696fc42890e2 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:19.952881 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a9dc0-9e82-4bd2-abec-5c7d0e90cfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:19.953547 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a9dc0-9e82-4bd2-abec-5c7d0e90cfcc None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:19.954401 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a9dc0-9e82-4bd2-abec-5c7d0e90cfcc None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:19.954672 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a9dc0-9e82-4bd2-abec-5c7d0e90cfcc None admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:19.955584 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a9dc0-9e82-4bd2-abec-5c7d0e90cfcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:19.955933 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a9dc0-9e82-4bd2-abec-5c7d0e90cfcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:19.957294 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a9dc0-9e82-4bd2-abec-5c7d0e90cfcc None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:19.971734 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 541/1076] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:40:19.977439 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a9dc0-9e82-4bd2-abec-5c7d0e90cfcc None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:20.051293 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d2b83-21da-44dd-8386-696fc42890e2 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:20.102696 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1ff80-b578-490b-a147-7d520b61b09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:20.103955 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1ff80-b578-490b-a147-7d520b61b09e None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:20.104408 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1ff80-b578-490b-a147-7d520b61b09e None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:20.104845 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1ff80-b578-490b-a147-7d520b61b09e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:20.117025 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1ff80-b578-490b-a147-7d520b61b09e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:40:20.118399 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a9dc0-9e82-4bd2-abec-5c7d0e90cfcc None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:20.124133 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-38f1ff80-b578-490b-a147-7d520b61b09e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 20:40:20.125375 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 536/1077] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 20:40:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:40:20.132245 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1ff80-b578-490b-a147-7d520b61b09e None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:20.164369 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ed370-039d-41dc-b2ce-05d1fce4da80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:20.165151 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ed370-039d-41dc-b2ce-05d1fce4da80 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:20.165419 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ed370-039d-41dc-b2ce-05d1fce4da80 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:20.165687 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ed370-039d-41dc-b2ce-05d1fce4da80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:20.172986 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ed370-039d-41dc-b2ce-05d1fce4da80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:20.174697 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ed370-039d-41dc-b2ce-05d1fce4da80 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:20.189401 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-439ed370-039d-41dc-b2ce-05d1fce4da80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 20:40:20.190660 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 542/1078] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:40:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:40:20.196865 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ed370-039d-41dc-b2ce-05d1fce4da80 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:20.243319 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1ff80-b578-490b-a147-7d520b61b09e None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:20.279758 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107709ca-3fd5-42ea-8420-ccb4acc72f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:20.280430 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107709ca-3fd5-42ea-8420-ccb4acc72f10 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:20.280697 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107709ca-3fd5-42ea-8420-ccb4acc72f10 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:20.280958 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107709ca-3fd5-42ea-8420-ccb4acc72f10 None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:20.281705 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107709ca-3fd5-42ea-8420-ccb4acc72f10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:20.282678 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107709ca-3fd5-42ea-8420-ccb4acc72f10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:20.284769 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107709ca-3fd5-42ea-8420-ccb4acc72f10 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:20.293495 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 537/1079] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:40:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:40:20.301570 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107709ca-3fd5-42ea-8420-ccb4acc72f10 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:20.319412 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ed370-039d-41dc-b2ce-05d1fce4da80 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:20.369746 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104d907-130f-4e64-8cd5-caf62115198c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:20.370529 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104d907-130f-4e64-8cd5-caf62115198c None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:20.370909 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104d907-130f-4e64-8cd5-caf62115198c None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:20.371277 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104d907-130f-4e64-8cd5-caf62115198c None admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:20.372253 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104d907-130f-4e64-8cd5-caf62115198c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:20.372693 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104d907-130f-4e64-8cd5-caf62115198c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:20.374290 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104d907-130f-4e64-8cd5-caf62115198c None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:20.388552 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 543/1080] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 20:40:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:40:20.396348 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104d907-130f-4e64-8cd5-caf62115198c None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:20.430298 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107709ca-3fd5-42ea-8420-ccb4acc72f10 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:20.466066 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ba3f1-5c0c-4629-9d71-abba1b2cc370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:20.467339 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ba3f1-5c0c-4629-9d71-abba1b2cc370 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:20.467708 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ba3f1-5c0c-4629-9d71-abba1b2cc370 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:20.468140 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ba3f1-5c0c-4629-9d71-abba1b2cc370 None admin] PATH_INFO: `/v3/users/253e8204b5cc43c49ec63bb6e9aa49eb` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:20.469618 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ba3f1-5c0c-4629-9d71-abba1b2cc370 None admin] RBAC: Authorizing `identity:get_user(user_id=253e8204b5cc43c49ec63bb6e9aa49eb)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:20.471073 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ba3f1-5c0c-4629-9d71-abba1b2cc370 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:20.472769 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 538/1081] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:40:20 2022] GET /identity/v3/users/253e8204b5cc43c49ec63bb6e9aa49eb => generated 285 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:40:20.478797 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ba3f1-5c0c-4629-9d71-abba1b2cc370 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:20.508452 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104d907-130f-4e64-8cd5-caf62115198c None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:20.543947 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38e28d-d75c-4668-af73-e64c6ec13c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:20.544841 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38e28d-d75c-4668-af73-e64c6ec13c1f None admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:20.545122 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38e28d-d75c-4668-af73-e64c6ec13c1f None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:20.545396 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38e28d-d75c-4668-af73-e64c6ec13c1f None admin] PATH_INFO: `/v3/projects/c55c2ee59af14cf8a7e4275de4f43037/users/04bc6ee009e34a5f82e2807db51523d3/roles/f5ccdb0329bf4a79a4fa1396ad06ab3d` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:20.548872 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d38e28d-d75c-4668-af73-e64c6ec13c1f None admin] RBAC: Authorizing `identity:create_grant(project_id=c55c2ee59af14cf8a7e4275de4f43037, user_id=04bc6ee009e34a5f82e2807db51523d3, role_id=f5ccdb0329bf4a79a4fa1396ad06ab3d)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:20.550819 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d38e28d-d75c-4668-af73-e64c6ec13c1f None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:20.568006 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 544/1082] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 20:40:20 2022] PUT /identity/v3/projects/c55c2ee59af14cf8a7e4275de4f43037/users/04bc6ee009e34a5f82e2807db51523d3/roles/f5ccdb0329bf4a79a4fa1396ad06ab3d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:40:20.607342 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ba3f1-5c0c-4629-9d71-abba1b2cc370 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:20.652355 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162a2ce-4131-4690-9dac-c1da3176207b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:20.653235 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162a2ce-4131-4690-9dac-c1da3176207b None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:20.653510 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162a2ce-4131-4690-9dac-c1da3176207b None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:20.653780 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162a2ce-4131-4690-9dac-c1da3176207b None admin] PATH_INFO: `/v3/projects/6f165bba556242ee9c6b8c010680c663` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:20.655101 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7162a2ce-4131-4690-9dac-c1da3176207b None admin] RBAC: Authorizing `identity:get_project(project_id=6f165bba556242ee9c6b8c010680c663)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:20.656600 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7162a2ce-4131-4690-9dac-c1da3176207b None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:20.659576 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 539/1083] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:40:20 2022] GET /identity/v3/projects/6f165bba556242ee9c6b8c010680c663 => generated 311 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:40:20.665806 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38e28d-d75c-4668-af73-e64c6ec13c1f None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:20.803803 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38e28d-d75c-4668-af73-e64c6ec13c1f None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:20.838363 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46119e-ec7e-4185-9d78-3dff71a8577c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:20.839163 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46119e-ec7e-4185-9d78-3dff71a8577c None admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:20.839432 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46119e-ec7e-4185-9d78-3dff71a8577c None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:20.839701 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46119e-ec7e-4185-9d78-3dff71a8577c None admin] PATH_INFO: `/v3/projects/6f165bba556242ee9c6b8c010680c663/users/253e8204b5cc43c49ec63bb6e9aa49eb/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:20.841693 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec46119e-ec7e-4185-9d78-3dff71a8577c None admin] RBAC: Authorizing `identity:create_grant(project_id=6f165bba556242ee9c6b8c010680c663, user_id=253e8204b5cc43c49ec63bb6e9aa49eb, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:20.843144 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec46119e-ec7e-4185-9d78-3dff71a8577c None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:20.860114 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 545/1084] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 20:40:20 2022] PUT /identity/v3/projects/6f165bba556242ee9c6b8c010680c663/users/253e8204b5cc43c49ec63bb6e9aa49eb/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:40:22.945209 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d514009-c48c-47d1-8037-4438061a76d1 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:22.945773 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d514009-c48c-47d1-8037-4438061a76d1 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:22.945773 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d514009-c48c-47d1-8037-4438061a76d1 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:22.947529 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 540/1085] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:40:22.952839 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c985187-6b3f-4b01-9bb3-86b5aa6d0827 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:22.953252 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c985187-6b3f-4b01-9bb3-86b5aa6d0827 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:22.953395 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c985187-6b3f-4b01-9bb3-86b5aa6d0827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:22.971381 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-8c985187-6b3f-4b01-9bb3-86b5aa6d0827 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:40:22.972597 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-8c985187-6b3f-4b01-9bb3-86b5aa6d0827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:40:23.037708 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 546/1086] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:40:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 20:40:23.061983 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d514009-c48c-47d1-8037-4438061a76d1 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:23.164852 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d514009-c48c-47d1-8037-4438061a76d1 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:23.197966 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deafe60a-4900-4239-b1f4-0a19fd4a8565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:23.198689 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafe60a-4900-4239-b1f4-0a19fd4a8565 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:23.198965 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafe60a-4900-4239-b1f4-0a19fd4a8565 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:23.199235 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafe60a-4900-4239-b1f4-0a19fd4a8565 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:23.209810 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deafe60a-4900-4239-b1f4-0a19fd4a8565 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:40:23.217249 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-deafe60a-4900-4239-b1f4-0a19fd4a8565 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 20:40:23.219035 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 541/1087] 10.222.0.49 () {56 vars in 1120 bytes} [Fri Oct 28 20:40:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:40:23.225329 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deafe60a-4900-4239-b1f4-0a19fd4a8565 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:23.225712 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdf069-bc9d-4bb8-af73-3f063aebc4ea None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:23.226001 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdf069-bc9d-4bb8-af73-3f063aebc4ea None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:23.226274 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdf069-bc9d-4bb8-af73-3f063aebc4ea None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:23.228111 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 547/1088] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:40:23.233182 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf58ff7-32e2-4acb-a144-7810fa3c9d37 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:23.233470 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf58ff7-32e2-4acb-a144-7810fa3c9d37 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:23.233745 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf58ff7-32e2-4acb-a144-7810fa3c9d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:23.251419 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-dcf58ff7-32e2-4acb-a144-7810fa3c9d37 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:40:23.252613 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-dcf58ff7-32e2-4acb-a144-7810fa3c9d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:40:23.318661 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 548/1089] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:40:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 20:40:23.327122 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deafe60a-4900-4239-b1f4-0a19fd4a8565 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:23.342614 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf58ff7-32e2-4acb-a144-7810fa3c9d37 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:23.359836 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f34f6-cf76-4944-aa21-316c2f0d7ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:23.360507 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f34f6-cf76-4944-aa21-316c2f0d7ec1 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:23.360782 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f34f6-cf76-4944-aa21-316c2f0d7ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:23.361055 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f34f6-cf76-4944-aa21-316c2f0d7ec1 None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:23.361791 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f34f6-cf76-4944-aa21-316c2f0d7ec1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:23.362099 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f34f6-cf76-4944-aa21-316c2f0d7ec1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:23.363470 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f34f6-cf76-4944-aa21-316c2f0d7ec1 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:23.371304 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 542/1090] 10.222.0.49 () {56 vars in 1115 bytes} [Fri Oct 28 20:40:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:40:23.377378 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f34f6-cf76-4944-aa21-316c2f0d7ec1 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:23.437328 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf58ff7-32e2-4acb-a144-7810fa3c9d37 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:23.472205 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c64ef-0192-4b37-bd62-96b4f3f8cd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:23.472993 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c64ef-0192-4b37-bd62-96b4f3f8cd5e None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:23.473317 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c64ef-0192-4b37-bd62-96b4f3f8cd5e None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:23.473591 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c64ef-0192-4b37-bd62-96b4f3f8cd5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:23.476312 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f34f6-cf76-4944-aa21-316c2f0d7ec1 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:23.483555 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c64ef-0192-4b37-bd62-96b4f3f8cd5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:40:23.490557 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-7a9c64ef-0192-4b37-bd62-96b4f3f8cd5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 20:40:23.491775 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 549/1091] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 20:40:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:40:23.497853 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c64ef-0192-4b37-bd62-96b4f3f8cd5e None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:23.509555 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e98be-c0b1-4666-af3b-8a97b8c28a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:23.510344 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e98be-c0b1-4666-af3b-8a97b8c28a28 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:23.510623 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e98be-c0b1-4666-af3b-8a97b8c28a28 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:23.510892 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e98be-c0b1-4666-af3b-8a97b8c28a28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:23.521927 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e98be-c0b1-4666-af3b-8a97b8c28a28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:23.523377 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e98be-c0b1-4666-af3b-8a97b8c28a28 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:23.539873 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-b06e98be-c0b1-4666-af3b-8a97b8c28a28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:40:23.541072 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 543/1092] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:40:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:40:23.546667 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e98be-c0b1-4666-af3b-8a97b8c28a28 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:23.601038 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c64ef-0192-4b37-bd62-96b4f3f8cd5e None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:23.637639 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad9542-89ad-4785-810d-f23e871243f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:23.638302 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad9542-89ad-4785-810d-f23e871243f5 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:23.638578 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad9542-89ad-4785-810d-f23e871243f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:23.638846 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad9542-89ad-4785-810d-f23e871243f5 None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:23.639586 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad9542-89ad-4785-810d-f23e871243f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:23.639919 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad9542-89ad-4785-810d-f23e871243f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:23.641440 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad9542-89ad-4785-810d-f23e871243f5 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:23.649096 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e98be-c0b1-4666-af3b-8a97b8c28a28 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:23.649658 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 550/1093] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:40:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:40:23.655391 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad9542-89ad-4785-810d-f23e871243f5 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:23.682729 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb222cd-b5b3-4f6f-9709-04ceabe64702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:23.683390 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb222cd-b5b3-4f6f-9709-04ceabe64702 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:23.683667 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb222cd-b5b3-4f6f-9709-04ceabe64702 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:23.683969 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb222cd-b5b3-4f6f-9709-04ceabe64702 None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:23.684686 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb222cd-b5b3-4f6f-9709-04ceabe64702 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:23.684991 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb222cd-b5b3-4f6f-9709-04ceabe64702 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:23.686365 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb222cd-b5b3-4f6f-9709-04ceabe64702 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:23.699111 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 544/1094] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:40:23.704942 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb222cd-b5b3-4f6f-9709-04ceabe64702 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:23.760144 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad9542-89ad-4785-810d-f23e871243f5 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:23.804179 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb7a5c-29be-4f94-a3cc-72652b27c278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:23.805452 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb7a5c-29be-4f94-a3cc-72652b27c278 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:23.805452 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb7a5c-29be-4f94-a3cc-72652b27c278 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:23.805665 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb7a5c-29be-4f94-a3cc-72652b27c278 None admin] PATH_INFO: `/v3/users/253e8204b5cc43c49ec63bb6e9aa49eb` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:23.806709 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb7a5c-29be-4f94-a3cc-72652b27c278 None admin] RBAC: Authorizing `identity:get_user(user_id=253e8204b5cc43c49ec63bb6e9aa49eb)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:23.808180 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb7a5c-29be-4f94-a3cc-72652b27c278 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:23.809789 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 551/1095] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:40:23 2022] GET /identity/v3/users/253e8204b5cc43c49ec63bb6e9aa49eb => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:40:23.816138 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb7a5c-29be-4f94-a3cc-72652b27c278 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:23.816337 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb222cd-b5b3-4f6f-9709-04ceabe64702 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:23.852171 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f20351-8737-4cc7-9ac4-9bb92f281f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:23.852956 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f20351-8737-4cc7-9ac4-9bb92f281f3f None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:23.853230 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f20351-8737-4cc7-9ac4-9bb92f281f3f None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:23.853494 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f20351-8737-4cc7-9ac4-9bb92f281f3f None admin] PATH_INFO: `/v3/users/nova` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:23.861394 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f20351-8737-4cc7-9ac4-9bb92f281f3f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:23.862848 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f20351-8737-4cc7-9ac4-9bb92f281f3f None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:23.877147 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-15f20351-8737-4cc7-9ac4-9bb92f281f3f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 20:40:23.878344 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 545/1096] 10.222.0.49 () {56 vars in 1093 bytes} [Fri Oct 28 20:40:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:40:23.884058 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f20351-8737-4cc7-9ac4-9bb92f281f3f None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:23.917307 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb7a5c-29be-4f94-a3cc-72652b27c278 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:23.952402 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777d4db-4fab-43b6-b2a9-59e9d5c0bb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:23.953044 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777d4db-4fab-43b6-b2a9-59e9d5c0bb39 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:23.953650 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777d4db-4fab-43b6-b2a9-59e9d5c0bb39 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:23.953650 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777d4db-4fab-43b6-b2a9-59e9d5c0bb39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:23.984495 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f20351-8737-4cc7-9ac4-9bb92f281f3f None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:24.020113 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b44da-59f8-4423-96ef-4d7b9fa345e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:24.020573 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b44da-59f8-4423-96ef-4d7b9fa345e3 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:24.020844 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b44da-59f8-4423-96ef-4d7b9fa345e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:24.021107 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b44da-59f8-4423-96ef-4d7b9fa345e3 None admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:24.021283 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777d4db-4fab-43b6-b2a9-59e9d5c0bb39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:24.021932 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b44da-59f8-4423-96ef-4d7b9fa345e3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:24.022234 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b44da-59f8-4423-96ef-4d7b9fa345e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:24.022742 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777d4db-4fab-43b6-b2a9-59e9d5c0bb39 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:24.023636 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b44da-59f8-4423-96ef-4d7b9fa345e3 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:24.043944 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 546/1097] 10.222.0.49 () {56 vars in 1133 bytes} [Fri Oct 28 20:40:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:40:24.050994 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b44da-59f8-4423-96ef-4d7b9fa345e3 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:24.122040 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 552/1098] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:40:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 28 20:40:24.128214 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777d4db-4fab-43b6-b2a9-59e9d5c0bb39 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:24.149161 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b44da-59f8-4423-96ef-4d7b9fa345e3 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:24.184848 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf20c5-c9fb-4242-a4b7-5ffc16b8b1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:24.185488 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf20c5-c9fb-4242-a4b7-5ffc16b8b1ad None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:24.185760 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf20c5-c9fb-4242-a4b7-5ffc16b8b1ad None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:24.186022 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf20c5-c9fb-4242-a4b7-5ffc16b8b1ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:24.224316 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777d4db-4fab-43b6-b2a9-59e9d5c0bb39 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:24.252839 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf20c5-c9fb-4242-a4b7-5ffc16b8b1ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:24.254294 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf20c5-c9fb-4242-a4b7-5ffc16b8b1ad None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:24.258007 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a05015-b794-47ad-b401-ff2b26d1180f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:24.258878 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a05015-b794-47ad-b401-ff2b26d1180f None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:24.259124 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a05015-b794-47ad-b401-ff2b26d1180f None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:24.259388 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a05015-b794-47ad-b401-ff2b26d1180f None admin] PATH_INFO: `/v3/projects/6f165bba556242ee9c6b8c010680c663` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:24.260734 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a05015-b794-47ad-b401-ff2b26d1180f None admin] RBAC: Authorizing `identity:get_project(project_id=6f165bba556242ee9c6b8c010680c663)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:24.262152 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a05015-b794-47ad-b401-ff2b26d1180f None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:24.264164 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 553/1099] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:40:24 2022] GET /identity/v3/projects/6f165bba556242ee9c6b8c010680c663 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:40:24.270185 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a05015-b794-47ad-b401-ff2b26d1180f None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:24.352836 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 547/1100] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:40:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 28 20:40:24.358563 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf20c5-c9fb-4242-a4b7-5ffc16b8b1ad None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:24.370097 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a05015-b794-47ad-b401-ff2b26d1180f None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:24.402941 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cdbe76-8e00-40d9-93e3-4c92870a34de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:24.403583 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cdbe76-8e00-40d9-93e3-4c92870a34de None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:24.403892 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cdbe76-8e00-40d9-93e3-4c92870a34de None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:24.404160 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cdbe76-8e00-40d9-93e3-4c92870a34de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:24.404975 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cdbe76-8e00-40d9-93e3-4c92870a34de None admin] RBAC: Adding query filter params (role.id=8fe105eeb7bf4856a94b0633bd781414, scope.project.id=6f165bba556242ee9c6b8c010680c663, user.id=253e8204b5cc43c49ec63bb6e9aa49eb) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:24.405278 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cdbe76-8e00-40d9-93e3-4c92870a34de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:24.407354 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cdbe76-8e00-40d9-93e3-4c92870a34de None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:24.413453 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 554/1101] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:40:24 2022] GET /identity/v3/role_assignments?user.id=253e8204b5cc43c49ec63bb6e9aa49eb&scope.project.id=6f165bba556242ee9c6b8c010680c663&role.id=8fe105eeb7bf4856a94b0633bd781414 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:40:24.460101 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf20c5-c9fb-4242-a4b7-5ffc16b8b1ad None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:24.496707 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87493274-e68c-4d29-8efb-3dfb193c13e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:24.497519 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87493274-e68c-4d29-8efb-3dfb193c13e4 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:24.497793 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87493274-e68c-4d29-8efb-3dfb193c13e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:24.498056 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87493274-e68c-4d29-8efb-3dfb193c13e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:24.509487 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87493274-e68c-4d29-8efb-3dfb193c13e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:24.510960 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87493274-e68c-4d29-8efb-3dfb193c13e4 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:24.530713 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-87493274-e68c-4d29-8efb-3dfb193c13e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:40:24.531621 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 548/1102] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:40:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:40:24.538871 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cdbe76-8e00-40d9-93e3-4c92870a34de None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:24.652376 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cdbe76-8e00-40d9-93e3-4c92870a34de None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:24.687703 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58512abd-70c0-4e19-882f-cef1a12a71ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:24.688468 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58512abd-70c0-4e19-882f-cef1a12a71ce None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:24.688740 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58512abd-70c0-4e19-882f-cef1a12a71ce None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:24.689010 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58512abd-70c0-4e19-882f-cef1a12a71ce None admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:24.689756 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58512abd-70c0-4e19-882f-cef1a12a71ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:24.690063 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58512abd-70c0-4e19-882f-cef1a12a71ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:24.691486 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58512abd-70c0-4e19-882f-cef1a12a71ce None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:24.704601 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 555/1103] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:24.710546 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87493274-e68c-4d29-8efb-3dfb193c13e4 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:24.816920 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87493274-e68c-4d29-8efb-3dfb193c13e4 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:24.855514 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8c5a8-539b-427d-b4ff-cab5a3976a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:24.856332 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8c5a8-539b-427d-b4ff-cab5a3976a0b None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:24.856608 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8c5a8-539b-427d-b4ff-cab5a3976a0b None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:24.856881 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8c5a8-539b-427d-b4ff-cab5a3976a0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:24.865058 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d8c5a8-539b-427d-b4ff-cab5a3976a0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:24.866514 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d8c5a8-539b-427d-b4ff-cab5a3976a0b None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:24.882458 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-a3d8c5a8-539b-427d-b4ff-cab5a3976a0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 20:40:24.883664 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 549/1104] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:40:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:40:24.890696 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58512abd-70c0-4e19-882f-cef1a12a71ce None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:24.990828 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58512abd-70c0-4e19-882f-cef1a12a71ce None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:25.024302 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e019a-08ca-48db-9cff-f3292a566b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:25.024955 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e019a-08ca-48db-9cff-f3292a566b14 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:25.025234 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e019a-08ca-48db-9cff-f3292a566b14 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:25.025505 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e019a-08ca-48db-9cff-f3292a566b14 None admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:25.026282 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e019a-08ca-48db-9cff-f3292a566b14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:25.026588 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e019a-08ca-48db-9cff-f3292a566b14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:25.028037 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e019a-08ca-48db-9cff-f3292a566b14 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:25.039988 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 556/1105] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 20:40:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:25.045990 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8c5a8-539b-427d-b4ff-cab5a3976a0b None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:25.142391 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8c5a8-539b-427d-b4ff-cab5a3976a0b None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:25.174680 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc96e75-8719-4993-b4c0-a195bd14b19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:25.175337 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc96e75-8719-4993-b4c0-a195bd14b19e None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:25.175599 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc96e75-8719-4993-b4c0-a195bd14b19e None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:25.176023 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc96e75-8719-4993-b4c0-a195bd14b19e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:25.176846 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc96e75-8719-4993-b4c0-a195bd14b19e None admin] RBAC: Adding query filter params (role.id=f5ccdb0329bf4a79a4fa1396ad06ab3d, scope.project.id=c55c2ee59af14cf8a7e4275de4f43037, user.id=04bc6ee009e34a5f82e2807db51523d3) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:25.177152 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc96e75-8719-4993-b4c0-a195bd14b19e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:25.178576 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc96e75-8719-4993-b4c0-a195bd14b19e None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:25.184334 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 550/1106] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:40:25 2022] GET /identity/v3/role_assignments?user.id=04bc6ee009e34a5f82e2807db51523d3&scope.project.id=c55c2ee59af14cf8a7e4275de4f43037&role.id=f5ccdb0329bf4a79a4fa1396ad06ab3d => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:26.812015 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425e932-77b1-4d1b-b508-ceb6456bab1b None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:26.812568 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425e932-77b1-4d1b-b508-ceb6456bab1b None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:26.812568 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425e932-77b1-4d1b-b508-ceb6456bab1b None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:26.814998 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 557/1107] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:40:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:40:26.820254 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc40de2-d2e4-4cc1-a639-cccc3c2a3cfb None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:26.820764 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc40de2-d2e4-4cc1-a639-cccc3c2a3cfb None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:26.820764 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc40de2-d2e4-4cc1-a639-cccc3c2a3cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:26.837883 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-adc40de2-d2e4-4cc1-a639-cccc3c2a3cfb None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:40:26.839054 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-adc40de2-d2e4-4cc1-a639-cccc3c2a3cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:40:26.904556 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 551/1108] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:40:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 20:40:26.929743 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425e932-77b1-4d1b-b508-ceb6456bab1b None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:27.028685 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425e932-77b1-4d1b-b508-ceb6456bab1b None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:27.061386 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af08823-2193-49b9-9749-0a2ee0bcd60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:27.062216 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af08823-2193-49b9-9749-0a2ee0bcd60d None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:27.062439 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af08823-2193-49b9-9749-0a2ee0bcd60d None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:27.062706 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af08823-2193-49b9-9749-0a2ee0bcd60d None admin] PATH_INFO: `/v3/domains/default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:27.064400 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af08823-2193-49b9-9749-0a2ee0bcd60d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:27.065821 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af08823-2193-49b9-9749-0a2ee0bcd60d None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:27.067416 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 558/1109] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:40:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:27.073309 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc40de2-d2e4-4cc1-a639-cccc3c2a3cfb None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:27.168228 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc40de2-d2e4-4cc1-a639-cccc3c2a3cfb None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:27.200678 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc449ec-5d96-4656-9f20-0cef0b787a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:27.201332 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc449ec-5d96-4656-9f20-0cef0b787a7c None admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:27.201602 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc449ec-5d96-4656-9f20-0cef0b787a7c None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:27.201866 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc449ec-5d96-4656-9f20-0cef0b787a7c None admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:27.202571 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc449ec-5d96-4656-9f20-0cef0b787a7c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:27.204864 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc449ec-5d96-4656-9f20-0cef0b787a7c None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:27.231689 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 552/1110] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Oct 28 20:40:27 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:40:29.638976 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f119ab-6550-48bf-897e-8efb840a1385 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:29.639489 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f119ab-6550-48bf-897e-8efb840a1385 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:29.639489 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f119ab-6550-48bf-897e-8efb840a1385 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:29.641780 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 559/1111] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:40:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:40:29.647098 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d5fed-8bf6-4c2d-b4fb-48ad0da0acae None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:29.647527 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d5fed-8bf6-4c2d-b4fb-48ad0da0acae None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:29.647646 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d5fed-8bf6-4c2d-b4fb-48ad0da0acae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:29.664992 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-4c3d5fed-8bf6-4c2d-b4fb-48ad0da0acae None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:40:29.666148 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-4c3d5fed-8bf6-4c2d-b4fb-48ad0da0acae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:40:29.732099 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 553/1112] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:40:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 20:40:29.756779 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f119ab-6550-48bf-897e-8efb840a1385 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:29.864981 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f119ab-6550-48bf-897e-8efb840a1385 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:29.899346 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b59a59-c66b-4e70-9858-d684cb2a8d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:29.900155 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b59a59-c66b-4e70-9858-d684cb2a8d57 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:29.900433 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b59a59-c66b-4e70-9858-d684cb2a8d57 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:29.900704 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b59a59-c66b-4e70-9858-d684cb2a8d57 None admin] PATH_INFO: `/v3/roles/28b8756191f44cadbdae28d1af156b6c` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:29.902197 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b59a59-c66b-4e70-9858-d684cb2a8d57 None admin] RBAC: Authorizing `identity:get_role(role_id=28b8756191f44cadbdae28d1af156b6c)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:29.903553 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b59a59-c66b-4e70-9858-d684cb2a8d57 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:29.905124 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 560/1113] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:40:29 2022] GET /identity/v3/roles/28b8756191f44cadbdae28d1af156b6c => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:29.912044 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d5fed-8bf6-4c2d-b4fb-48ad0da0acae None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:30.008384 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d5fed-8bf6-4c2d-b4fb-48ad0da0acae None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:30.041426 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2e1ad-32f0-44bd-b7a7-077143ac53ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:30.042282 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2e1ad-32f0-44bd-b7a7-077143ac53ab None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:30.042559 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2e1ad-32f0-44bd-b7a7-077143ac53ab None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:30.042832 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2e1ad-32f0-44bd-b7a7-077143ac53ab None admin] PATH_INFO: `/v3/users/3944cdf89487475bab4c8cc92fdaec6f` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:30.055875 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd2e1ad-32f0-44bd-b7a7-077143ac53ab None admin] RBAC: Authorizing `identity:get_user(user_id=3944cdf89487475bab4c8cc92fdaec6f)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:30.057328 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd2e1ad-32f0-44bd-b7a7-077143ac53ab None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:30.059004 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 554/1114] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:40:29 2022] GET /identity/v3/users/3944cdf89487475bab4c8cc92fdaec6f => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:30.065613 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b59a59-c66b-4e70-9858-d684cb2a8d57 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:30.166339 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b59a59-c66b-4e70-9858-d684cb2a8d57 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:30.198979 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305603b-835b-4fa6-8f50-3942e64602d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:30.199616 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305603b-835b-4fa6-8f50-3942e64602d6 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:30.199928 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305603b-835b-4fa6-8f50-3942e64602d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:30.200204 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305603b-835b-4fa6-8f50-3942e64602d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:30.265878 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305603b-835b-4fa6-8f50-3942e64602d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:30.267957 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305603b-835b-4fa6-8f50-3942e64602d6 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:30.363651 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 561/1115] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:40:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 20:40:30.369785 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2e1ad-32f0-44bd-b7a7-077143ac53ab None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:30.470354 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2e1ad-32f0-44bd-b7a7-077143ac53ab None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:30.504481 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7db71b-f2b8-421c-a36f-d144520b89be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:30.505330 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7db71b-f2b8-421c-a36f-d144520b89be None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:30.505607 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7db71b-f2b8-421c-a36f-d144520b89be None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:30.505877 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7db71b-f2b8-421c-a36f-d144520b89be None admin] PATH_INFO: `/v3/projects/6f165bba556242ee9c6b8c010680c663` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:30.507077 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7db71b-f2b8-421c-a36f-d144520b89be None admin] RBAC: Authorizing `identity:get_project(project_id=6f165bba556242ee9c6b8c010680c663)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:30.508547 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7db71b-f2b8-421c-a36f-d144520b89be None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:30.510266 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 555/1116] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:40:30 2022] GET /identity/v3/projects/6f165bba556242ee9c6b8c010680c663 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:30.516597 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305603b-835b-4fa6-8f50-3942e64602d6 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:30.612237 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305603b-835b-4fa6-8f50-3942e64602d6 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:30.644955 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fa485-21b5-4ffa-835a-7174bb470ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:30.645607 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fa485-21b5-4ffa-835a-7174bb470ae5 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:30.645866 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fa485-21b5-4ffa-835a-7174bb470ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:30.646137 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fa485-21b5-4ffa-835a-7174bb470ae5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:30.646957 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fa485-21b5-4ffa-835a-7174bb470ae5 None admin] RBAC: Adding query filter params (role.id=28b8756191f44cadbdae28d1af156b6c, scope.project.id=6f165bba556242ee9c6b8c010680c663, user.id=3944cdf89487475bab4c8cc92fdaec6f) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:30.647266 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fa485-21b5-4ffa-835a-7174bb470ae5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:30.648725 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fa485-21b5-4ffa-835a-7174bb470ae5 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:30.654067 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 562/1117] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:40:30 2022] GET /identity/v3/role_assignments?user.id=3944cdf89487475bab4c8cc92fdaec6f&scope.project.id=6f165bba556242ee9c6b8c010680c663&role.id=28b8756191f44cadbdae28d1af156b6c => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:33.006835 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9925990-15f6-4fc3-bdaf-6577f31b5c95 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:33.007366 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9925990-15f6-4fc3-bdaf-6577f31b5c95 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:33.007366 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9925990-15f6-4fc3-bdaf-6577f31b5c95 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:33.009200 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 556/1118] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:40:33.014289 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be2a5c-0333-4221-aee4-45900a2b48eb None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:33.014678 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be2a5c-0333-4221-aee4-45900a2b48eb None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:33.014838 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be2a5c-0333-4221-aee4-45900a2b48eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:33.031153 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-78be2a5c-0333-4221-aee4-45900a2b48eb None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:40:33.032893 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-78be2a5c-0333-4221-aee4-45900a2b48eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:40:33.097350 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 563/1119] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:40:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 20:40:33.120636 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9925990-15f6-4fc3-bdaf-6577f31b5c95 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:33.218411 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9925990-15f6-4fc3-bdaf-6577f31b5c95 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:33.252782 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e86f18-9524-46a1-84d2-90d8a1770b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:33.253631 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e86f18-9524-46a1-84d2-90d8a1770b4d None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:33.253909 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e86f18-9524-46a1-84d2-90d8a1770b4d None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:33.254181 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e86f18-9524-46a1-84d2-90d8a1770b4d None admin] PATH_INFO: `/v3/roles/28b8756191f44cadbdae28d1af156b6c` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:33.255660 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e86f18-9524-46a1-84d2-90d8a1770b4d None admin] RBAC: Authorizing `identity:get_role(role_id=28b8756191f44cadbdae28d1af156b6c)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:33.257120 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e86f18-9524-46a1-84d2-90d8a1770b4d None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:33.258466 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 557/1120] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:40:33 2022] GET /identity/v3/roles/28b8756191f44cadbdae28d1af156b6c => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:33.264582 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be2a5c-0333-4221-aee4-45900a2b48eb None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:33.360640 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be2a5c-0333-4221-aee4-45900a2b48eb None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:33.393159 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c3bda-31e0-494e-abe9-e42d38dc8b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:33.394018 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c3bda-31e0-494e-abe9-e42d38dc8b22 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:33.394297 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c3bda-31e0-494e-abe9-e42d38dc8b22 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:33.394578 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c3bda-31e0-494e-abe9-e42d38dc8b22 None admin] PATH_INFO: `/v3/users/3944cdf89487475bab4c8cc92fdaec6f` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:33.395776 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c3bda-31e0-494e-abe9-e42d38dc8b22 None admin] RBAC: Authorizing `identity:get_user(user_id=3944cdf89487475bab4c8cc92fdaec6f)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:33.397207 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c3bda-31e0-494e-abe9-e42d38dc8b22 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:33.398823 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 564/1121] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:40:33 2022] GET /identity/v3/users/3944cdf89487475bab4c8cc92fdaec6f => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:33.404659 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e86f18-9524-46a1-84d2-90d8a1770b4d None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:33.501327 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e86f18-9524-46a1-84d2-90d8a1770b4d None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:33.535064 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac3765-2117-4845-a6a0-f70939b93f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:33.535940 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac3765-2117-4845-a6a0-f70939b93f41 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:33.536212 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac3765-2117-4845-a6a0-f70939b93f41 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:33.536688 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac3765-2117-4845-a6a0-f70939b93f41 None admin] PATH_INFO: `/v3/projects/6f165bba556242ee9c6b8c010680c663` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:33.537659 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac3765-2117-4845-a6a0-f70939b93f41 None admin] RBAC: Authorizing `identity:get_project(project_id=6f165bba556242ee9c6b8c010680c663)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:33.539208 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac3765-2117-4845-a6a0-f70939b93f41 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:33.540923 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 558/1122] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:40:33 2022] GET /identity/v3/projects/6f165bba556242ee9c6b8c010680c663 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:33.548708 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c3bda-31e0-494e-abe9-e42d38dc8b22 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:33.643505 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c3bda-31e0-494e-abe9-e42d38dc8b22 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:33.676269 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd6a4f-4a37-4cf9-8c63-562f69e1618f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:33.677145 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd6a4f-4a37-4cf9-8c63-562f69e1618f None admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:33.677417 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd6a4f-4a37-4cf9-8c63-562f69e1618f None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:33.677683 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd6a4f-4a37-4cf9-8c63-562f69e1618f None admin] PATH_INFO: `/v3/projects/6f165bba556242ee9c6b8c010680c663/users/3944cdf89487475bab4c8cc92fdaec6f/roles/28b8756191f44cadbdae28d1af156b6c` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:33.679858 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd6a4f-4a37-4cf9-8c63-562f69e1618f None admin] RBAC: Authorizing `identity:create_grant(project_id=6f165bba556242ee9c6b8c010680c663, user_id=3944cdf89487475bab4c8cc92fdaec6f, role_id=28b8756191f44cadbdae28d1af156b6c)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:33.681271 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd6a4f-4a37-4cf9-8c63-562f69e1618f None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:33.694607 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 565/1123] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 20:40:33 2022] PUT /identity/v3/projects/6f165bba556242ee9c6b8c010680c663/users/3944cdf89487475bab4c8cc92fdaec6f/roles/28b8756191f44cadbdae28d1af156b6c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:40:36.027566 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e5b90-c870-436c-8d98-ba47e9d053c1 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:36.028168 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e5b90-c870-436c-8d98-ba47e9d053c1 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:36.028168 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e5b90-c870-436c-8d98-ba47e9d053c1 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:36.029897 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 559/1124] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:40:36.035928 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e618b91-6377-4e27-905a-c07572a4aabd None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:36.036332 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e618b91-6377-4e27-905a-c07572a4aabd None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:36.036475 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e618b91-6377-4e27-905a-c07572a4aabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:36.053235 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-8e618b91-6377-4e27-905a-c07572a4aabd None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:40:36.054383 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-8e618b91-6377-4e27-905a-c07572a4aabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:40:36.117094 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 566/1125] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:40:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:40:36.139993 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e5b90-c870-436c-8d98-ba47e9d053c1 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:36.238208 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e5b90-c870-436c-8d98-ba47e9d053c1 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:36.270930 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5483a-d4df-49ff-8e66-4c243f8dad4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:36.271813 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5483a-d4df-49ff-8e66-4c243f8dad4c None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:36.272095 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5483a-d4df-49ff-8e66-4c243f8dad4c None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:36.272367 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5483a-d4df-49ff-8e66-4c243f8dad4c None admin] PATH_INFO: `/v3/roles/28b8756191f44cadbdae28d1af156b6c` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:36.273842 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5483a-d4df-49ff-8e66-4c243f8dad4c None admin] RBAC: Authorizing `identity:get_role(role_id=28b8756191f44cadbdae28d1af156b6c)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:36.275206 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5483a-d4df-49ff-8e66-4c243f8dad4c None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:36.276592 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 560/1126] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:40:36 2022] GET /identity/v3/roles/28b8756191f44cadbdae28d1af156b6c => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:36.282926 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e618b91-6377-4e27-905a-c07572a4aabd None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:36.379529 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e618b91-6377-4e27-905a-c07572a4aabd None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:36.412544 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505457be-c809-40f4-83ce-64ce02e85a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:36.413393 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505457be-c809-40f4-83ce-64ce02e85a1d None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:36.413668 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505457be-c809-40f4-83ce-64ce02e85a1d None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:36.413935 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505457be-c809-40f4-83ce-64ce02e85a1d None admin] PATH_INFO: `/v3/users/3944cdf89487475bab4c8cc92fdaec6f` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:36.415097 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505457be-c809-40f4-83ce-64ce02e85a1d None admin] RBAC: Authorizing `identity:get_user(user_id=3944cdf89487475bab4c8cc92fdaec6f)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:36.416534 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505457be-c809-40f4-83ce-64ce02e85a1d None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:36.418125 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 567/1127] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:40:36 2022] GET /identity/v3/users/3944cdf89487475bab4c8cc92fdaec6f => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:36.424104 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5483a-d4df-49ff-8e66-4c243f8dad4c None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:36.520310 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5483a-d4df-49ff-8e66-4c243f8dad4c None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:36.553996 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c863d-891a-4acc-ab06-5b19b154c6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:36.554561 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c863d-891a-4acc-ab06-5b19b154c6be None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:36.554841 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c863d-891a-4acc-ab06-5b19b154c6be None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:36.555113 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c863d-891a-4acc-ab06-5b19b154c6be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:36.625699 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c863d-891a-4acc-ab06-5b19b154c6be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:36.627149 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c863d-891a-4acc-ab06-5b19b154c6be None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:36.721786 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 561/1128] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:40:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 20:40:36.727769 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505457be-c809-40f4-83ce-64ce02e85a1d None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:36.831394 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505457be-c809-40f4-83ce-64ce02e85a1d None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:36.865065 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f729ef-df3f-44bd-8f26-594e20e0e04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:36.866082 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f729ef-df3f-44bd-8f26-594e20e0e04b None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:36.866364 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f729ef-df3f-44bd-8f26-594e20e0e04b None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:36.866635 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f729ef-df3f-44bd-8f26-594e20e0e04b None admin] PATH_INFO: `/v3/projects/6f165bba556242ee9c6b8c010680c663` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:36.867861 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f729ef-df3f-44bd-8f26-594e20e0e04b None admin] RBAC: Authorizing `identity:get_project(project_id=6f165bba556242ee9c6b8c010680c663)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:36.869295 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f729ef-df3f-44bd-8f26-594e20e0e04b None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:36.871004 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 568/1129] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:40:36 2022] GET /identity/v3/projects/6f165bba556242ee9c6b8c010680c663 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:36.877872 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c863d-891a-4acc-ab06-5b19b154c6be None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:36.972559 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c863d-891a-4acc-ab06-5b19b154c6be None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:37.004552 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12234a99-df0b-4a12-a4a2-1348f1de3066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:37.005187 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12234a99-df0b-4a12-a4a2-1348f1de3066 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:37.005464 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12234a99-df0b-4a12-a4a2-1348f1de3066 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:37.005728 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12234a99-df0b-4a12-a4a2-1348f1de3066 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:37.006536 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12234a99-df0b-4a12-a4a2-1348f1de3066 None admin] RBAC: Adding query filter params (role.id=28b8756191f44cadbdae28d1af156b6c, scope.project.id=6f165bba556242ee9c6b8c010680c663, user.id=3944cdf89487475bab4c8cc92fdaec6f) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:37.006839 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12234a99-df0b-4a12-a4a2-1348f1de3066 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:37.008298 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12234a99-df0b-4a12-a4a2-1348f1de3066 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:37.013916 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 562/1130] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:40:36 2022] GET /identity/v3/role_assignments?user.id=3944cdf89487475bab4c8cc92fdaec6f&scope.project.id=6f165bba556242ee9c6b8c010680c663&role.id=28b8756191f44cadbdae28d1af156b6c => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:39.405382 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f51e9f-5096-43de-b2b9-3e9871db1482 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:39.405965 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f51e9f-5096-43de-b2b9-3e9871db1482 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:39.405965 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f51e9f-5096-43de-b2b9-3e9871db1482 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:39.408583 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 569/1131] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:40:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:40:39.414121 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c81f56-c806-4dc9-b68a-829eaebd9c49 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:39.414551 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c81f56-c806-4dc9-b68a-829eaebd9c49 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:39.414655 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c81f56-c806-4dc9-b68a-829eaebd9c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:39.431128 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-17c81f56-c806-4dc9-b68a-829eaebd9c49 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:40:39.432341 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-17c81f56-c806-4dc9-b68a-829eaebd9c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:40:39.496303 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 563/1132] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:40:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:40:39.519991 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f51e9f-5096-43de-b2b9-3e9871db1482 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:39.616324 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f51e9f-5096-43de-b2b9-3e9871db1482 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:39.650087 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026499f9-5667-4aa6-9ab3-878117c5d522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:39.650874 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026499f9-5667-4aa6-9ab3-878117c5d522 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:39.651147 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026499f9-5667-4aa6-9ab3-878117c5d522 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:39.651411 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026499f9-5667-4aa6-9ab3-878117c5d522 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:39.652590 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026499f9-5667-4aa6-9ab3-878117c5d522 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:39.654005 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026499f9-5667-4aa6-9ab3-878117c5d522 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:39.655582 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 570/1133] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:40:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:39.662499 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c81f56-c806-4dc9-b68a-829eaebd9c49 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:39.758771 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c81f56-c806-4dc9-b68a-829eaebd9c49 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:39.791329 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da440035-a809-4cee-b710-7fd06ca3f685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:39.792003 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da440035-a809-4cee-b710-7fd06ca3f685 None admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:39.792279 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da440035-a809-4cee-b710-7fd06ca3f685 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:39.792543 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da440035-a809-4cee-b710-7fd06ca3f685 None admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:39.793253 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da440035-a809-4cee-b710-7fd06ca3f685 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:39.794682 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da440035-a809-4cee-b710-7fd06ca3f685 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:39.828936 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 564/1134] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Oct 28 20:40:39 2022] POST /identity/v3/projects => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:40:42.213488 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e064a-9987-41d2-ba84-2960c0fe43f1 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:42.214087 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e064a-9987-41d2-ba84-2960c0fe43f1 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:42.214087 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e064a-9987-41d2-ba84-2960c0fe43f1 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:42.215836 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 571/1135] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:40:42.221251 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed999a7-52c9-417a-a587-7c33da76790e None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:42.221717 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed999a7-52c9-417a-a587-7c33da76790e None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:42.221816 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed999a7-52c9-417a-a587-7c33da76790e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:42.238683 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-bed999a7-52c9-417a-a587-7c33da76790e None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:40:42.239899 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-bed999a7-52c9-417a-a587-7c33da76790e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:40:42.304669 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 565/1136] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:40:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:40:42.330487 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e064a-9987-41d2-ba84-2960c0fe43f1 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:42.427763 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e064a-9987-41d2-ba84-2960c0fe43f1 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:42.460720 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65408615-3824-4c6b-99a7-0c71bef97046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:42.461500 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65408615-3824-4c6b-99a7-0c71bef97046 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:42.461778 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65408615-3824-4c6b-99a7-0c71bef97046 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:42.462050 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65408615-3824-4c6b-99a7-0c71bef97046 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:42.463209 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65408615-3824-4c6b-99a7-0c71bef97046 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:42.464814 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65408615-3824-4c6b-99a7-0c71bef97046 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:42.466375 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 572/1137] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:40:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:42.472396 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed999a7-52c9-417a-a587-7c33da76790e None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:42.567374 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed999a7-52c9-417a-a587-7c33da76790e None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:42.599642 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523e4f7-c4bc-4ddc-85fd-383a046e1339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:42.600330 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523e4f7-c4bc-4ddc-85fd-383a046e1339 None admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:42.600603 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523e4f7-c4bc-4ddc-85fd-383a046e1339 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:42.600864 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523e4f7-c4bc-4ddc-85fd-383a046e1339 None admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:42.601572 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523e4f7-c4bc-4ddc-85fd-383a046e1339 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:42.602984 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523e4f7-c4bc-4ddc-85fd-383a046e1339 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:42.626928 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 566/1138] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Oct 28 20:40:42 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:40:44.997683 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41905061-02b2-45bc-82f4-239f29bd13d5 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:44.998246 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41905061-02b2-45bc-82f4-239f29bd13d5 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:44.998246 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41905061-02b2-45bc-82f4-239f29bd13d5 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:45.000070 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 573/1139] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:40:45.005805 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3d0f9-c938-4405-b999-047d2763c046 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:45.006242 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3d0f9-c938-4405-b999-047d2763c046 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:45.006349 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3d0f9-c938-4405-b999-047d2763c046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:45.023807 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-54f3d0f9-c938-4405-b999-047d2763c046 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:40:45.025025 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-54f3d0f9-c938-4405-b999-047d2763c046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:40:45.091789 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 567/1140] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:40:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:40:45.115960 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41905061-02b2-45bc-82f4-239f29bd13d5 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:45.214359 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41905061-02b2-45bc-82f4-239f29bd13d5 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:45.247822 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86582964-c079-4a1f-921a-a29aa08d7844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:45.248534 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86582964-c079-4a1f-921a-a29aa08d7844 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:45.248814 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86582964-c079-4a1f-921a-a29aa08d7844 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:45.249082 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86582964-c079-4a1f-921a-a29aa08d7844 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:45.258918 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86582964-c079-4a1f-921a-a29aa08d7844 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:40:45.266064 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-86582964-c079-4a1f-921a-a29aa08d7844 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 20:40:45.267244 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 574/1141] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 20:40:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:40:45.273277 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3d0f9-c938-4405-b999-047d2763c046 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:45.367142 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3d0f9-c938-4405-b999-047d2763c046 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:45.400571 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904756d5-df53-4e2f-a156-152165785ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:45.401222 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904756d5-df53-4e2f-a156-152165785ad0 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:45.401493 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904756d5-df53-4e2f-a156-152165785ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:45.401758 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904756d5-df53-4e2f-a156-152165785ad0 None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:45.402501 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904756d5-df53-4e2f-a156-152165785ad0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:45.402799 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904756d5-df53-4e2f-a156-152165785ad0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:45.404188 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904756d5-df53-4e2f-a156-152165785ad0 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:45.412896 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 568/1142] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:40:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:45.418779 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86582964-c079-4a1f-921a-a29aa08d7844 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:45.523280 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86582964-c079-4a1f-921a-a29aa08d7844 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:45.556015 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d33568-3795-492a-aea8-fe7fa80d27c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:45.556874 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d33568-3795-492a-aea8-fe7fa80d27c4 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:45.557268 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d33568-3795-492a-aea8-fe7fa80d27c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:45.557545 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d33568-3795-492a-aea8-fe7fa80d27c4 None admin] PATH_INFO: `/v3/users/9313bea155cd41bd90329d001c74918c` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:45.571185 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d33568-3795-492a-aea8-fe7fa80d27c4 None admin] RBAC: Authorizing `identity:get_user(user_id=9313bea155cd41bd90329d001c74918c)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:45.572649 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d33568-3795-492a-aea8-fe7fa80d27c4 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:45.574320 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 575/1143] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:40:45 2022] GET /identity/v3/users/9313bea155cd41bd90329d001c74918c => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:45.580547 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904756d5-df53-4e2f-a156-152165785ad0 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:45.703922 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904756d5-df53-4e2f-a156-152165785ad0 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:45.737684 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001ee7a-db8b-4718-aa0d-572c1759888f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:45.738338 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001ee7a-db8b-4718-aa0d-572c1759888f None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:45.738610 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001ee7a-db8b-4718-aa0d-572c1759888f None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:45.738884 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001ee7a-db8b-4718-aa0d-572c1759888f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:45.814031 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6001ee7a-db8b-4718-aa0d-572c1759888f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:45.815416 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6001ee7a-db8b-4718-aa0d-572c1759888f None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:45.936140 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 569/1144] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:40:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 20:40:45.945545 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d33568-3795-492a-aea8-fe7fa80d27c4 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:46.057496 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d33568-3795-492a-aea8-fe7fa80d27c4 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:46.102888 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a06a68-d3c2-48aa-8543-41251e107103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:46.103662 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a06a68-d3c2-48aa-8543-41251e107103 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:46.103968 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a06a68-d3c2-48aa-8543-41251e107103 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:46.104239 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a06a68-d3c2-48aa-8543-41251e107103 None admin] PATH_INFO: `/v3/projects/ae70ac10ace64cd785a294e1484782f4` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:46.105427 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a06a68-d3c2-48aa-8543-41251e107103 None admin] RBAC: Authorizing `identity:get_project(project_id=ae70ac10ace64cd785a294e1484782f4)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:46.106855 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a06a68-d3c2-48aa-8543-41251e107103 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:46.108862 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 576/1145] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:40:45 2022] GET /identity/v3/projects/ae70ac10ace64cd785a294e1484782f4 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:40:46.116718 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001ee7a-db8b-4718-aa0d-572c1759888f None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:46.224371 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001ee7a-db8b-4718-aa0d-572c1759888f None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:46.267664 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f68e13-dd92-48d0-9020-6c87d3763629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:46.268357 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f68e13-dd92-48d0-9020-6c87d3763629 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:46.268640 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f68e13-dd92-48d0-9020-6c87d3763629 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:46.269908 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f68e13-dd92-48d0-9020-6c87d3763629 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:46.270768 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f68e13-dd92-48d0-9020-6c87d3763629 None admin] RBAC: Adding query filter params (role.id=8fe105eeb7bf4856a94b0633bd781414, scope.project.id=ae70ac10ace64cd785a294e1484782f4, user.id=9313bea155cd41bd90329d001c74918c) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:46.271081 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f68e13-dd92-48d0-9020-6c87d3763629 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:46.272751 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f68e13-dd92-48d0-9020-6c87d3763629 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:46.279783 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 570/1146] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:40:46 2022] GET /identity/v3/role_assignments?user.id=9313bea155cd41bd90329d001c74918c&scope.project.id=ae70ac10ace64cd785a294e1484782f4&role.id=8fe105eeb7bf4856a94b0633bd781414 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:48.635484 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae48cf9-4e3b-4ade-9c4b-7b32b9fa07ea None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:48.636051 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae48cf9-4e3b-4ade-9c4b-7b32b9fa07ea None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:48.636051 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae48cf9-4e3b-4ade-9c4b-7b32b9fa07ea None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:48.637770 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 577/1147] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:40:48.644284 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663fcb8-af50-46b1-9d88-be7526a0a522 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:48.644849 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663fcb8-af50-46b1-9d88-be7526a0a522 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:48.644849 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663fcb8-af50-46b1-9d88-be7526a0a522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:48.663587 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-7663fcb8-af50-46b1-9d88-be7526a0a522 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:40:48.664844 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-7663fcb8-af50-46b1-9d88-be7526a0a522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:40:48.730329 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 571/1148] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:40:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:40:48.753531 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae48cf9-4e3b-4ade-9c4b-7b32b9fa07ea None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:48.851818 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae48cf9-4e3b-4ade-9c4b-7b32b9fa07ea None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:48.884343 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b05b3f-2db3-4076-b313-9845a8a25509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:48.885119 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b05b3f-2db3-4076-b313-9845a8a25509 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:48.885395 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b05b3f-2db3-4076-b313-9845a8a25509 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:48.885716 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b05b3f-2db3-4076-b313-9845a8a25509 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:48.895595 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b05b3f-2db3-4076-b313-9845a8a25509 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:40:48.902517 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-84b05b3f-2db3-4076-b313-9845a8a25509 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 20:40:48.903692 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 578/1149] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 20:40:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:40:48.910950 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663fcb8-af50-46b1-9d88-be7526a0a522 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:49.006517 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663fcb8-af50-46b1-9d88-be7526a0a522 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:49.040803 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30f5d5-a669-464b-9a68-f50a498cc689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:49.041462 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30f5d5-a669-464b-9a68-f50a498cc689 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:49.041736 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30f5d5-a669-464b-9a68-f50a498cc689 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:49.042004 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30f5d5-a669-464b-9a68-f50a498cc689 None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:49.042740 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae30f5d5-a669-464b-9a68-f50a498cc689 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:49.043035 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae30f5d5-a669-464b-9a68-f50a498cc689 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:49.044430 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae30f5d5-a669-464b-9a68-f50a498cc689 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:49.053377 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 572/1150] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:40:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:49.061253 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b05b3f-2db3-4076-b313-9845a8a25509 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:49.159718 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b05b3f-2db3-4076-b313-9845a8a25509 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:49.192983 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6c7b5-a234-48aa-aa6c-70760176f971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:49.193843 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6c7b5-a234-48aa-aa6c-70760176f971 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:49.194123 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6c7b5-a234-48aa-aa6c-70760176f971 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:49.194396 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6c7b5-a234-48aa-aa6c-70760176f971 None admin] PATH_INFO: `/v3/users/9313bea155cd41bd90329d001c74918c` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:49.195577 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca6c7b5-a234-48aa-aa6c-70760176f971 None admin] RBAC: Authorizing `identity:get_user(user_id=9313bea155cd41bd90329d001c74918c)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:49.197038 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca6c7b5-a234-48aa-aa6c-70760176f971 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:49.198662 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 579/1151] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:40:49 2022] GET /identity/v3/users/9313bea155cd41bd90329d001c74918c => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:49.205216 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30f5d5-a669-464b-9a68-f50a498cc689 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:49.304268 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30f5d5-a669-464b-9a68-f50a498cc689 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:49.336931 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29221b55-266d-4530-81e3-9f486d7961f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:49.337775 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29221b55-266d-4530-81e3-9f486d7961f3 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:49.338053 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29221b55-266d-4530-81e3-9f486d7961f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:49.338324 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29221b55-266d-4530-81e3-9f486d7961f3 None admin] PATH_INFO: `/v3/projects/ae70ac10ace64cd785a294e1484782f4` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:49.339500 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29221b55-266d-4530-81e3-9f486d7961f3 None admin] RBAC: Authorizing `identity:get_project(project_id=ae70ac10ace64cd785a294e1484782f4)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:49.340967 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29221b55-266d-4530-81e3-9f486d7961f3 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:49.342643 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 573/1152] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:40:49 2022] GET /identity/v3/projects/ae70ac10ace64cd785a294e1484782f4 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:49.348892 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6c7b5-a234-48aa-aa6c-70760176f971 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:49.446257 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6c7b5-a234-48aa-aa6c-70760176f971 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:49.478168 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab551297-08f9-482c-b689-da821b4aa33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:49.479040 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab551297-08f9-482c-b689-da821b4aa33b None admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:49.479318 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab551297-08f9-482c-b689-da821b4aa33b None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:49.479590 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab551297-08f9-482c-b689-da821b4aa33b None admin] PATH_INFO: `/v3/projects/ae70ac10ace64cd785a294e1484782f4/users/9313bea155cd41bd90329d001c74918c/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:49.481587 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab551297-08f9-482c-b689-da821b4aa33b None admin] RBAC: Authorizing `identity:create_grant(project_id=ae70ac10ace64cd785a294e1484782f4, user_id=9313bea155cd41bd90329d001c74918c, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:49.483015 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab551297-08f9-482c-b689-da821b4aa33b None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:49.497606 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 580/1153] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 20:40:49 2022] PUT /identity/v3/projects/ae70ac10ace64cd785a294e1484782f4/users/9313bea155cd41bd90329d001c74918c/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:40:51.860004 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189d315-11a5-41a6-896d-9347c8c21b52 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:51.860639 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189d315-11a5-41a6-896d-9347c8c21b52 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:51.860639 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189d315-11a5-41a6-896d-9347c8c21b52 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:51.862390 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 574/1154] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:40:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:40:51.868483 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69678b6b-cb5e-4de6-8f54-61f1fa8f0e13 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:51.868998 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69678b6b-cb5e-4de6-8f54-61f1fa8f0e13 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:51.869108 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69678b6b-cb5e-4de6-8f54-61f1fa8f0e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:51.886438 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-69678b6b-cb5e-4de6-8f54-61f1fa8f0e13 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:40:51.887640 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-69678b6b-cb5e-4de6-8f54-61f1fa8f0e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:40:51.952062 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 581/1155] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:40:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:40:51.977012 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189d315-11a5-41a6-896d-9347c8c21b52 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:52.074625 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189d315-11a5-41a6-896d-9347c8c21b52 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:52.107236 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc6600-c296-4b8c-b800-0ebc1080e38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:52.108043 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc6600-c296-4b8c-b800-0ebc1080e38f None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:52.108319 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc6600-c296-4b8c-b800-0ebc1080e38f None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:52.108585 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc6600-c296-4b8c-b800-0ebc1080e38f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:52.119073 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc6600-c296-4b8c-b800-0ebc1080e38f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:40:52.126076 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-93bc6600-c296-4b8c-b800-0ebc1080e38f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 20:40:52.127231 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 575/1156] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 20:40:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:40:52.133320 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69678b6b-cb5e-4de6-8f54-61f1fa8f0e13 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:52.226339 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69678b6b-cb5e-4de6-8f54-61f1fa8f0e13 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:52.258885 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba0612-3688-42bb-8952-c28c64758b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:52.259546 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba0612-3688-42bb-8952-c28c64758b2a None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:52.259928 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba0612-3688-42bb-8952-c28c64758b2a None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:52.260371 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba0612-3688-42bb-8952-c28c64758b2a None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:52.261146 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba0612-3688-42bb-8952-c28c64758b2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:52.261427 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba0612-3688-42bb-8952-c28c64758b2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:52.262794 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba0612-3688-42bb-8952-c28c64758b2a None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:52.271644 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 582/1157] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:40:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:52.277430 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc6600-c296-4b8c-b800-0ebc1080e38f None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:52.374929 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc6600-c296-4b8c-b800-0ebc1080e38f None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:52.408116 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c6013-2c16-4c3a-870b-36989f279bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:52.409239 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c6013-2c16-4c3a-870b-36989f279bcd None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:52.409514 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c6013-2c16-4c3a-870b-36989f279bcd None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:52.409784 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c6013-2c16-4c3a-870b-36989f279bcd None admin] PATH_INFO: `/v3/users/9313bea155cd41bd90329d001c74918c` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:52.410979 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c6013-2c16-4c3a-870b-36989f279bcd None admin] RBAC: Authorizing `identity:get_user(user_id=9313bea155cd41bd90329d001c74918c)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:52.412447 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c6013-2c16-4c3a-870b-36989f279bcd None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:52.414058 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 576/1158] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:40:52 2022] GET /identity/v3/users/9313bea155cd41bd90329d001c74918c => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:52.419902 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba0612-3688-42bb-8952-c28c64758b2a None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:52.521707 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba0612-3688-42bb-8952-c28c64758b2a None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:52.554087 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f5fab-6024-4ab7-b4fe-616d2af1ef37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:52.554729 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f5fab-6024-4ab7-b4fe-616d2af1ef37 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:52.555006 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f5fab-6024-4ab7-b4fe-616d2af1ef37 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:52.555279 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f5fab-6024-4ab7-b4fe-616d2af1ef37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:52.620041 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f5fab-6024-4ab7-b4fe-616d2af1ef37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:52.621511 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f5fab-6024-4ab7-b4fe-616d2af1ef37 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:52.717133 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 583/1159] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:40:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 20:40:52.723794 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c6013-2c16-4c3a-870b-36989f279bcd None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:52.820509 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c6013-2c16-4c3a-870b-36989f279bcd None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:52.853318 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e21962-9e5b-414f-8fff-6e1c0c9a1340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:52.854170 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e21962-9e5b-414f-8fff-6e1c0c9a1340 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:52.854441 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e21962-9e5b-414f-8fff-6e1c0c9a1340 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:52.854704 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e21962-9e5b-414f-8fff-6e1c0c9a1340 None admin] PATH_INFO: `/v3/projects/ae70ac10ace64cd785a294e1484782f4` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:52.855887 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e21962-9e5b-414f-8fff-6e1c0c9a1340 None admin] RBAC: Authorizing `identity:get_project(project_id=ae70ac10ace64cd785a294e1484782f4)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:52.857318 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e21962-9e5b-414f-8fff-6e1c0c9a1340 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:52.859556 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 577/1160] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:40:52 2022] GET /identity/v3/projects/ae70ac10ace64cd785a294e1484782f4 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:52.865989 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f5fab-6024-4ab7-b4fe-616d2af1ef37 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:52.965631 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f5fab-6024-4ab7-b4fe-616d2af1ef37 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:52.998623 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196f412-09e0-4a1e-a2bd-44f78923fae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:52.999181 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196f412-09e0-4a1e-a2bd-44f78923fae8 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:52.999455 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196f412-09e0-4a1e-a2bd-44f78923fae8 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:52.999832 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196f412-09e0-4a1e-a2bd-44f78923fae8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:53.000868 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196f412-09e0-4a1e-a2bd-44f78923fae8 None admin] RBAC: Adding query filter params (role.id=8fe105eeb7bf4856a94b0633bd781414, scope.project.id=ae70ac10ace64cd785a294e1484782f4, user.id=9313bea155cd41bd90329d001c74918c) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:53.001177 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196f412-09e0-4a1e-a2bd-44f78923fae8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:53.002591 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196f412-09e0-4a1e-a2bd-44f78923fae8 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:53.008185 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 584/1161] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:40:52 2022] GET /identity/v3/role_assignments?user.id=9313bea155cd41bd90329d001c74918c&scope.project.id=ae70ac10ace64cd785a294e1484782f4&role.id=8fe105eeb7bf4856a94b0633bd781414 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:55.354204 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ac7e0-5f0f-47d6-a55c-8dc60913e8ee None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:55.354758 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ac7e0-5f0f-47d6-a55c-8dc60913e8ee None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:55.354758 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ac7e0-5f0f-47d6-a55c-8dc60913e8ee None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:55.356579 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 578/1162] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:40:55.362088 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421152e9-2b7c-4612-a21f-e07e269c53e0 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:55.362543 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421152e9-2b7c-4612-a21f-e07e269c53e0 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:55.362637 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421152e9-2b7c-4612-a21f-e07e269c53e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:55.379843 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-421152e9-2b7c-4612-a21f-e07e269c53e0 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:40:55.381011 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-421152e9-2b7c-4612-a21f-e07e269c53e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:40:55.443816 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 585/1163] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:40:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:40:55.469400 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ac7e0-5f0f-47d6-a55c-8dc60913e8ee None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:55.568071 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ac7e0-5f0f-47d6-a55c-8dc60913e8ee None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:55.600873 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5c2e2-0dc1-4699-bfb7-610c33d89049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:55.601511 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5c2e2-0dc1-4699-bfb7-610c33d89049 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:55.601791 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5c2e2-0dc1-4699-bfb7-610c33d89049 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:55.602063 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5c2e2-0dc1-4699-bfb7-610c33d89049 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:55.666129 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e5c2e2-0dc1-4699-bfb7-610c33d89049 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:55.667583 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e5c2e2-0dc1-4699-bfb7-610c33d89049 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:55.761677 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 579/1164] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:40:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 20:40:55.768475 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421152e9-2b7c-4612-a21f-e07e269c53e0 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:55.863644 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421152e9-2b7c-4612-a21f-e07e269c53e0 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:55.895986 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b345a75-542e-4985-85ad-db42a15e3569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:55.896775 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b345a75-542e-4985-85ad-db42a15e3569 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:55.897049 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b345a75-542e-4985-85ad-db42a15e3569 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:55.897313 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b345a75-542e-4985-85ad-db42a15e3569 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:55.903848 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b345a75-542e-4985-85ad-db42a15e3569 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:55.905281 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b345a75-542e-4985-85ad-db42a15e3569 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:55.919344 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-3b345a75-542e-4985-85ad-db42a15e3569 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 28 20:40:55.920528 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 586/1165] 10.222.0.49 () {56 vars in 1117 bytes} [Fri Oct 28 20:40:55 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:40:55.927117 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5c2e2-0dc1-4699-bfb7-610c33d89049 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:56.021009 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5c2e2-0dc1-4699-bfb7-610c33d89049 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:56.053831 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64da211-7163-4908-977c-92dcb9e832ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:56.054481 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64da211-7163-4908-977c-92dcb9e832ab None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:56.054753 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64da211-7163-4908-977c-92dcb9e832ab None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:56.055018 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64da211-7163-4908-977c-92dcb9e832ab None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:56.055719 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64da211-7163-4908-977c-92dcb9e832ab None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:40:56.056045 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64da211-7163-4908-977c-92dcb9e832ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:56.057403 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64da211-7163-4908-977c-92dcb9e832ab None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:56.065223 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 580/1166] 10.222.0.49 () {56 vars in 1115 bytes} [Fri Oct 28 20:40:55 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:40:58.420910 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f5a20-2987-43e3-8358-f2058248871f None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:58.421945 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f5a20-2987-43e3-8358-f2058248871f None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:58.422043 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f5a20-2987-43e3-8358-f2058248871f None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:58.424045 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 587/1167] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:40:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:40:58.429545 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1add3-3275-4e95-ad78-ffac0b6e7d31 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:58.429970 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1add3-3275-4e95-ad78-ffac0b6e7d31 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:58.430078 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1add3-3275-4e95-ad78-ffac0b6e7d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:58.447246 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-c2c1add3-3275-4e95-ad78-ffac0b6e7d31 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:40:58.448484 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-c2c1add3-3275-4e95-ad78-ffac0b6e7d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:40:58.513689 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 581/1168] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:40:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:40:58.537971 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f5a20-2987-43e3-8358-f2058248871f None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:40:58.634160 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f5a20-2987-43e3-8358-f2058248871f None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:40:58.666478 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787ee4a-d6f4-4c12-b63a-85e36e36cee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:40:58.667119 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787ee4a-d6f4-4c12-b63a-85e36e36cee4 None admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:40:58.667395 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787ee4a-d6f4-4c12-b63a-85e36e36cee4 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:40:58.667665 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787ee4a-d6f4-4c12-b63a-85e36e36cee4 None admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:40:58.668484 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787ee4a-d6f4-4c12-b63a-85e36e36cee4 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:40:58.669844 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787ee4a-d6f4-4c12-b63a-85e36e36cee4 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:40:58.684590 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 588/1169] 10.222.0.49 () {60 vars in 1138 bytes} [Fri Oct 28 20:40:58 2022] POST /identity/v3/domains => generated 267 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:41:01.105626 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20f4fa-df64-43f8-bcb5-ee4511e07370 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:41:01.106200 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20f4fa-df64-43f8-bcb5-ee4511e07370 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:41:01.106200 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20f4fa-df64-43f8-bcb5-ee4511e07370 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:41:01.107972 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 582/1170] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:41:01.114120 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1df2f-29ea-4350-8de4-0195fd6ca524 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:41:01.114526 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1df2f-29ea-4350-8de4-0195fd6ca524 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:41:01.114680 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1df2f-29ea-4350-8de4-0195fd6ca524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:41:01.131677 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-b9b1df2f-29ea-4350-8de4-0195fd6ca524 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:41:01.132888 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-b9b1df2f-29ea-4350-8de4-0195fd6ca524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:41:01.200534 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 589/1171] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:41:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 20:41:01.225029 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20f4fa-df64-43f8-bcb5-ee4511e07370 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:41:01.325206 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20f4fa-df64-43f8-bcb5-ee4511e07370 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:41:01.356901 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4485bf-e2e7-4c99-b5f7-461bb27c9cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:41:01.357689 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4485bf-e2e7-4c99-b5f7-461bb27c9cfc None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:41:01.357967 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4485bf-e2e7-4c99-b5f7-461bb27c9cfc None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:41:01.358237 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4485bf-e2e7-4c99-b5f7-461bb27c9cfc None admin] PATH_INFO: `/v3/domains/147a8a7debce41f284681f90dd23299b` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:41:01.369091 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4485bf-e2e7-4c99-b5f7-461bb27c9cfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=147a8a7debce41f284681f90dd23299b)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:41:01.370550 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4485bf-e2e7-4c99-b5f7-461bb27c9cfc None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:41:01.372242 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 583/1172] 10.222.0.49 () {56 vars in 1183 bytes} [Fri Oct 28 20:41:01 2022] GET /identity/v3/domains/147a8a7debce41f284681f90dd23299b => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:41:01.378878 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1df2f-29ea-4350-8de4-0195fd6ca524 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:41:01.471304 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1df2f-29ea-4350-8de4-0195fd6ca524 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:41:01.504628 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ccb4d-3d27-4862-a256-d7e1f7b4af80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:41:01.505276 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ccb4d-3d27-4862-a256-d7e1f7b4af80 None admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:41:01.505552 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ccb4d-3d27-4862-a256-d7e1f7b4af80 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:41:01.505821 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ccb4d-3d27-4862-a256-d7e1f7b4af80 None admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:41:01.506532 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ccb4d-3d27-4862-a256-d7e1f7b4af80 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:41:01.507974 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ccb4d-3d27-4862-a256-d7e1f7b4af80 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:41:01.532838 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 590/1173] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Oct 28 20:41:01 2022] POST /identity/v3/projects => generated 361 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:41:03.932926 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba864dd-add9-4dc6-acb7-800c1f5e2c82 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:41:03.933481 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba864dd-add9-4dc6-acb7-800c1f5e2c82 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:41:03.933481 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba864dd-add9-4dc6-acb7-800c1f5e2c82 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:41:03.935245 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 584/1174] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:41:03.941401 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de900262-6643-4305-8fae-cfde90cb0b85 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:41:03.941835 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de900262-6643-4305-8fae-cfde90cb0b85 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:41:03.941965 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de900262-6643-4305-8fae-cfde90cb0b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:41:03.959798 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-de900262-6643-4305-8fae-cfde90cb0b85 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:41:03.961046 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-de900262-6643-4305-8fae-cfde90cb0b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:41:04.029065 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 591/1175] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:41:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:41:04.054367 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba864dd-add9-4dc6-acb7-800c1f5e2c82 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:41:04.152933 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba864dd-add9-4dc6-acb7-800c1f5e2c82 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:41:04.186023 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56cd2c-d5d6-4745-ab71-486350d6ee41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:41:04.187395 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56cd2c-d5d6-4745-ab71-486350d6ee41 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:41:04.187920 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56cd2c-d5d6-4745-ab71-486350d6ee41 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:41:04.188269 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56cd2c-d5d6-4745-ab71-486350d6ee41 None admin] PATH_INFO: `/v3/domains/147a8a7debce41f284681f90dd23299b` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:41:04.189437 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56cd2c-d5d6-4745-ab71-486350d6ee41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=147a8a7debce41f284681f90dd23299b)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:41:04.190870 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56cd2c-d5d6-4745-ab71-486350d6ee41 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:41:04.192645 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 585/1176] 10.222.0.49 () {56 vars in 1183 bytes} [Fri Oct 28 20:41:04 2022] GET /identity/v3/domains/147a8a7debce41f284681f90dd23299b => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:41:04.198561 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de900262-6643-4305-8fae-cfde90cb0b85 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:41:04.294787 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de900262-6643-4305-8fae-cfde90cb0b85 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:41:04.328012 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0f601-2f56-4d04-bc87-75151cf1b63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:41:04.328670 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0f601-2f56-4d04-bc87-75151cf1b63f None admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:41:04.328946 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0f601-2f56-4d04-bc87-75151cf1b63f None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:41:04.329214 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0f601-2f56-4d04-bc87-75151cf1b63f None admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:41:04.329922 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0f601-2f56-4d04-bc87-75151cf1b63f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:41:04.331346 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0f601-2f56-4d04-bc87-75151cf1b63f None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:41:04.351893 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 592/1177] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Oct 28 20:41:04 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:41:06.763073 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de441b82-bc4a-47dc-bf3a-6526794a81a2 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:41:06.763606 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de441b82-bc4a-47dc-bf3a-6526794a81a2 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:41:06.763606 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de441b82-bc4a-47dc-bf3a-6526794a81a2 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:41:06.765429 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 586/1178] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:41:06.770785 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504a5c8-4bbb-45ed-9a58-358c4392bb23 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:41:06.771228 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504a5c8-4bbb-45ed-9a58-358c4392bb23 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:41:06.771346 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504a5c8-4bbb-45ed-9a58-358c4392bb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:41:06.789046 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-6504a5c8-4bbb-45ed-9a58-358c4392bb23 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:41:06.790261 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-6504a5c8-4bbb-45ed-9a58-358c4392bb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:41:06.857755 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 593/1179] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:41:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 20:41:06.882042 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de441b82-bc4a-47dc-bf3a-6526794a81a2 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:41:06.980436 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de441b82-bc4a-47dc-bf3a-6526794a81a2 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:41:07.013569 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa1704-6315-4553-a9c9-07d1a82d50fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:41:07.014275 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa1704-6315-4553-a9c9-07d1a82d50fc None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:41:07.014555 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa1704-6315-4553-a9c9-07d1a82d50fc None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:41:07.014853 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa1704-6315-4553-a9c9-07d1a82d50fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:41:07.024729 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa1704-6315-4553-a9c9-07d1a82d50fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:41:07.032470 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-38aa1704-6315-4553-a9c9-07d1a82d50fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 20:41:07.033900 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 587/1180] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 20:41:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:41:07.040166 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504a5c8-4bbb-45ed-9a58-358c4392bb23 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:41:07.140652 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504a5c8-4bbb-45ed-9a58-358c4392bb23 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:41:07.173267 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ee9f8-0cb5-4772-af11-8934bd71e203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:41:07.173920 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ee9f8-0cb5-4772-af11-8934bd71e203 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:41:07.174195 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ee9f8-0cb5-4772-af11-8934bd71e203 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:41:07.174458 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ee9f8-0cb5-4772-af11-8934bd71e203 None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:41:07.175196 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ee9f8-0cb5-4772-af11-8934bd71e203 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:41:07.175500 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ee9f8-0cb5-4772-af11-8934bd71e203 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:41:07.176885 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ee9f8-0cb5-4772-af11-8934bd71e203 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:41:07.185138 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 594/1181] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:41:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:41:07.191359 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa1704-6315-4553-a9c9-07d1a82d50fc None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:41:07.296719 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa1704-6315-4553-a9c9-07d1a82d50fc None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:41:07.328907 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad80eed-0b0d-4d69-8686-8c47e88584bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:41:07.330121 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad80eed-0b0d-4d69-8686-8c47e88584bf None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:41:07.330525 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad80eed-0b0d-4d69-8686-8c47e88584bf None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:41:07.330904 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad80eed-0b0d-4d69-8686-8c47e88584bf None admin] PATH_INFO: `/v3/users/2bd57325aafd45d9acf5917cf7c28c4e` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:41:07.344462 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad80eed-0b0d-4d69-8686-8c47e88584bf None admin] RBAC: Authorizing `identity:get_user(user_id=2bd57325aafd45d9acf5917cf7c28c4e)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:41:07.345914 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad80eed-0b0d-4d69-8686-8c47e88584bf None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:41:07.347571 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 588/1182] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:41:07 2022] GET /identity/v3/users/2bd57325aafd45d9acf5917cf7c28c4e => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:41:07.353455 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ee9f8-0cb5-4772-af11-8934bd71e203 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:41:07.448846 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ee9f8-0cb5-4772-af11-8934bd71e203 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:41:07.482274 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf7b2a-6be7-4989-a115-60789894c4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:41:07.482933 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf7b2a-6be7-4989-a115-60789894c4eb None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:41:07.483197 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf7b2a-6be7-4989-a115-60789894c4eb None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:41:07.483518 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf7b2a-6be7-4989-a115-60789894c4eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:41:07.547265 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf7b2a-6be7-4989-a115-60789894c4eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:41:07.548654 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf7b2a-6be7-4989-a115-60789894c4eb None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:41:07.643459 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 595/1183] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:41:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 20:41:07.649443 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad80eed-0b0d-4d69-8686-8c47e88584bf None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:41:07.749723 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad80eed-0b0d-4d69-8686-8c47e88584bf None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:41:07.785783 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bbc45c-807a-4a1d-af17-c51064711ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:41:07.786662 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbc45c-807a-4a1d-af17-c51064711ba2 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:41:07.786940 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbc45c-807a-4a1d-af17-c51064711ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:41:07.787213 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbc45c-807a-4a1d-af17-c51064711ba2 None admin] PATH_INFO: `/v3/projects/41c6df69d6044049a54f27a300e6b012` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:41:07.788478 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bbc45c-807a-4a1d-af17-c51064711ba2 None admin] RBAC: Authorizing `identity:get_project(project_id=41c6df69d6044049a54f27a300e6b012)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:41:07.789946 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bbc45c-807a-4a1d-af17-c51064711ba2 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:41:07.791705 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 589/1184] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:41:07 2022] GET /identity/v3/projects/41c6df69d6044049a54f27a300e6b012 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:41:07.798315 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf7b2a-6be7-4989-a115-60789894c4eb None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:41:07.897073 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf7b2a-6be7-4989-a115-60789894c4eb None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:41:07.929548 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c687a-0e71-4ca3-a001-da1387c1ac5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:41:07.930186 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c687a-0e71-4ca3-a001-da1387c1ac5b None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:41:07.930460 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c687a-0e71-4ca3-a001-da1387c1ac5b None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:41:07.930727 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c687a-0e71-4ca3-a001-da1387c1ac5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:41:07.931537 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c687a-0e71-4ca3-a001-da1387c1ac5b None admin] RBAC: Adding query filter params (role.id=8fe105eeb7bf4856a94b0633bd781414, scope.project.id=41c6df69d6044049a54f27a300e6b012, user.id=2bd57325aafd45d9acf5917cf7c28c4e) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:41:07.931870 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c687a-0e71-4ca3-a001-da1387c1ac5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:41:07.933280 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c687a-0e71-4ca3-a001-da1387c1ac5b None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:41:07.938768 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 596/1185] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:41:07 2022] GET /identity/v3/role_assignments?user.id=2bd57325aafd45d9acf5917cf7c28c4e&scope.project.id=41c6df69d6044049a54f27a300e6b012&role.id=8fe105eeb7bf4856a94b0633bd781414 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:41:10.247562 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34e906-81f5-48a2-8d6d-ac76e445c070 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:41:10.248149 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34e906-81f5-48a2-8d6d-ac76e445c070 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:41:10.248149 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34e906-81f5-48a2-8d6d-ac76e445c070 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:41:10.250613 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 590/1186] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:41:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:41:10.255924 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1263e07-e1bd-4c9b-b855-a6ddd2429e7f None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:41:10.256324 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1263e07-e1bd-4c9b-b855-a6ddd2429e7f None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:41:10.256478 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1263e07-e1bd-4c9b-b855-a6ddd2429e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:41:10.273563 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-a1263e07-e1bd-4c9b-b855-a6ddd2429e7f None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:41:10.274763 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-a1263e07-e1bd-4c9b-b855-a6ddd2429e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:41:10.339588 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 597/1187] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:41:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:41:10.362431 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34e906-81f5-48a2-8d6d-ac76e445c070 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:41:10.458993 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34e906-81f5-48a2-8d6d-ac76e445c070 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:41:10.492650 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f994ed3-7625-4a84-bf74-eff5fd90d07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:41:10.493363 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f994ed3-7625-4a84-bf74-eff5fd90d07f None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:41:10.493639 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f994ed3-7625-4a84-bf74-eff5fd90d07f None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:41:10.493908 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f994ed3-7625-4a84-bf74-eff5fd90d07f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:41:10.506122 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f994ed3-7625-4a84-bf74-eff5fd90d07f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:41:10.513201 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-8f994ed3-7625-4a84-bf74-eff5fd90d07f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 20:41:10.514649 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 591/1188] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 20:41:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:41:10.520877 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1263e07-e1bd-4c9b-b855-a6ddd2429e7f None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:41:10.614250 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1263e07-e1bd-4c9b-b855-a6ddd2429e7f None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:41:10.646261 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba14ee4-d04e-417f-8c3b-3aa76a06fa9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:41:10.646913 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba14ee4-d04e-417f-8c3b-3aa76a06fa9d None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:41:10.647190 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba14ee4-d04e-417f-8c3b-3aa76a06fa9d None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:41:10.647460 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba14ee4-d04e-417f-8c3b-3aa76a06fa9d None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:41:10.648229 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba14ee4-d04e-417f-8c3b-3aa76a06fa9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:41:10.648532 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba14ee4-d04e-417f-8c3b-3aa76a06fa9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:41:10.649891 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba14ee4-d04e-417f-8c3b-3aa76a06fa9d None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:41:10.658234 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 598/1189] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:41:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:41:10.664458 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f994ed3-7625-4a84-bf74-eff5fd90d07f None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:41:10.760210 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f994ed3-7625-4a84-bf74-eff5fd90d07f None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:41:10.792600 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6322b918-0a33-466f-8faa-075ef73c7eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:41:10.793447 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322b918-0a33-466f-8faa-075ef73c7eba None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:41:10.793717 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322b918-0a33-466f-8faa-075ef73c7eba None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:41:10.793982 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322b918-0a33-466f-8faa-075ef73c7eba None admin] PATH_INFO: `/v3/users/2bd57325aafd45d9acf5917cf7c28c4e` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:41:10.795135 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6322b918-0a33-466f-8faa-075ef73c7eba None admin] RBAC: Authorizing `identity:get_user(user_id=2bd57325aafd45d9acf5917cf7c28c4e)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:41:10.797234 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6322b918-0a33-466f-8faa-075ef73c7eba None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:41:10.798821 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 592/1190] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:41:10 2022] GET /identity/v3/users/2bd57325aafd45d9acf5917cf7c28c4e => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:41:10.804602 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba14ee4-d04e-417f-8c3b-3aa76a06fa9d None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:41:10.900406 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba14ee4-d04e-417f-8c3b-3aa76a06fa9d None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:41:10.932584 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dcb3cc-b02a-400c-bfe5-28304a7b459b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:41:10.933430 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcb3cc-b02a-400c-bfe5-28304a7b459b None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:41:10.933702 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcb3cc-b02a-400c-bfe5-28304a7b459b None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:41:10.933972 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcb3cc-b02a-400c-bfe5-28304a7b459b None admin] PATH_INFO: `/v3/projects/41c6df69d6044049a54f27a300e6b012` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:41:10.935124 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dcb3cc-b02a-400c-bfe5-28304a7b459b None admin] RBAC: Authorizing `identity:get_project(project_id=41c6df69d6044049a54f27a300e6b012)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:41:10.936720 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dcb3cc-b02a-400c-bfe5-28304a7b459b None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:41:10.938420 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 599/1191] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:41:10 2022] GET /identity/v3/projects/41c6df69d6044049a54f27a300e6b012 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:41:10.944422 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6322b918-0a33-466f-8faa-075ef73c7eba None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:41:11.043154 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6322b918-0a33-466f-8faa-075ef73c7eba None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:41:11.076898 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe999269-d8f2-4130-89a0-45a16fd5d202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:41:11.077891 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe999269-d8f2-4130-89a0-45a16fd5d202 None admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:41:11.078093 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe999269-d8f2-4130-89a0-45a16fd5d202 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:41:11.078366 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe999269-d8f2-4130-89a0-45a16fd5d202 None admin] PATH_INFO: `/v3/projects/41c6df69d6044049a54f27a300e6b012/users/2bd57325aafd45d9acf5917cf7c28c4e/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:41:11.080374 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe999269-d8f2-4130-89a0-45a16fd5d202 None admin] RBAC: Authorizing `identity:create_grant(project_id=41c6df69d6044049a54f27a300e6b012, user_id=2bd57325aafd45d9acf5917cf7c28c4e, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:41:11.081815 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe999269-d8f2-4130-89a0-45a16fd5d202 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:41:11.094793 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 593/1192] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 20:41:10 2022] PUT /identity/v3/projects/41c6df69d6044049a54f27a300e6b012/users/2bd57325aafd45d9acf5917cf7c28c4e/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:41:13.444372 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6485e-9171-4d35-a51e-1890564f31e2 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:41:13.444916 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6485e-9171-4d35-a51e-1890564f31e2 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:41:13.444916 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6485e-9171-4d35-a51e-1890564f31e2 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:41:13.446667 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 600/1193] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:41:13.451980 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7e817-1515-4918-bb12-783ac61102ae None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:41:13.452523 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7e817-1515-4918-bb12-783ac61102ae None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:41:13.452696 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7e817-1515-4918-bb12-783ac61102ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:41:13.469197 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-cdc7e817-1515-4918-bb12-783ac61102ae None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:41:13.470358 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-cdc7e817-1515-4918-bb12-783ac61102ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:41:13.536018 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 594/1194] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:41:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 20:41:13.559929 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6485e-9171-4d35-a51e-1890564f31e2 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:41:13.656794 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6485e-9171-4d35-a51e-1890564f31e2 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:41:13.688889 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0461c47-1ddf-4646-8c87-45afb461d973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:41:13.689666 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0461c47-1ddf-4646-8c87-45afb461d973 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:41:13.689941 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0461c47-1ddf-4646-8c87-45afb461d973 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:41:13.690208 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0461c47-1ddf-4646-8c87-45afb461d973 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:41:13.700724 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0461c47-1ddf-4646-8c87-45afb461d973 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:41:13.707826 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-d0461c47-1ddf-4646-8c87-45afb461d973 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 20:41:13.709101 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 601/1195] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 20:41:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:41:13.715364 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7e817-1515-4918-bb12-783ac61102ae None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:41:13.811077 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7e817-1515-4918-bb12-783ac61102ae None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:41:13.844719 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ac64a-81ad-480b-81b9-78061356382d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:41:13.845378 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ac64a-81ad-480b-81b9-78061356382d None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:41:13.845651 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ac64a-81ad-480b-81b9-78061356382d None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:41:13.845916 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ac64a-81ad-480b-81b9-78061356382d None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:41:13.846664 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ac64a-81ad-480b-81b9-78061356382d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:41:13.846966 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ac64a-81ad-480b-81b9-78061356382d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:41:13.848379 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ac64a-81ad-480b-81b9-78061356382d None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:41:13.856621 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 595/1196] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:41:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:41:13.863134 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0461c47-1ddf-4646-8c87-45afb461d973 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:41:13.958664 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0461c47-1ddf-4646-8c87-45afb461d973 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:41:13.991022 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac922b68-7642-47c8-b6c9-8e939bc43b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:41:13.991907 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac922b68-7642-47c8-b6c9-8e939bc43b26 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:41:13.992185 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac922b68-7642-47c8-b6c9-8e939bc43b26 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:41:13.992455 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac922b68-7642-47c8-b6c9-8e939bc43b26 None admin] PATH_INFO: `/v3/users/2bd57325aafd45d9acf5917cf7c28c4e` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:41:13.993622 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac922b68-7642-47c8-b6c9-8e939bc43b26 None admin] RBAC: Authorizing `identity:get_user(user_id=2bd57325aafd45d9acf5917cf7c28c4e)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:41:13.995043 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac922b68-7642-47c8-b6c9-8e939bc43b26 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:41:13.996682 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 602/1197] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 20:41:13 2022] GET /identity/v3/users/2bd57325aafd45d9acf5917cf7c28c4e => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:41:14.002795 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ac64a-81ad-480b-81b9-78061356382d None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:41:14.099209 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ac64a-81ad-480b-81b9-78061356382d None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:41:14.130963 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a7306-5552-4ea9-b5b4-a8c92dd73f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:41:14.131602 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a7306-5552-4ea9-b5b4-a8c92dd73f97 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:41:14.131911 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a7306-5552-4ea9-b5b4-a8c92dd73f97 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:41:14.132184 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a7306-5552-4ea9-b5b4-a8c92dd73f97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:41:14.198879 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a7306-5552-4ea9-b5b4-a8c92dd73f97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:41:14.200373 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a7306-5552-4ea9-b5b4-a8c92dd73f97 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:41:14.297208 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 596/1198] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:41:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 28 20:41:14.303519 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac922b68-7642-47c8-b6c9-8e939bc43b26 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:41:14.399885 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac922b68-7642-47c8-b6c9-8e939bc43b26 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:41:14.432424 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568eba7-4433-4207-a6ae-23c89052f8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:41:14.433262 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568eba7-4433-4207-a6ae-23c89052f8de None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:41:14.433539 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568eba7-4433-4207-a6ae-23c89052f8de None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:41:14.433808 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568eba7-4433-4207-a6ae-23c89052f8de None admin] PATH_INFO: `/v3/projects/41c6df69d6044049a54f27a300e6b012` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:41:14.434956 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568eba7-4433-4207-a6ae-23c89052f8de None admin] RBAC: Authorizing `identity:get_project(project_id=41c6df69d6044049a54f27a300e6b012)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:41:14.436640 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568eba7-4433-4207-a6ae-23c89052f8de None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:41:14.438447 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 603/1199] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 20:41:14 2022] GET /identity/v3/projects/41c6df69d6044049a54f27a300e6b012 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:41:14.444692 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a7306-5552-4ea9-b5b4-a8c92dd73f97 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:41:14.540727 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a7306-5552-4ea9-b5b4-a8c92dd73f97 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:41:14.573534 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d6026-a215-4b31-a900-875159c82ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:41:14.574180 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d6026-a215-4b31-a900-875159c82ee7 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:41:14.574457 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d6026-a215-4b31-a900-875159c82ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:41:14.574725 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d6026-a215-4b31-a900-875159c82ee7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:41:14.575539 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d6026-a215-4b31-a900-875159c82ee7 None admin] RBAC: Adding query filter params (role.id=8fe105eeb7bf4856a94b0633bd781414, scope.project.id=41c6df69d6044049a54f27a300e6b012, user.id=2bd57325aafd45d9acf5917cf7c28c4e) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:41:14.575875 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d6026-a215-4b31-a900-875159c82ee7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:41:14.577332 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d6026-a215-4b31-a900-875159c82ee7 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:41:14.583046 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 597/1200] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:41:14 2022] GET /identity/v3/role_assignments?user.id=2bd57325aafd45d9acf5917cf7c28c4e&scope.project.id=41c6df69d6044049a54f27a300e6b012&role.id=8fe105eeb7bf4856a94b0633bd781414 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:42:20.160141 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4d12d-8607-412a-8ecc-c0e5a969de80 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:20.161074 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4d12d-8607-412a-8ecc-c0e5a969de80 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:20.161074 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4d12d-8607-412a-8ecc-c0e5a969de80 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:20.162799 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 604/1201] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:42:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:42:20.171907 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a48c4-c137-4be4-8b08-d704ae8c3846 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:20.171907 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a48c4-c137-4be4-8b08-d704ae8c3846 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:20.171907 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a48c4-c137-4be4-8b08-d704ae8c3846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:20.212046 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-578a48c4-c137-4be4-8b08-d704ae8c3846 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:42:20.214193 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-578a48c4-c137-4be4-8b08-d704ae8c3846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:42:20.344300 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 598/1202] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:42:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 20:42:20.370283 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4d12d-8607-412a-8ecc-c0e5a969de80 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:20.552529 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4d12d-8607-412a-8ecc-c0e5a969de80 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:20.617665 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09aa63-5ed3-4b0e-8885-60a624b63b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:20.618483 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09aa63-5ed3-4b0e-8885-60a624b63b6a None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:20.618771 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09aa63-5ed3-4b0e-8885-60a624b63b6a None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:20.619051 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09aa63-5ed3-4b0e-8885-60a624b63b6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:20.635707 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09aa63-5ed3-4b0e-8885-60a624b63b6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:20.638720 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09aa63-5ed3-4b0e-8885-60a624b63b6a None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:20.666957 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-5c09aa63-5ed3-4b0e-8885-60a624b63b6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:42:20.670925 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 605/1203] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:42:20.679658 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a48c4-c137-4be4-8b08-d704ae8c3846 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:20.836304 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a48c4-c137-4be4-8b08-d704ae8c3846 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:20.887538 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de869f6-6bb0-4de4-aa7d-f6bf63b88fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:20.889034 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de869f6-6bb0-4de4-aa7d-f6bf63b88fde None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:20.889658 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de869f6-6bb0-4de4-aa7d-f6bf63b88fde None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:20.890266 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de869f6-6bb0-4de4-aa7d-f6bf63b88fde None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:20.891307 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de869f6-6bb0-4de4-aa7d-f6bf63b88fde None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:42:20.891719 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de869f6-6bb0-4de4-aa7d-f6bf63b88fde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:20.893738 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de869f6-6bb0-4de4-aa7d-f6bf63b88fde None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:20.915785 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 599/1204] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:42:20.920897 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09aa63-5ed3-4b0e-8885-60a624b63b6a None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:21.105302 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09aa63-5ed3-4b0e-8885-60a624b63b6a None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:21.165766 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1b7a9-5da9-4447-a84f-f4e68d53baf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:21.165766 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1b7a9-5da9-4447-a84f-f4e68d53baf7 None admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:21.165766 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1b7a9-5da9-4447-a84f-f4e68d53baf7 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:21.165766 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1b7a9-5da9-4447-a84f-f4e68d53baf7 None admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:21.167083 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1b7a9-5da9-4447-a84f-f4e68d53baf7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:21.167571 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1b7a9-5da9-4447-a84f-f4e68d53baf7 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:21.196317 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 606/1205] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Oct 28 20:42:20 2022] POST /identity/v3/users => generated 251 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:42:24.915773 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e2bd5-7616-40ca-8125-fb270bbe2b4c None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:24.915773 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e2bd5-7616-40ca-8125-fb270bbe2b4c None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:24.917273 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e2bd5-7616-40ca-8125-fb270bbe2b4c None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:24.921074 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 600/1206] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:42:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:42:24.930141 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd547bb-ae8b-4893-b9e8-b382ca0a9f69 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:24.930141 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd547bb-ae8b-4893-b9e8-b382ca0a9f69 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:24.930141 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd547bb-ae8b-4893-b9e8-b382ca0a9f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:24.951273 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-1fd547bb-ae8b-4893-b9e8-b382ca0a9f69 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:42:24.952901 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-1fd547bb-ae8b-4893-b9e8-b382ca0a9f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:42:25.068278 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 607/1207] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:42:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 20:42:25.096501 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e2bd5-7616-40ca-8125-fb270bbe2b4c None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:25.266870 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e2bd5-7616-40ca-8125-fb270bbe2b4c None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:25.328977 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60430e06-7481-4d56-9653-55c673ecc024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:25.330168 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60430e06-7481-4d56-9653-55c673ecc024 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:25.330549 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60430e06-7481-4d56-9653-55c673ecc024 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:25.330963 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60430e06-7481-4d56-9653-55c673ecc024 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:25.346017 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60430e06-7481-4d56-9653-55c673ecc024 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:42:25.354683 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-60430e06-7481-4d56-9653-55c673ecc024 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 20:42:25.355993 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 601/1208] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 20:42:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:42:25.364487 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd547bb-ae8b-4893-b9e8-b382ca0a9f69 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:25.527794 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd547bb-ae8b-4893-b9e8-b382ca0a9f69 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:25.583149 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19aa7e-85dc-4d7c-a5ed-007828761f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:25.584795 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19aa7e-85dc-4d7c-a5ed-007828761f7d None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:25.584795 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19aa7e-85dc-4d7c-a5ed-007828761f7d None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:25.584795 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19aa7e-85dc-4d7c-a5ed-007828761f7d None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:25.585167 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19aa7e-85dc-4d7c-a5ed-007828761f7d None admin] RBAC: Adding query filter params (name=service) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:42:25.585469 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19aa7e-85dc-4d7c-a5ed-007828761f7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:25.587182 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19aa7e-85dc-4d7c-a5ed-007828761f7d None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:25.600027 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 608/1209] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 20:42:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:42:25.606119 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60430e06-7481-4d56-9653-55c673ecc024 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:25.745301 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60430e06-7481-4d56-9653-55c673ecc024 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:25.807429 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8cc4bd-2504-487d-be83-3d862030f628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:25.808931 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8cc4bd-2504-487d-be83-3d862030f628 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:25.810009 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8cc4bd-2504-487d-be83-3d862030f628 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:25.810553 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8cc4bd-2504-487d-be83-3d862030f628 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:25.831395 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8cc4bd-2504-487d-be83-3d862030f628 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:25.833292 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8cc4bd-2504-487d-be83-3d862030f628 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:25.863653 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-ba8cc4bd-2504-487d-be83-3d862030f628 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:42:25.870447 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 602/1210] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:42:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:42:25.873012 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19aa7e-85dc-4d7c-a5ed-007828761f7d None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:26.024328 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19aa7e-85dc-4d7c-a5ed-007828761f7d None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:26.071894 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f869a3d-fb6a-4dbc-97d3-fd523c8662e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:26.072632 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f869a3d-fb6a-4dbc-97d3-fd523c8662e6 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:26.072960 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f869a3d-fb6a-4dbc-97d3-fd523c8662e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:26.073273 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f869a3d-fb6a-4dbc-97d3-fd523c8662e6 None admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:26.074087 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f869a3d-fb6a-4dbc-97d3-fd523c8662e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:42:26.074444 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f869a3d-fb6a-4dbc-97d3-fd523c8662e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:26.076409 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f869a3d-fb6a-4dbc-97d3-fd523c8662e6 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:26.092707 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 609/1211] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:42:26.099421 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8cc4bd-2504-487d-be83-3d862030f628 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:26.278445 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8cc4bd-2504-487d-be83-3d862030f628 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:26.318093 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1f093-0a4a-43d2-8f87-c0a2d60f3f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:26.318901 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1f093-0a4a-43d2-8f87-c0a2d60f3f7c None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:26.319177 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1f093-0a4a-43d2-8f87-c0a2d60f3f7c None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:26.319449 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1f093-0a4a-43d2-8f87-c0a2d60f3f7c None admin] PATH_INFO: `/v3/users/placement` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:26.328815 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e1f093-0a4a-43d2-8f87-c0a2d60f3f7c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:26.330360 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e1f093-0a4a-43d2-8f87-c0a2d60f3f7c None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:26.348282 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-d3e1f093-0a4a-43d2-8f87-c0a2d60f3f7c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 20:42:26.354781 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 603/1212] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:42:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:42:26.355794 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f869a3d-fb6a-4dbc-97d3-fd523c8662e6 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:26.483388 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f869a3d-fb6a-4dbc-97d3-fd523c8662e6 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:26.522072 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9e5dc-2b47-41f4-b8f9-3aaa63b6285c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:26.523212 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9e5dc-2b47-41f4-b8f9-3aaa63b6285c None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:26.523711 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9e5dc-2b47-41f4-b8f9-3aaa63b6285c None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:26.524255 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9e5dc-2b47-41f4-b8f9-3aaa63b6285c None admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:26.525461 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9e5dc-2b47-41f4-b8f9-3aaa63b6285c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:42:26.525942 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9e5dc-2b47-41f4-b8f9-3aaa63b6285c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:26.527684 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9e5dc-2b47-41f4-b8f9-3aaa63b6285c None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:26.549508 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 610/1213] 10.222.0.49 () {56 vars in 1143 bytes} [Fri Oct 28 20:42:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:42:26.558993 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1f093-0a4a-43d2-8f87-c0a2d60f3f7c None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:26.737432 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1f093-0a4a-43d2-8f87-c0a2d60f3f7c None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:26.790546 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4c240-4460-4462-8d19-18b0a1d98df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:26.791991 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4c240-4460-4462-8d19-18b0a1d98df8 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:26.792574 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4c240-4460-4462-8d19-18b0a1d98df8 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:26.793241 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4c240-4460-4462-8d19-18b0a1d98df8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:26.879391 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4c240-4460-4462-8d19-18b0a1d98df8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:26.881224 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4c240-4460-4462-8d19-18b0a1d98df8 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:27.021912 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 604/1214] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:42:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 20:42:27.025918 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9e5dc-2b47-41f4-b8f9-3aaa63b6285c None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:27.179940 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9e5dc-2b47-41f4-b8f9-3aaa63b6285c None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:27.238960 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ffcf2-88f2-4990-b20d-e5dd6945fed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:27.239795 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ffcf2-88f2-4990-b20d-e5dd6945fed2 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:27.240089 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ffcf2-88f2-4990-b20d-e5dd6945fed2 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:27.240482 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ffcf2-88f2-4990-b20d-e5dd6945fed2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:27.256371 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ffcf2-88f2-4990-b20d-e5dd6945fed2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:27.257866 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ffcf2-88f2-4990-b20d-e5dd6945fed2 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:27.276883 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-0e5ffcf2-88f2-4990-b20d-e5dd6945fed2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:42:27.279097 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 611/1215] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:42:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:42:27.285228 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4c240-4460-4462-8d19-18b0a1d98df8 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:27.414803 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4c240-4460-4462-8d19-18b0a1d98df8 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:27.468192 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14881eb2-d373-4730-bc88-305f138d335e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:27.469569 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14881eb2-d373-4730-bc88-305f138d335e None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:27.470004 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14881eb2-d373-4730-bc88-305f138d335e None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:27.470502 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14881eb2-d373-4730-bc88-305f138d335e None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:27.471964 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14881eb2-d373-4730-bc88-305f138d335e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:42:27.472511 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14881eb2-d373-4730-bc88-305f138d335e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:27.475618 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14881eb2-d373-4730-bc88-305f138d335e None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:27.501062 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 605/1216] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:42:27.513152 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ffcf2-88f2-4990-b20d-e5dd6945fed2 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:27.689995 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ffcf2-88f2-4990-b20d-e5dd6945fed2 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:27.748551 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e552829-0488-4387-8db5-1b713188057d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:27.749866 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e552829-0488-4387-8db5-1b713188057d None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:27.750359 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e552829-0488-4387-8db5-1b713188057d None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:27.750852 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e552829-0488-4387-8db5-1b713188057d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:27.761904 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e552829-0488-4387-8db5-1b713188057d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:27.766271 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e552829-0488-4387-8db5-1b713188057d None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:27.789597 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-5e552829-0488-4387-8db5-1b713188057d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 20:42:27.791431 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 612/1217] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:42:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:42:27.799931 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14881eb2-d373-4730-bc88-305f138d335e None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:27.994871 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14881eb2-d373-4730-bc88-305f138d335e None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:28.052596 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464a7a2-09dc-4cdb-9811-abc3efdaf7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:28.053804 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464a7a2-09dc-4cdb-9811-abc3efdaf7b8 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:28.054304 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464a7a2-09dc-4cdb-9811-abc3efdaf7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:28.054806 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464a7a2-09dc-4cdb-9811-abc3efdaf7b8 None admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:28.056128 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f464a7a2-09dc-4cdb-9811-abc3efdaf7b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:42:28.056655 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f464a7a2-09dc-4cdb-9811-abc3efdaf7b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:28.059884 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f464a7a2-09dc-4cdb-9811-abc3efdaf7b8 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:28.079580 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 606/1218] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 20:42:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:42:28.087430 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e552829-0488-4387-8db5-1b713188057d None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:28.265851 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e552829-0488-4387-8db5-1b713188057d None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:28.309719 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c448880-13b6-4581-8013-8c12d10ad492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:28.310550 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c448880-13b6-4581-8013-8c12d10ad492 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:28.310888 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c448880-13b6-4581-8013-8c12d10ad492 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:28.311162 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c448880-13b6-4581-8013-8c12d10ad492 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:28.312178 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c448880-13b6-4581-8013-8c12d10ad492 None admin] RBAC: Adding query filter params (role.id=7190d40a528146289333f0b9c16a6370, scope.project.id=c55c2ee59af14cf8a7e4275de4f43037, user.id=938634e835b94a75af698aef6941958f) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:42:28.312495 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c448880-13b6-4581-8013-8c12d10ad492 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:28.313954 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c448880-13b6-4581-8013-8c12d10ad492 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:28.321876 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 613/1219] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:42:28 2022] GET /identity/v3/role_assignments?user.id=938634e835b94a75af698aef6941958f&scope.project.id=c55c2ee59af14cf8a7e4275de4f43037&role.id=7190d40a528146289333f0b9c16a6370 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:42:31.038065 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abe77b-993a-449e-a8e6-386580454cb3 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:31.038663 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abe77b-993a-449e-a8e6-386580454cb3 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:31.038663 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abe77b-993a-449e-a8e6-386580454cb3 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:31.040548 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 607/1220] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:42:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:42:31.048079 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9c9ad-f4b3-4ee4-bcf8-d118c497c0fe None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:31.048623 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9c9ad-f4b3-4ee4-bcf8-d118c497c0fe None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:31.048847 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9c9ad-f4b3-4ee4-bcf8-d118c497c0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:31.073927 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-caa9c9ad-f4b3-4ee4-bcf8-d118c497c0fe None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:42:31.076045 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-caa9c9ad-f4b3-4ee4-bcf8-d118c497c0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:42:31.160939 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 614/1221] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:42:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:42:31.185930 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15abe77b-993a-449e-a8e6-386580454cb3 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:31.341592 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15abe77b-993a-449e-a8e6-386580454cb3 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:31.385989 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f5748-8c7d-4ee5-912b-e977e9c77d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:31.386811 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f5748-8c7d-4ee5-912b-e977e9c77d04 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:31.387093 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f5748-8c7d-4ee5-912b-e977e9c77d04 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:31.387364 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f5748-8c7d-4ee5-912b-e977e9c77d04 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:31.399228 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f5748-8c7d-4ee5-912b-e977e9c77d04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:42:31.406356 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-ec1f5748-8c7d-4ee5-912b-e977e9c77d04 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 20:42:31.407865 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 608/1222] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 20:42:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:42:31.415128 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9c9ad-f4b3-4ee4-bcf8-d118c497c0fe None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:31.553186 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9c9ad-f4b3-4ee4-bcf8-d118c497c0fe None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:31.590006 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352c36f-11f6-4374-8793-17366c3fff88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:31.591172 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352c36f-11f6-4374-8793-17366c3fff88 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:31.591451 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352c36f-11f6-4374-8793-17366c3fff88 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:31.591892 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352c36f-11f6-4374-8793-17366c3fff88 None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:31.592599 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352c36f-11f6-4374-8793-17366c3fff88 None admin] RBAC: Adding query filter params (name=service) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:42:31.592904 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352c36f-11f6-4374-8793-17366c3fff88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:31.594280 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352c36f-11f6-4374-8793-17366c3fff88 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:31.604965 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 615/1223] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 20:42:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:42:31.618325 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f5748-8c7d-4ee5-912b-e977e9c77d04 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:31.772545 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f5748-8c7d-4ee5-912b-e977e9c77d04 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:31.816293 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b139a2-290b-4e8a-b00e-1d15a890cba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:31.817518 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b139a2-290b-4e8a-b00e-1d15a890cba9 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:31.817932 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b139a2-290b-4e8a-b00e-1d15a890cba9 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:31.818393 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b139a2-290b-4e8a-b00e-1d15a890cba9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:31.835484 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b139a2-290b-4e8a-b00e-1d15a890cba9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:31.837990 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b139a2-290b-4e8a-b00e-1d15a890cba9 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:31.859883 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-12b139a2-290b-4e8a-b00e-1d15a890cba9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:42:31.861091 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 609/1224] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:42:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:42:31.867479 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352c36f-11f6-4374-8793-17366c3fff88 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:31.990206 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352c36f-11f6-4374-8793-17366c3fff88 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:32.034820 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9acf22-35d6-45e3-a773-e64e11137253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:32.035480 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9acf22-35d6-45e3-a773-e64e11137253 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:32.035758 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9acf22-35d6-45e3-a773-e64e11137253 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:32.036048 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9acf22-35d6-45e3-a773-e64e11137253 None admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:32.036793 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9acf22-35d6-45e3-a773-e64e11137253 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:42:32.037105 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9acf22-35d6-45e3-a773-e64e11137253 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:32.038565 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9acf22-35d6-45e3-a773-e64e11137253 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:32.052056 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 616/1225] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:42:32.057680 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b139a2-290b-4e8a-b00e-1d15a890cba9 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:32.195092 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b139a2-290b-4e8a-b00e-1d15a890cba9 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:32.240886 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a893971-560f-4648-ae05-b094425a81f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:32.242240 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a893971-560f-4648-ae05-b094425a81f2 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:32.242717 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a893971-560f-4648-ae05-b094425a81f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:32.243188 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a893971-560f-4648-ae05-b094425a81f2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:32.258415 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a893971-560f-4648-ae05-b094425a81f2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:32.260047 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a893971-560f-4648-ae05-b094425a81f2 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:32.278315 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-2a893971-560f-4648-ae05-b094425a81f2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 20:42:32.280597 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 610/1226] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:42:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:42:32.288559 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9acf22-35d6-45e3-a773-e64e11137253 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:32.421417 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9acf22-35d6-45e3-a773-e64e11137253 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:32.464790 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace28fb6-e657-4c61-b8be-cf94847aaabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:32.465503 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace28fb6-e657-4c61-b8be-cf94847aaabe None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:32.465784 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace28fb6-e657-4c61-b8be-cf94847aaabe None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:32.466060 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace28fb6-e657-4c61-b8be-cf94847aaabe None admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:32.467035 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace28fb6-e657-4c61-b8be-cf94847aaabe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:42:32.467331 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace28fb6-e657-4c61-b8be-cf94847aaabe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:32.468873 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace28fb6-e657-4c61-b8be-cf94847aaabe None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:32.491253 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 617/1227] 10.222.0.49 () {56 vars in 1143 bytes} [Fri Oct 28 20:42:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:42:32.502118 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a893971-560f-4648-ae05-b094425a81f2 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:32.645092 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a893971-560f-4648-ae05-b094425a81f2 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:32.691325 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770de7c8-be10-49b3-9a66-c82b0924a19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:32.692211 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770de7c8-be10-49b3-9a66-c82b0924a19c None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:32.692725 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770de7c8-be10-49b3-9a66-c82b0924a19c None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:32.693086 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770de7c8-be10-49b3-9a66-c82b0924a19c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:32.707009 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770de7c8-be10-49b3-9a66-c82b0924a19c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:32.708594 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770de7c8-be10-49b3-9a66-c82b0924a19c None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:32.730514 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-770de7c8-be10-49b3-9a66-c82b0924a19c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:42:32.732332 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 611/1228] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:42:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:42:32.738911 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace28fb6-e657-4c61-b8be-cf94847aaabe None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:32.881814 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace28fb6-e657-4c61-b8be-cf94847aaabe None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:32.920180 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc5091-10a0-47c4-a894-c0fa30f18c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:32.920845 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc5091-10a0-47c4-a894-c0fa30f18c4a None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:32.921155 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc5091-10a0-47c4-a894-c0fa30f18c4a None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:32.921426 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc5091-10a0-47c4-a894-c0fa30f18c4a None admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:32.922173 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc5091-10a0-47c4-a894-c0fa30f18c4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:42:32.922439 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc5091-10a0-47c4-a894-c0fa30f18c4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:32.930323 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc5091-10a0-47c4-a894-c0fa30f18c4a None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:32.936728 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 618/1229] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:42:32.943470 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770de7c8-be10-49b3-9a66-c82b0924a19c None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:33.081251 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770de7c8-be10-49b3-9a66-c82b0924a19c None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:33.120152 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ccc6f3-7dce-4a00-b14b-0444d6bd80fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:33.121249 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ccc6f3-7dce-4a00-b14b-0444d6bd80fa None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:33.122149 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ccc6f3-7dce-4a00-b14b-0444d6bd80fa None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:33.122600 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ccc6f3-7dce-4a00-b14b-0444d6bd80fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:33.134441 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ccc6f3-7dce-4a00-b14b-0444d6bd80fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:33.136673 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ccc6f3-7dce-4a00-b14b-0444d6bd80fa None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:33.154772 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-84ccc6f3-7dce-4a00-b14b-0444d6bd80fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 20:42:33.156339 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 612/1230] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:42:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:42:33.163395 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc5091-10a0-47c4-a894-c0fa30f18c4a None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:33.319233 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc5091-10a0-47c4-a894-c0fa30f18c4a None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:33.367214 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b06b7b-0bd4-4e2e-9300-17218b094938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:33.367833 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b06b7b-0bd4-4e2e-9300-17218b094938 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:33.368115 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b06b7b-0bd4-4e2e-9300-17218b094938 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:33.368387 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b06b7b-0bd4-4e2e-9300-17218b094938 None admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:33.369835 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b06b7b-0bd4-4e2e-9300-17218b094938 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:42:33.369835 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b06b7b-0bd4-4e2e-9300-17218b094938 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:33.370930 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b06b7b-0bd4-4e2e-9300-17218b094938 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:33.384905 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 619/1231] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 20:42:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:42:33.392035 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ccc6f3-7dce-4a00-b14b-0444d6bd80fa None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:33.536397 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ccc6f3-7dce-4a00-b14b-0444d6bd80fa None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:33.580834 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16506d87-b74d-4f74-955b-c6f9956736b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:33.581773 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16506d87-b74d-4f74-955b-c6f9956736b0 None admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:33.582008 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16506d87-b74d-4f74-955b-c6f9956736b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:33.582279 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16506d87-b74d-4f74-955b-c6f9956736b0 None admin] PATH_INFO: `/v3/projects/c55c2ee59af14cf8a7e4275de4f43037/users/938634e835b94a75af698aef6941958f/roles/7190d40a528146289333f0b9c16a6370` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:33.603172 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16506d87-b74d-4f74-955b-c6f9956736b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=c55c2ee59af14cf8a7e4275de4f43037, user_id=938634e835b94a75af698aef6941958f, role_id=7190d40a528146289333f0b9c16a6370)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:33.604682 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16506d87-b74d-4f74-955b-c6f9956736b0 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:33.619434 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 613/1232] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 20:42:33 2022] PUT /identity/v3/projects/c55c2ee59af14cf8a7e4275de4f43037/users/938634e835b94a75af698aef6941958f/roles/7190d40a528146289333f0b9c16a6370 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:42:36.139641 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c209d83-a998-47a1-b704-db35ae8cc36a None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:36.140312 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c209d83-a998-47a1-b704-db35ae8cc36a None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:36.140409 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c209d83-a998-47a1-b704-db35ae8cc36a None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:36.142368 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 620/1233] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:42:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:42:36.148688 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce4549-f892-4b35-8f40-2b26b300054d None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:36.149280 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce4549-f892-4b35-8f40-2b26b300054d None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:36.149280 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce4549-f892-4b35-8f40-2b26b300054d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:36.172132 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-52ce4549-f892-4b35-8f40-2b26b300054d None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:42:36.173610 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-52ce4549-f892-4b35-8f40-2b26b300054d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:42:36.259581 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 614/1234] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:42:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:42:36.284817 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c209d83-a998-47a1-b704-db35ae8cc36a None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:36.414484 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c209d83-a998-47a1-b704-db35ae8cc36a None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:36.455608 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5d7af-800a-4292-aee4-c81cf93d915f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:36.456729 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5d7af-800a-4292-aee4-c81cf93d915f None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:36.457010 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5d7af-800a-4292-aee4-c81cf93d915f None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:36.457281 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5d7af-800a-4292-aee4-c81cf93d915f None admin] PATH_INFO: `/v3/roles/service` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:36.471326 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5d7af-800a-4292-aee4-c81cf93d915f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:42:36.480421 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-37e5d7af-800a-4292-aee4-c81cf93d915f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 20:42:36.487716 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 621/1235] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 20:42:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:42:36.490607 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce4549-f892-4b35-8f40-2b26b300054d None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:36.614991 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce4549-f892-4b35-8f40-2b26b300054d None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:36.661977 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23123625-2ff5-488a-870e-38fbf4b6b372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:36.662931 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23123625-2ff5-488a-870e-38fbf4b6b372 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:36.663255 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23123625-2ff5-488a-870e-38fbf4b6b372 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:36.663550 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23123625-2ff5-488a-870e-38fbf4b6b372 None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:36.664695 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23123625-2ff5-488a-870e-38fbf4b6b372 None admin] RBAC: Adding query filter params (name=service) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:42:36.665000 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23123625-2ff5-488a-870e-38fbf4b6b372 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:36.666477 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23123625-2ff5-488a-870e-38fbf4b6b372 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:36.678004 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 615/1236] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 20:42:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:42:36.685434 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5d7af-800a-4292-aee4-c81cf93d915f None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:36.813718 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5d7af-800a-4292-aee4-c81cf93d915f None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:36.864340 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775da636-8d04-4877-9ef7-9033cbc5d51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:36.865404 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775da636-8d04-4877-9ef7-9033cbc5d51b None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:36.865853 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775da636-8d04-4877-9ef7-9033cbc5d51b None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:36.866351 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775da636-8d04-4877-9ef7-9033cbc5d51b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:36.883381 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775da636-8d04-4877-9ef7-9033cbc5d51b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:36.885649 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775da636-8d04-4877-9ef7-9033cbc5d51b None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:36.905648 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-775da636-8d04-4877-9ef7-9033cbc5d51b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:42:36.907502 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 622/1237] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:42:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:42:36.913898 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23123625-2ff5-488a-870e-38fbf4b6b372 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:37.041989 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23123625-2ff5-488a-870e-38fbf4b6b372 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:37.100278 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006d2b1-ee6f-49cd-8a6c-4ad13abf0586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:37.104933 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006d2b1-ee6f-49cd-8a6c-4ad13abf0586 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:37.104933 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006d2b1-ee6f-49cd-8a6c-4ad13abf0586 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:37.104933 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006d2b1-ee6f-49cd-8a6c-4ad13abf0586 None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:37.104933 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1006d2b1-ee6f-49cd-8a6c-4ad13abf0586 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:42:37.104933 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1006d2b1-ee6f-49cd-8a6c-4ad13abf0586 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:37.104933 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1006d2b1-ee6f-49cd-8a6c-4ad13abf0586 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:37.119476 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 616/1238] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:42:37.128910 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775da636-8d04-4877-9ef7-9033cbc5d51b None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:37.271299 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775da636-8d04-4877-9ef7-9033cbc5d51b None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:37.319076 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae082852-67dd-494c-91e7-206555e1d5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:37.320187 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae082852-67dd-494c-91e7-206555e1d5a1 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:37.320690 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae082852-67dd-494c-91e7-206555e1d5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:37.321208 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae082852-67dd-494c-91e7-206555e1d5a1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:37.342309 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae082852-67dd-494c-91e7-206555e1d5a1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:37.343985 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae082852-67dd-494c-91e7-206555e1d5a1 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:37.360226 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-ae082852-67dd-494c-91e7-206555e1d5a1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 20:42:37.361619 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 623/1239] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:42:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:42:37.369735 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006d2b1-ee6f-49cd-8a6c-4ad13abf0586 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:37.512418 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006d2b1-ee6f-49cd-8a6c-4ad13abf0586 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:37.562206 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4520639-3078-4003-be97-560781eb3f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:37.562909 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4520639-3078-4003-be97-560781eb3f34 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:37.563311 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4520639-3078-4003-be97-560781eb3f34 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:37.563725 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4520639-3078-4003-be97-560781eb3f34 None admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:37.564895 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4520639-3078-4003-be97-560781eb3f34 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:42:37.565283 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4520639-3078-4003-be97-560781eb3f34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:37.567143 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4520639-3078-4003-be97-560781eb3f34 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:37.590610 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 617/1240] 10.222.0.49 () {56 vars in 1143 bytes} [Fri Oct 28 20:42:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:42:37.596737 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae082852-67dd-494c-91e7-206555e1d5a1 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:37.745693 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae082852-67dd-494c-91e7-206555e1d5a1 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:37.790734 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd00571-099c-484c-8823-8922e47d6497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:37.791385 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd00571-099c-484c-8823-8922e47d6497 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:37.791672 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd00571-099c-484c-8823-8922e47d6497 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:37.791961 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd00571-099c-484c-8823-8922e47d6497 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:37.896524 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd00571-099c-484c-8823-8922e47d6497 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:37.898817 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd00571-099c-484c-8823-8922e47d6497 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:38.047413 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 624/1241] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:42:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 20:42:38.054478 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4520639-3078-4003-be97-560781eb3f34 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:38.178732 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4520639-3078-4003-be97-560781eb3f34 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:38.216017 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8b031-f2ab-46a8-8ad5-c314003dbb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:38.216919 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8b031-f2ab-46a8-8ad5-c314003dbb67 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:38.217301 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8b031-f2ab-46a8-8ad5-c314003dbb67 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:38.217714 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8b031-f2ab-46a8-8ad5-c314003dbb67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:38.234543 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8b031-f2ab-46a8-8ad5-c314003dbb67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:38.237242 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8b031-f2ab-46a8-8ad5-c314003dbb67 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:38.269328 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-79f8b031-f2ab-46a8-8ad5-c314003dbb67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:42:38.271584 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 618/1242] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:42:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:42:38.278337 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd00571-099c-484c-8823-8922e47d6497 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:38.424572 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd00571-099c-484c-8823-8922e47d6497 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:38.470075 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9495d-2623-4035-bee7-8a279d98df3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:38.471011 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9495d-2623-4035-bee7-8a279d98df3b None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:38.471279 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9495d-2623-4035-bee7-8a279d98df3b None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:38.471587 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9495d-2623-4035-bee7-8a279d98df3b None admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:38.472612 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c9495d-2623-4035-bee7-8a279d98df3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:42:38.473152 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c9495d-2623-4035-bee7-8a279d98df3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:38.474811 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c9495d-2623-4035-bee7-8a279d98df3b None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:38.488215 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 625/1243] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:42:38.495558 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8b031-f2ab-46a8-8ad5-c314003dbb67 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:38.618748 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8b031-f2ab-46a8-8ad5-c314003dbb67 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:38.666790 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29feae-2a62-47e6-9d06-8df9caddcbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:38.668673 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29feae-2a62-47e6-9d06-8df9caddcbf8 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:38.669048 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29feae-2a62-47e6-9d06-8df9caddcbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:38.669557 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29feae-2a62-47e6-9d06-8df9caddcbf8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:38.683105 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb29feae-2a62-47e6-9d06-8df9caddcbf8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:38.685362 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb29feae-2a62-47e6-9d06-8df9caddcbf8 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:38.703759 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-eb29feae-2a62-47e6-9d06-8df9caddcbf8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 20:42:38.705160 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 619/1244] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:42:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:42:38.712646 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9495d-2623-4035-bee7-8a279d98df3b None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:38.849729 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9495d-2623-4035-bee7-8a279d98df3b None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:38.896867 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734e665-e1dd-44b0-88d2-23deab6fdd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:38.897726 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734e665-e1dd-44b0-88d2-23deab6fdd9c None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:38.898135 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734e665-e1dd-44b0-88d2-23deab6fdd9c None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:38.898578 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734e665-e1dd-44b0-88d2-23deab6fdd9c None admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:38.900237 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3734e665-e1dd-44b0-88d2-23deab6fdd9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:42:38.900653 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3734e665-e1dd-44b0-88d2-23deab6fdd9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:38.903160 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3734e665-e1dd-44b0-88d2-23deab6fdd9c None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:38.919960 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 626/1245] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 20:42:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:42:38.926409 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29feae-2a62-47e6-9d06-8df9caddcbf8 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:39.056288 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29feae-2a62-47e6-9d06-8df9caddcbf8 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:39.103035 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849e4ef-175e-40bb-a491-71b3646d3202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:39.103646 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849e4ef-175e-40bb-a491-71b3646d3202 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:39.103970 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849e4ef-175e-40bb-a491-71b3646d3202 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:39.104302 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849e4ef-175e-40bb-a491-71b3646d3202 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:39.105223 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2849e4ef-175e-40bb-a491-71b3646d3202 None admin] RBAC: Adding query filter params (role.id=7190d40a528146289333f0b9c16a6370, scope.project.id=c55c2ee59af14cf8a7e4275de4f43037, user.id=938634e835b94a75af698aef6941958f) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:42:39.106535 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2849e4ef-175e-40bb-a491-71b3646d3202 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:39.108774 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2849e4ef-175e-40bb-a491-71b3646d3202 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:39.115703 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 620/1246] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:42:38 2022] GET /identity/v3/role_assignments?user.id=938634e835b94a75af698aef6941958f&scope.project.id=c55c2ee59af14cf8a7e4275de4f43037&role.id=7190d40a528146289333f0b9c16a6370 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:42:42.007968 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55969f5b-5ed9-412f-a2e3-1cfe78dec3a0 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:42.008851 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55969f5b-5ed9-412f-a2e3-1cfe78dec3a0 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:42.008851 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55969f5b-5ed9-412f-a2e3-1cfe78dec3a0 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:42.010926 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 627/1247] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:42:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:42:42.018263 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60145a8-e514-422a-9d12-8a066dcb692a None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:42.018801 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60145a8-e514-422a-9d12-8a066dcb692a None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:42.019009 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60145a8-e514-422a-9d12-8a066dcb692a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:42.040416 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-d60145a8-e514-422a-9d12-8a066dcb692a None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:42:42.041621 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-d60145a8-e514-422a-9d12-8a066dcb692a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:42:42.129315 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 621/1248] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:42:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:42:42.166286 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55969f5b-5ed9-412f-a2e3-1cfe78dec3a0 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:42.301305 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55969f5b-5ed9-412f-a2e3-1cfe78dec3a0 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:42.343728 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74802769-44b2-4887-aa35-159babe65c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:42.344578 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74802769-44b2-4887-aa35-159babe65c39 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:42.344946 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74802769-44b2-4887-aa35-159babe65c39 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:42.345210 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74802769-44b2-4887-aa35-159babe65c39 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:42.359153 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74802769-44b2-4887-aa35-159babe65c39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:42:42.366574 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-74802769-44b2-4887-aa35-159babe65c39 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 20:42:42.368205 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 628/1249] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 20:42:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:42:42.374996 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60145a8-e514-422a-9d12-8a066dcb692a None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:42.490520 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60145a8-e514-422a-9d12-8a066dcb692a None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:42.530424 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4ddce-3814-4602-b8dd-051809ff2456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:42.531474 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4ddce-3814-4602-b8dd-051809ff2456 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:42.531824 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4ddce-3814-4602-b8dd-051809ff2456 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:42.532392 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4ddce-3814-4602-b8dd-051809ff2456 None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:42.533197 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4ddce-3814-4602-b8dd-051809ff2456 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:42:42.533495 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4ddce-3814-4602-b8dd-051809ff2456 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:42.535777 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4ddce-3814-4602-b8dd-051809ff2456 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:42.543914 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 622/1250] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:42:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:42:42.550318 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74802769-44b2-4887-aa35-159babe65c39 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:42.682827 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74802769-44b2-4887-aa35-159babe65c39 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:42.736169 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5caf6-47bf-424e-902e-134917d76b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:42.736998 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5caf6-47bf-424e-902e-134917d76b62 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:42.737302 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5caf6-47bf-424e-902e-134917d76b62 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:42.737577 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5caf6-47bf-424e-902e-134917d76b62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:42.755271 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf5caf6-47bf-424e-902e-134917d76b62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:42.756868 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf5caf6-47bf-424e-902e-134917d76b62 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:42.778451 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-acf5caf6-47bf-424e-902e-134917d76b62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:42:42.780053 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 629/1251] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:42:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:42:42.786563 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4ddce-3814-4602-b8dd-051809ff2456 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:42.943130 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4ddce-3814-4602-b8dd-051809ff2456 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:42.995662 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea2e31-526c-49e1-bec2-cc95386922c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:42.996825 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea2e31-526c-49e1-bec2-cc95386922c5 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:42.997458 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea2e31-526c-49e1-bec2-cc95386922c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:43.000105 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea2e31-526c-49e1-bec2-cc95386922c5 None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:43.001220 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea2e31-526c-49e1-bec2-cc95386922c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:42:43.001682 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea2e31-526c-49e1-bec2-cc95386922c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:43.003726 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea2e31-526c-49e1-bec2-cc95386922c5 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:43.026296 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 623/1252] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:42:43.033286 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5caf6-47bf-424e-902e-134917d76b62 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:43.164751 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5caf6-47bf-424e-902e-134917d76b62 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:43.210084 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2a475-23ac-4406-b0cf-05c86aa7116f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:43.212021 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2a475-23ac-4406-b0cf-05c86aa7116f None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:43.212626 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2a475-23ac-4406-b0cf-05c86aa7116f None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:43.213166 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2a475-23ac-4406-b0cf-05c86aa7116f None admin] PATH_INFO: `/v3/users/placement` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:43.224202 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2a475-23ac-4406-b0cf-05c86aa7116f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:43.225865 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2a475-23ac-4406-b0cf-05c86aa7116f None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:43.243138 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-84e2a475-23ac-4406-b0cf-05c86aa7116f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 20:42:43.244546 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 630/1253] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:42:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:42:43.253248 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea2e31-526c-49e1-bec2-cc95386922c5 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:43.395489 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea2e31-526c-49e1-bec2-cc95386922c5 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:43.438812 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c9102-0f1f-40d4-9533-7e1fe72d9b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:43.439597 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c9102-0f1f-40d4-9533-7e1fe72d9b09 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:43.439989 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c9102-0f1f-40d4-9533-7e1fe72d9b09 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:43.440285 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c9102-0f1f-40d4-9533-7e1fe72d9b09 None admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:43.441353 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c9102-0f1f-40d4-9533-7e1fe72d9b09 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:42:43.441659 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c9102-0f1f-40d4-9533-7e1fe72d9b09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:43.443133 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c9102-0f1f-40d4-9533-7e1fe72d9b09 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:43.468692 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 624/1254] 10.222.0.49 () {56 vars in 1143 bytes} [Fri Oct 28 20:42:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:42:43.475958 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2a475-23ac-4406-b0cf-05c86aa7116f None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:43.609507 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2a475-23ac-4406-b0cf-05c86aa7116f None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:43.647607 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a93881-b13b-43e2-af5c-e4af7c8e22a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:43.648439 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a93881-b13b-43e2-af5c-e4af7c8e22a3 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:43.648822 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a93881-b13b-43e2-af5c-e4af7c8e22a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:43.649051 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a93881-b13b-43e2-af5c-e4af7c8e22a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:43.742555 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a93881-b13b-43e2-af5c-e4af7c8e22a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:43.743983 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a93881-b13b-43e2-af5c-e4af7c8e22a3 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:43.869782 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 631/1255] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:42:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 20:42:43.878098 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c9102-0f1f-40d4-9533-7e1fe72d9b09 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:43.987116 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c9102-0f1f-40d4-9533-7e1fe72d9b09 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:44.024431 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01695f0-0821-411b-b27b-bd12793e0f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:44.025128 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01695f0-0821-411b-b27b-bd12793e0f6f None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:44.025396 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01695f0-0821-411b-b27b-bd12793e0f6f None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:44.025660 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01695f0-0821-411b-b27b-bd12793e0f6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:44.036898 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01695f0-0821-411b-b27b-bd12793e0f6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:44.038380 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01695f0-0821-411b-b27b-bd12793e0f6f None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:44.056815 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-d01695f0-0821-411b-b27b-bd12793e0f6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:42:44.058110 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 625/1256] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:42:44.066367 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a93881-b13b-43e2-af5c-e4af7c8e22a3 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:44.177150 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a93881-b13b-43e2-af5c-e4af7c8e22a3 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:44.211337 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc22623-e242-49b5-b406-f112d23e74de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:44.212020 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc22623-e242-49b5-b406-f112d23e74de None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:44.212296 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc22623-e242-49b5-b406-f112d23e74de None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:44.212565 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc22623-e242-49b5-b406-f112d23e74de None admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:44.213287 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc22623-e242-49b5-b406-f112d23e74de None admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:42:44.213593 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc22623-e242-49b5-b406-f112d23e74de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:44.214999 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc22623-e242-49b5-b406-f112d23e74de None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:44.227536 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 632/1257] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:42:44.240366 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01695f0-0821-411b-b27b-bd12793e0f6f None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:44.356733 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01695f0-0821-411b-b27b-bd12793e0f6f None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:44.401972 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47670e11-ba95-44b7-8fe3-fc2fe19978a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:44.403849 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47670e11-ba95-44b7-8fe3-fc2fe19978a6 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:44.404262 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47670e11-ba95-44b7-8fe3-fc2fe19978a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:44.404710 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47670e11-ba95-44b7-8fe3-fc2fe19978a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:44.416123 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47670e11-ba95-44b7-8fe3-fc2fe19978a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:44.418906 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47670e11-ba95-44b7-8fe3-fc2fe19978a6 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:44.438567 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-47670e11-ba95-44b7-8fe3-fc2fe19978a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 20:42:44.440829 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 626/1258] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:42:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 20:42:44.446950 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc22623-e242-49b5-b406-f112d23e74de None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:44.561150 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc22623-e242-49b5-b406-f112d23e74de None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:44.597488 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b0afc-32b9-462b-9cac-f3725250a6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:44.598170 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b0afc-32b9-462b-9cac-f3725250a6b1 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:44.598447 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b0afc-32b9-462b-9cac-f3725250a6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:44.598722 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b0afc-32b9-462b-9cac-f3725250a6b1 None admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:44.599537 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b0afc-32b9-462b-9cac-f3725250a6b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:42:44.599880 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b0afc-32b9-462b-9cac-f3725250a6b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:44.601376 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b0afc-32b9-462b-9cac-f3725250a6b1 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:44.615503 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 633/1259] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 20:42:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:42:44.622547 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47670e11-ba95-44b7-8fe3-fc2fe19978a6 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:44.742135 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47670e11-ba95-44b7-8fe3-fc2fe19978a6 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:44.781177 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220272d-c12c-4977-9e59-affceabe282c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:44.781846 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220272d-c12c-4977-9e59-affceabe282c None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:44.782372 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220272d-c12c-4977-9e59-affceabe282c None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:44.782638 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220272d-c12c-4977-9e59-affceabe282c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:44.783481 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220272d-c12c-4977-9e59-affceabe282c None admin] RBAC: Adding query filter params (role.id=8fe105eeb7bf4856a94b0633bd781414, scope.project.id=c55c2ee59af14cf8a7e4275de4f43037, user.id=938634e835b94a75af698aef6941958f) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:42:44.783815 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220272d-c12c-4977-9e59-affceabe282c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:44.785303 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220272d-c12c-4977-9e59-affceabe282c None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:44.791373 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 627/1260] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:42:44 2022] GET /identity/v3/role_assignments?user.id=938634e835b94a75af698aef6941958f&scope.project.id=c55c2ee59af14cf8a7e4275de4f43037&role.id=8fe105eeb7bf4856a94b0633bd781414 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:42:47.132588 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb2041-abc1-4b5f-baa5-488aa871d7d2 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:47.133118 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb2041-abc1-4b5f-baa5-488aa871d7d2 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:47.133118 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb2041-abc1-4b5f-baa5-488aa871d7d2 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:47.134915 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 634/1261] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:42:47.140897 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18884bd9-fdff-450c-a324-9b228a4922a8 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:47.141439 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18884bd9-fdff-450c-a324-9b228a4922a8 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:47.141439 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18884bd9-fdff-450c-a324-9b228a4922a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:47.158712 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-18884bd9-fdff-450c-a324-9b228a4922a8 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:42:47.159903 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-18884bd9-fdff-450c-a324-9b228a4922a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:42:47.224154 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 628/1262] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:42:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 20:42:47.247852 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb2041-abc1-4b5f-baa5-488aa871d7d2 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:47.344193 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb2041-abc1-4b5f-baa5-488aa871d7d2 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:47.376449 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6cdba-deab-490c-b5fd-74740a6c8161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:47.377222 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6cdba-deab-490c-b5fd-74740a6c8161 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:47.377495 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6cdba-deab-490c-b5fd-74740a6c8161 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:47.377764 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6cdba-deab-490c-b5fd-74740a6c8161 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:47.387902 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a6cdba-deab-490c-b5fd-74740a6c8161 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:42:47.394786 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-a0a6cdba-deab-490c-b5fd-74740a6c8161 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 20:42:47.396080 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 635/1263] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 20:42:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:42:47.403257 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18884bd9-fdff-450c-a324-9b228a4922a8 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:47.502465 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18884bd9-fdff-450c-a324-9b228a4922a8 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:47.534957 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9018083-829e-430e-be4c-38e393ad2858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:47.535612 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9018083-829e-430e-be4c-38e393ad2858 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:47.535958 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9018083-829e-430e-be4c-38e393ad2858 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:47.536187 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9018083-829e-430e-be4c-38e393ad2858 None admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:47.536920 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9018083-829e-430e-be4c-38e393ad2858 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:42:47.537220 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9018083-829e-430e-be4c-38e393ad2858 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:47.538583 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9018083-829e-430e-be4c-38e393ad2858 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:47.547321 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 629/1264] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:42:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:42:47.553235 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6cdba-deab-490c-b5fd-74740a6c8161 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:47.666529 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6cdba-deab-490c-b5fd-74740a6c8161 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:47.710330 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a114332-cc3c-498a-ae79-fce36fbfea11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:47.711280 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a114332-cc3c-498a-ae79-fce36fbfea11 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:47.711758 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a114332-cc3c-498a-ae79-fce36fbfea11 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:47.712083 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a114332-cc3c-498a-ae79-fce36fbfea11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:47.724948 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a114332-cc3c-498a-ae79-fce36fbfea11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:47.726430 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a114332-cc3c-498a-ae79-fce36fbfea11 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:47.745506 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-6a114332-cc3c-498a-ae79-fce36fbfea11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:42:47.747059 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 636/1265] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:42:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:42:47.753532 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9018083-829e-430e-be4c-38e393ad2858 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:47.876478 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9018083-829e-430e-be4c-38e393ad2858 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:47.913207 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc161818-dd61-4395-80b6-f9f022c2c942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:47.913871 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc161818-dd61-4395-80b6-f9f022c2c942 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:47.915166 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc161818-dd61-4395-80b6-f9f022c2c942 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:47.915438 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc161818-dd61-4395-80b6-f9f022c2c942 None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:47.916185 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc161818-dd61-4395-80b6-f9f022c2c942 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:42:47.916486 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc161818-dd61-4395-80b6-f9f022c2c942 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:47.918009 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc161818-dd61-4395-80b6-f9f022c2c942 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:47.930538 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 630/1266] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:42:47.936764 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a114332-cc3c-498a-ae79-fce36fbfea11 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:48.044116 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a114332-cc3c-498a-ae79-fce36fbfea11 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:48.080385 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf98c63-001a-4f2e-aae7-ba8a10ae5690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:48.081189 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf98c63-001a-4f2e-aae7-ba8a10ae5690 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:48.081462 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf98c63-001a-4f2e-aae7-ba8a10ae5690 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:48.081726 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf98c63-001a-4f2e-aae7-ba8a10ae5690 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:48.092414 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf98c63-001a-4f2e-aae7-ba8a10ae5690 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:48.094895 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf98c63-001a-4f2e-aae7-ba8a10ae5690 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:48.110720 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-7bf98c63-001a-4f2e-aae7-ba8a10ae5690 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 20:42:48.111974 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 637/1267] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:42:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:42:48.118047 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc161818-dd61-4395-80b6-f9f022c2c942 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:48.224102 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc161818-dd61-4395-80b6-f9f022c2c942 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:48.258361 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb3ed8-bf6d-430f-bb6c-51065baaa5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:48.259028 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb3ed8-bf6d-430f-bb6c-51065baaa5bb None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:48.259307 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb3ed8-bf6d-430f-bb6c-51065baaa5bb None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:48.259581 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb3ed8-bf6d-430f-bb6c-51065baaa5bb None admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:48.260442 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb3ed8-bf6d-430f-bb6c-51065baaa5bb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:42:48.260753 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb3ed8-bf6d-430f-bb6c-51065baaa5bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:48.262781 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb3ed8-bf6d-430f-bb6c-51065baaa5bb None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:48.281946 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 631/1268] 10.222.0.49 () {56 vars in 1143 bytes} [Fri Oct 28 20:42:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:42:48.290111 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf98c63-001a-4f2e-aae7-ba8a10ae5690 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:48.398095 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf98c63-001a-4f2e-aae7-ba8a10ae5690 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:48.431014 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f8ef0-9fd7-4c48-907e-6ff28012b94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:48.431814 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f8ef0-9fd7-4c48-907e-6ff28012b94e None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:48.432090 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f8ef0-9fd7-4c48-907e-6ff28012b94e None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:48.432355 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f8ef0-9fd7-4c48-907e-6ff28012b94e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:48.443441 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f8ef0-9fd7-4c48-907e-6ff28012b94e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:48.444920 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f8ef0-9fd7-4c48-907e-6ff28012b94e None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:48.461353 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-c14f8ef0-9fd7-4c48-907e-6ff28012b94e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:42:48.462542 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 638/1269] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:42:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:42:48.468941 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb3ed8-bf6d-430f-bb6c-51065baaa5bb None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:48.568671 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb3ed8-bf6d-430f-bb6c-51065baaa5bb None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:48.601561 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a722ef-e3ac-4f49-a870-5675b3ea6aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:48.602214 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a722ef-e3ac-4f49-a870-5675b3ea6aad None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:48.602488 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a722ef-e3ac-4f49-a870-5675b3ea6aad None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:48.602755 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a722ef-e3ac-4f49-a870-5675b3ea6aad None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:48.603466 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a722ef-e3ac-4f49-a870-5675b3ea6aad None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:42:48.603787 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a722ef-e3ac-4f49-a870-5675b3ea6aad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:48.605170 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a722ef-e3ac-4f49-a870-5675b3ea6aad None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:48.619818 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 632/1270] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:42:48.626422 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f8ef0-9fd7-4c48-907e-6ff28012b94e None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:48.738618 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f8ef0-9fd7-4c48-907e-6ff28012b94e None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:48.771477 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283e8fa-6c86-460b-8824-e30c130eac2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:48.772290 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283e8fa-6c86-460b-8824-e30c130eac2b None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:48.772665 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283e8fa-6c86-460b-8824-e30c130eac2b None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:48.772843 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283e8fa-6c86-460b-8824-e30c130eac2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:48.780105 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283e8fa-6c86-460b-8824-e30c130eac2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:48.781540 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283e8fa-6c86-460b-8824-e30c130eac2b None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:48.795125 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-c283e8fa-6c86-460b-8824-e30c130eac2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 20:42:48.796353 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 639/1271] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:42:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:42:48.802343 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a722ef-e3ac-4f49-a870-5675b3ea6aad None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:48.906302 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a722ef-e3ac-4f49-a870-5675b3ea6aad None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:48.938476 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3b14c-681a-4630-adcc-49a86ad8d889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:48.939115 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3b14c-681a-4630-adcc-49a86ad8d889 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:48.939387 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3b14c-681a-4630-adcc-49a86ad8d889 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:48.939649 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3b14c-681a-4630-adcc-49a86ad8d889 None admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:48.940448 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3b14c-681a-4630-adcc-49a86ad8d889 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:42:48.940746 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3b14c-681a-4630-adcc-49a86ad8d889 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:48.942159 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3b14c-681a-4630-adcc-49a86ad8d889 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:48.954048 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 633/1272] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 20:42:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:42:48.960133 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283e8fa-6c86-460b-8824-e30c130eac2b None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:49.056606 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283e8fa-6c86-460b-8824-e30c130eac2b None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:49.090006 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b8db6-709a-40b0-88b8-e97236cdc1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:49.090872 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b8db6-709a-40b0-88b8-e97236cdc1fc None admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:49.091146 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b8db6-709a-40b0-88b8-e97236cdc1fc None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:49.091411 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b8db6-709a-40b0-88b8-e97236cdc1fc None admin] PATH_INFO: `/v3/projects/c55c2ee59af14cf8a7e4275de4f43037/users/938634e835b94a75af698aef6941958f/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:49.093366 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b8db6-709a-40b0-88b8-e97236cdc1fc None admin] RBAC: Authorizing `identity:create_grant(project_id=c55c2ee59af14cf8a7e4275de4f43037, user_id=938634e835b94a75af698aef6941958f, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:49.094781 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b8db6-709a-40b0-88b8-e97236cdc1fc None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:49.108354 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 640/1273] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 20:42:48 2022] PUT /identity/v3/projects/c55c2ee59af14cf8a7e4275de4f43037/users/938634e835b94a75af698aef6941958f/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:42:51.439680 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cabdeb-f1b3-4831-8d4a-1514e615642f None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:51.440250 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cabdeb-f1b3-4831-8d4a-1514e615642f None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:51.440250 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cabdeb-f1b3-4831-8d4a-1514e615642f None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:51.442012 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 634/1274] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:42:51.447206 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73adf3b8-fc2c-4e37-bafd-b05b24521d59 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:51.447629 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73adf3b8-fc2c-4e37-bafd-b05b24521d59 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:51.447779 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73adf3b8-fc2c-4e37-bafd-b05b24521d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:51.465332 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-73adf3b8-fc2c-4e37-bafd-b05b24521d59 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:42:51.466523 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-73adf3b8-fc2c-4e37-bafd-b05b24521d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:42:51.529711 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 641/1275] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:42:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:42:51.553404 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cabdeb-f1b3-4831-8d4a-1514e615642f None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:51.655168 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cabdeb-f1b3-4831-8d4a-1514e615642f None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:51.692860 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cde4dd-d1f9-4e97-867d-81cf46d61ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:51.693689 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cde4dd-d1f9-4e97-867d-81cf46d61ab3 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:51.693963 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cde4dd-d1f9-4e97-867d-81cf46d61ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:51.694251 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cde4dd-d1f9-4e97-867d-81cf46d61ab3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:51.707137 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cde4dd-d1f9-4e97-867d-81cf46d61ab3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 20:42:51.716960 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-30cde4dd-d1f9-4e97-867d-81cf46d61ab3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 20:42:51.718261 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 635/1276] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 20:42:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:42:51.724711 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73adf3b8-fc2c-4e37-bafd-b05b24521d59 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:51.838527 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73adf3b8-fc2c-4e37-bafd-b05b24521d59 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:51.880679 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8b605-a788-4225-999c-74d7a40d3d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:51.881433 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8b605-a788-4225-999c-74d7a40d3d93 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:51.881808 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8b605-a788-4225-999c-74d7a40d3d93 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:51.882098 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8b605-a788-4225-999c-74d7a40d3d93 None admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:51.883030 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de8b605-a788-4225-999c-74d7a40d3d93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:42:51.883383 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de8b605-a788-4225-999c-74d7a40d3d93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:51.885108 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de8b605-a788-4225-999c-74d7a40d3d93 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:51.893773 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 642/1277] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 20:42:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:42:51.899542 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cde4dd-d1f9-4e97-867d-81cf46d61ab3 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:51.995305 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cde4dd-d1f9-4e97-867d-81cf46d61ab3 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:52.027951 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5df143-a218-4d14-ad0a-4d06d4956bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:52.028730 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5df143-a218-4d14-ad0a-4d06d4956bd9 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:52.029010 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5df143-a218-4d14-ad0a-4d06d4956bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:52.029284 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5df143-a218-4d14-ad0a-4d06d4956bd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:52.039691 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5df143-a218-4d14-ad0a-4d06d4956bd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:52.041175 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5df143-a218-4d14-ad0a-4d06d4956bd9 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:52.057144 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-ec5df143-a218-4d14-ad0a-4d06d4956bd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:42:52.058851 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 636/1278] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:42:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:42:52.064622 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8b605-a788-4225-999c-74d7a40d3d93 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:52.162975 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8b605-a788-4225-999c-74d7a40d3d93 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:52.194302 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9a390-778a-4b8a-9c02-d1e95b8e22a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:52.194959 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9a390-778a-4b8a-9c02-d1e95b8e22a8 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:52.195236 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9a390-778a-4b8a-9c02-d1e95b8e22a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:52.195506 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9a390-778a-4b8a-9c02-d1e95b8e22a8 None admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:52.196249 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9a390-778a-4b8a-9c02-d1e95b8e22a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:42:52.196553 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9a390-778a-4b8a-9c02-d1e95b8e22a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:52.197901 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9a390-778a-4b8a-9c02-d1e95b8e22a8 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:52.210136 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 643/1279] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:42:52.216358 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5df143-a218-4d14-ad0a-4d06d4956bd9 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:52.314377 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5df143-a218-4d14-ad0a-4d06d4956bd9 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:52.347634 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83309280-41c3-41ce-8317-65f6eb678c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:52.348453 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83309280-41c3-41ce-8317-65f6eb678c9d None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:52.348725 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83309280-41c3-41ce-8317-65f6eb678c9d None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:52.348989 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83309280-41c3-41ce-8317-65f6eb678c9d None admin] PATH_INFO: `/v3/users/placement` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:52.357461 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83309280-41c3-41ce-8317-65f6eb678c9d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:52.358896 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83309280-41c3-41ce-8317-65f6eb678c9d None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:52.372229 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-83309280-41c3-41ce-8317-65f6eb678c9d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 20:42:52.373421 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 637/1280] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:42:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:42:52.379434 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9a390-778a-4b8a-9c02-d1e95b8e22a8 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:52.475793 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9a390-778a-4b8a-9c02-d1e95b8e22a8 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:52.508852 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5c3f7-8d7b-4a00-a867-1ce4668a9dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:52.509509 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5c3f7-8d7b-4a00-a867-1ce4668a9dff None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:52.509788 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5c3f7-8d7b-4a00-a867-1ce4668a9dff None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:52.510059 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5c3f7-8d7b-4a00-a867-1ce4668a9dff None admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:52.510888 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a5c3f7-8d7b-4a00-a867-1ce4668a9dff None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:42:52.511192 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a5c3f7-8d7b-4a00-a867-1ce4668a9dff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:52.513410 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a5c3f7-8d7b-4a00-a867-1ce4668a9dff None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:52.530490 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 644/1281] 10.222.0.49 () {56 vars in 1143 bytes} [Fri Oct 28 20:42:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:42:52.536714 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83309280-41c3-41ce-8317-65f6eb678c9d None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:52.632108 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83309280-41c3-41ce-8317-65f6eb678c9d None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:52.669276 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c14186-bdc5-48b3-946b-61b6c48ad1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:52.669918 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c14186-bdc5-48b3-946b-61b6c48ad1b5 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:52.670196 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c14186-bdc5-48b3-946b-61b6c48ad1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:52.670468 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c14186-bdc5-48b3-946b-61b6c48ad1b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:52.737730 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c14186-bdc5-48b3-946b-61b6c48ad1b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:52.739097 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c14186-bdc5-48b3-946b-61b6c48ad1b5 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:52.836025 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 638/1282] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 20:42:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 20:42:52.843619 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5c3f7-8d7b-4a00-a867-1ce4668a9dff None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:52.946051 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5c3f7-8d7b-4a00-a867-1ce4668a9dff None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:52.979281 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bee4e2-b15c-4df5-b0c6-8b11778eb858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:52.980128 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bee4e2-b15c-4df5-b0c6-8b11778eb858 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:52.980409 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bee4e2-b15c-4df5-b0c6-8b11778eb858 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:52.980689 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bee4e2-b15c-4df5-b0c6-8b11778eb858 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:52.990671 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bee4e2-b15c-4df5-b0c6-8b11778eb858 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:52.992078 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bee4e2-b15c-4df5-b0c6-8b11778eb858 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:53.008633 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-97bee4e2-b15c-4df5-b0c6-8b11778eb858 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 20:42:53.009838 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 645/1283] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:42:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:42:53.016273 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c14186-bdc5-48b3-946b-61b6c48ad1b5 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:53.111467 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c14186-bdc5-48b3-946b-61b6c48ad1b5 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:53.144182 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a67d4-df50-4796-b450-31857c243e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:53.144839 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a67d4-df50-4796-b450-31857c243e39 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:53.145118 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a67d4-df50-4796-b450-31857c243e39 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:53.145386 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a67d4-df50-4796-b450-31857c243e39 None admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:53.146101 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a67d4-df50-4796-b450-31857c243e39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:42:53.146406 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a67d4-df50-4796-b450-31857c243e39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:53.147800 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a67d4-df50-4796-b450-31857c243e39 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:53.159998 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 639/1284] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 20:42:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:42:53.165674 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bee4e2-b15c-4df5-b0c6-8b11778eb858 None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:53.261352 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bee4e2-b15c-4df5-b0c6-8b11778eb858 None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:53.295167 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99898e95-5a8c-4947-9fa4-2bd8175612af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:53.295990 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99898e95-5a8c-4947-9fa4-2bd8175612af None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:53.296269 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99898e95-5a8c-4947-9fa4-2bd8175612af None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:53.296539 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99898e95-5a8c-4947-9fa4-2bd8175612af None admin] PATH_INFO: `/v3/projects/service` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:53.303049 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99898e95-5a8c-4947-9fa4-2bd8175612af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:53.304520 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99898e95-5a8c-4947-9fa4-2bd8175612af None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:53.317765 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING keystone.server.flask.application [None req-99898e95-5a8c-4947-9fa4-2bd8175612af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 20:42:53.318972 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 646/1285] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 20:42:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:42:53.325471 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a67d4-df50-4796-b450-31857c243e39 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:53.421946 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a67d4-df50-4796-b450-31857c243e39 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:53.454753 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1643a8a-2e74-4e86-bc74-8612c2b46812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:53.455402 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1643a8a-2e74-4e86-bc74-8612c2b46812 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:53.455681 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1643a8a-2e74-4e86-bc74-8612c2b46812 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:53.455983 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1643a8a-2e74-4e86-bc74-8612c2b46812 None admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:53.456759 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1643a8a-2e74-4e86-bc74-8612c2b46812 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:42:53.457067 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1643a8a-2e74-4e86-bc74-8612c2b46812 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:53.458495 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1643a8a-2e74-4e86-bc74-8612c2b46812 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:53.470525 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 640/1286] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 20:42:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:42:53.476782 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99898e95-5a8c-4947-9fa4-2bd8175612af None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:53.574563 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99898e95-5a8c-4947-9fa4-2bd8175612af None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:53.607015 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca693c-ac6e-404e-a3db-1429fe5013fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:53.607663 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca693c-ac6e-404e-a3db-1429fe5013fa None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:53.607972 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca693c-ac6e-404e-a3db-1429fe5013fa None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:53.608244 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca693c-ac6e-404e-a3db-1429fe5013fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:53.609061 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca693c-ac6e-404e-a3db-1429fe5013fa None admin] RBAC: Adding query filter params (role.id=8fe105eeb7bf4856a94b0633bd781414, scope.project.id=c55c2ee59af14cf8a7e4275de4f43037, user.id=938634e835b94a75af698aef6941958f) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:42:53.609366 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca693c-ac6e-404e-a3db-1429fe5013fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:53.610787 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca693c-ac6e-404e-a3db-1429fe5013fa None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:53.616555 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 647/1287] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 20:42:53 2022] GET /identity/v3/role_assignments?user.id=938634e835b94a75af698aef6941958f&scope.project.id=c55c2ee59af14cf8a7e4275de4f43037&role.id=8fe105eeb7bf4856a94b0633bd781414 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:42:56.005755 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c0328-85f1-450f-b7c4-615fd1f9b565 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:56.006288 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c0328-85f1-450f-b7c4-615fd1f9b565 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:56.006288 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c0328-85f1-450f-b7c4-615fd1f9b565 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:56.008071 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 641/1288] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:42:56.013238 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57145145-2783-41c1-bda6-b72fffbe81a5 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:56.013657 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57145145-2783-41c1-bda6-b72fffbe81a5 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:56.013774 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57145145-2783-41c1-bda6-b72fffbe81a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:56.030256 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-57145145-2783-41c1-bda6-b72fffbe81a5 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:42:56.031440 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-57145145-2783-41c1-bda6-b72fffbe81a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:42:56.095147 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 648/1289] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:42:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 20:42:56.117958 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c0328-85f1-450f-b7c4-615fd1f9b565 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:56.217117 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c0328-85f1-450f-b7c4-615fd1f9b565 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:56.251259 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65e0a8-21d8-470b-9805-39516892e9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:56.252065 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65e0a8-21d8-470b-9805-39516892e9d6 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:56.252338 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65e0a8-21d8-470b-9805-39516892e9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:56.252601 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65e0a8-21d8-470b-9805-39516892e9d6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:56.253244 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f65e0a8-21d8-470b-9805-39516892e9d6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:56.254608 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f65e0a8-21d8-470b-9805-39516892e9d6 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:56.265263 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-4f65e0a8-21d8-470b-9805-39516892e9d6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 20:42:56.266354 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 642/1290] 10.222.0.49 () {56 vars in 1117 bytes} [Fri Oct 28 20:42:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:42:56.272605 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57145145-2783-41c1-bda6-b72fffbe81a5 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:56.371486 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57145145-2783-41c1-bda6-b72fffbe81a5 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:56.403308 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91de4d-205f-44f0-b7be-a7b12d340471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:56.403986 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91de4d-205f-44f0-b7be-a7b12d340471 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:56.404265 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91de4d-205f-44f0-b7be-a7b12d340471 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:56.404534 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91de4d-205f-44f0-b7be-a7b12d340471 None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:56.405235 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91de4d-205f-44f0-b7be-a7b12d340471 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:42:56.405536 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91de4d-205f-44f0-b7be-a7b12d340471 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:56.407140 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91de4d-205f-44f0-b7be-a7b12d340471 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:56.411910 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 649/1291] 10.222.0.49 () {56 vars in 1116 bytes} [Fri Oct 28 20:42:56 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:42:56.417945 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65e0a8-21d8-470b-9805-39516892e9d6 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:56.514202 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65e0a8-21d8-470b-9805-39516892e9d6 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:56.546043 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1f90f-08e1-4cac-8f69-e4ecee867d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:56.546625 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1f90f-08e1-4cac-8f69-e4ecee867d23 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:56.546903 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1f90f-08e1-4cac-8f69-e4ecee867d23 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:56.547172 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1f90f-08e1-4cac-8f69-e4ecee867d23 None admin] PATH_INFO: `/v3/services` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:56.547893 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1f90f-08e1-4cac-8f69-e4ecee867d23 None admin] RBAC: Adding query filter params (type=placement) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:42:56.548202 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1f90f-08e1-4cac-8f69-e4ecee867d23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:56.549571 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1f90f-08e1-4cac-8f69-e4ecee867d23 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:56.553937 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 643/1292] 10.222.0.49 () {56 vars in 1116 bytes} [Fri Oct 28 20:42:56 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:42:58.953896 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354d1ff-e601-4ccd-9ecd-2d787b3ef3de None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:58.954425 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354d1ff-e601-4ccd-9ecd-2d787b3ef3de None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:58.954425 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354d1ff-e601-4ccd-9ecd-2d787b3ef3de None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:58.956278 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 650/1293] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:42:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:42:58.961425 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087d610-6c24-41c8-92da-901edfa97b7c None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:58.961809 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087d610-6c24-41c8-92da-901edfa97b7c None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:58.961973 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087d610-6c24-41c8-92da-901edfa97b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:58.979113 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-d087d610-6c24-41c8-92da-901edfa97b7c None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:42:58.980435 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-d087d610-6c24-41c8-92da-901edfa97b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:42:59.043688 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 644/1294] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:42:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:42:59.066328 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354d1ff-e601-4ccd-9ecd-2d787b3ef3de None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:42:59.164002 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354d1ff-e601-4ccd-9ecd-2d787b3ef3de None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:42:59.196074 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91f0c8-ede4-4d59-97f8-65626abffe9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:42:59.196722 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91f0c8-ede4-4d59-97f8-65626abffe9d None admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:42:59.196996 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91f0c8-ede4-4d59-97f8-65626abffe9d None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:42:59.197263 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91f0c8-ede4-4d59-97f8-65626abffe9d None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:42:59.197973 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b91f0c8-ede4-4d59-97f8-65626abffe9d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:42:59.200153 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b91f0c8-ede4-4d59-97f8-65626abffe9d None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:42:59.213606 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 651/1295] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Oct 28 20:42:59 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:43:01.560640 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41177ebb-b092-4ccf-aa19-4f5ffa6ba587 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:43:01.561137 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41177ebb-b092-4ccf-aa19-4f5ffa6ba587 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:43:01.561137 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41177ebb-b092-4ccf-aa19-4f5ffa6ba587 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:43:01.562857 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 645/1296] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:43:01.568438 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef2f38-0233-461b-9ce0-1a1b0e414728 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:43:01.568879 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef2f38-0233-461b-9ce0-1a1b0e414728 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:43:01.568990 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef2f38-0233-461b-9ce0-1a1b0e414728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:43:01.585440 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-29ef2f38-0233-461b-9ce0-1a1b0e414728 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:43:01.586627 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-29ef2f38-0233-461b-9ce0-1a1b0e414728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:43:01.657205 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 652/1297] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:43:01 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:43:01.680240 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41177ebb-b092-4ccf-aa19-4f5ffa6ba587 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:43:01.776543 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41177ebb-b092-4ccf-aa19-4f5ffa6ba587 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:43:01.809946 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395d2da-44df-4dbe-a3f0-49ea5f833b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:43:01.810785 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395d2da-44df-4dbe-a3f0-49ea5f833b94 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:43:01.811006 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395d2da-44df-4dbe-a3f0-49ea5f833b94 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:43:01.811275 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395d2da-44df-4dbe-a3f0-49ea5f833b94 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:43:01.811960 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395d2da-44df-4dbe-a3f0-49ea5f833b94 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:43:01.813334 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395d2da-44df-4dbe-a3f0-49ea5f833b94 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:43:01.824661 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-9395d2da-44df-4dbe-a3f0-49ea5f833b94 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 20:43:01.825824 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 646/1298] 10.222.0.49 () {56 vars in 1117 bytes} [Fri Oct 28 20:43:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:43:01.832091 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef2f38-0233-461b-9ce0-1a1b0e414728 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:43:01.931731 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef2f38-0233-461b-9ce0-1a1b0e414728 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:43:01.964070 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d654b9-df5a-428a-a796-972d28a5c43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:43:01.965246 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d654b9-df5a-428a-a796-972d28a5c43e None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:43:01.965525 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d654b9-df5a-428a-a796-972d28a5c43e None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:43:01.965794 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d654b9-df5a-428a-a796-972d28a5c43e None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:43:01.966491 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d654b9-df5a-428a-a796-972d28a5c43e None admin] RBAC: Adding query filter params (name=placement) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:43:01.966793 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d654b9-df5a-428a-a796-972d28a5c43e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:43:01.968177 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d654b9-df5a-428a-a796-972d28a5c43e None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:43:01.973125 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 653/1299] 10.222.0.49 () {56 vars in 1116 bytes} [Fri Oct 28 20:43:01 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:43:01.979254 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395d2da-44df-4dbe-a3f0-49ea5f833b94 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:43:02.074152 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395d2da-44df-4dbe-a3f0-49ea5f833b94 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:43:02.105820 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9620d85-e82a-46d8-a6b2-3b3ea4e98f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:43:02.106460 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9620d85-e82a-46d8-a6b2-3b3ea4e98f69 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:43:02.106732 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9620d85-e82a-46d8-a6b2-3b3ea4e98f69 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:43:02.106998 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9620d85-e82a-46d8-a6b2-3b3ea4e98f69 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:43:02.107785 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9620d85-e82a-46d8-a6b2-3b3ea4e98f69 None admin] RBAC: Adding query filter params (interface=public, service_id=6bec0042e1ba43febac4f4a0bc5b8043, region_id=RegionOne) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:43:02.108091 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9620d85-e82a-46d8-a6b2-3b3ea4e98f69 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:43:02.109448 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9620d85-e82a-46d8-a6b2-3b3ea4e98f69 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:43:02.114283 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 647/1300] 10.222.0.49 () {56 vars in 1251 bytes} [Fri Oct 28 20:43:01 2022] GET /identity/v3/endpoints?service_id=6bec0042e1ba43febac4f4a0bc5b8043&interface=public®ion_id=RegionOne => generated 194 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:43:02.119993 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d654b9-df5a-428a-a796-972d28a5c43e None admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:43:02.217953 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d654b9-df5a-428a-a796-972d28a5c43e None admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:43:02.250712 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641051e-20fc-47ee-9169-6bf4d214c6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:43:02.251362 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641051e-20fc-47ee-9169-6bf4d214c6ea None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:43:02.251635 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641051e-20fc-47ee-9169-6bf4d214c6ea None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:43:02.251935 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641051e-20fc-47ee-9169-6bf4d214c6ea None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:43:02.252606 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641051e-20fc-47ee-9169-6bf4d214c6ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:43:02.253960 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641051e-20fc-47ee-9169-6bf4d214c6ea None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:43:02.260823 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 654/1301] 10.222.0.49 () {56 vars in 1087 bytes} [Fri Oct 28 20:43:02 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:43:04.619271 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf6dd7-154a-40a4-a09a-c2e5ad9848d2 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:43:04.619811 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf6dd7-154a-40a4-a09a-c2e5ad9848d2 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:43:04.619811 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf6dd7-154a-40a4-a09a-c2e5ad9848d2 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:43:04.622150 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 648/1302] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:43:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:43:04.627400 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7708e-0226-4e83-9c75-fe6bb4320ac8 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:43:04.627817 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7708e-0226-4e83-9c75-fe6bb4320ac8 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:43:04.627988 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7708e-0226-4e83-9c75-fe6bb4320ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:43:04.645166 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-fcf7708e-0226-4e83-9c75-fe6bb4320ac8 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:43:04.646337 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-fcf7708e-0226-4e83-9c75-fe6bb4320ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:43:04.709568 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 655/1303] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:43:04 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 20:43:04.734077 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf6dd7-154a-40a4-a09a-c2e5ad9848d2 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:43:04.832178 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf6dd7-154a-40a4-a09a-c2e5ad9848d2 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:43:04.865950 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e5aad-f082-4e12-9803-27f443845c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:43:04.866766 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e5aad-f082-4e12-9803-27f443845c29 None admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:43:04.867019 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e5aad-f082-4e12-9803-27f443845c29 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:43:04.867289 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e5aad-f082-4e12-9803-27f443845c29 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:43:04.867964 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e5aad-f082-4e12-9803-27f443845c29 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:43:04.869392 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e5aad-f082-4e12-9803-27f443845c29 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:43:04.880311 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING keystone.server.flask.application [None req-1a5e5aad-f082-4e12-9803-27f443845c29 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 20:43:04.881479 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 649/1304] 10.222.0.49 () {56 vars in 1117 bytes} [Fri Oct 28 20:43:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 20:43:04.888166 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7708e-0226-4e83-9c75-fe6bb4320ac8 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:43:04.986951 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7708e-0226-4e83-9c75-fe6bb4320ac8 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:43:05.020040 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151be9fc-3f04-4aa9-aadf-da3e579bcd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:43:05.020646 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151be9fc-3f04-4aa9-aadf-da3e579bcd66 None admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:43:05.020926 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151be9fc-3f04-4aa9-aadf-da3e579bcd66 None admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:43:05.021201 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151be9fc-3f04-4aa9-aadf-da3e579bcd66 None admin] PATH_INFO: `/v3/services` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:43:05.021901 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151be9fc-3f04-4aa9-aadf-da3e579bcd66 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:43:05.022205 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151be9fc-3f04-4aa9-aadf-da3e579bcd66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:43:05.023567 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151be9fc-3f04-4aa9-aadf-da3e579bcd66 None admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:43:05.029260 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 656/1305] 10.222.0.49 () {56 vars in 1116 bytes} [Fri Oct 28 20:43:04 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:43:05.035286 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e5aad-f082-4e12-9803-27f443845c29 None admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:43:05.130598 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e5aad-f082-4e12-9803-27f443845c29 None admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:43:05.164402 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dee4a3-b5c1-4b91-be76-041601d4b1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:43:05.165048 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dee4a3-b5c1-4b91-be76-041601d4b1d4 None admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:43:05.165324 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dee4a3-b5c1-4b91-be76-041601d4b1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:43:05.165593 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dee4a3-b5c1-4b91-be76-041601d4b1d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:43:05.166317 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dee4a3-b5c1-4b91-be76-041601d4b1d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:43:05.167798 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dee4a3-b5c1-4b91-be76-041601d4b1d4 None admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:43:05.185288 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 650/1306] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:43:05 2022] POST /identity/v3/endpoints => generated 331 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:44:17.171595 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe55cc-ad13-496b-9007-8f35fcb8929d None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:17.172609 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe55cc-ad13-496b-9007-8f35fcb8929d None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:17.172609 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe55cc-ad13-496b-9007-8f35fcb8929d None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:17.174055 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 657/1307] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:44:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:44:17.180159 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4e5ca-7372-4860-b4cb-ed512f5a12d2 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:17.180957 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4e5ca-7372-4860-b4cb-ed512f5a12d2 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:17.180957 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4e5ca-7372-4860-b4cb-ed512f5a12d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:17.288387 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-4aa4e5ca-7372-4860-b4cb-ed512f5a12d2 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:44:17.289631 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-4aa4e5ca-7372-4860-b4cb-ed512f5a12d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:44:17.433186 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 651/1308] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:44:17.460752 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe55cc-ad13-496b-9007-8f35fcb8929d None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:44:17.463404 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-41fe55cc-ad13-496b-9007-8f35fcb8929d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:44:17.621080 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe55cc-ad13-496b-9007-8f35fcb8929d None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:44:17.735221 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6cd27-8454-454a-9f36-bbc9fee41832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:44:17.736256 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6cd27-8454-454a-9f36-bbc9fee41832 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:17.736749 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6cd27-8454-454a-9f36-bbc9fee41832 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:17.737197 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6cd27-8454-454a-9f36-bbc9fee41832 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:17.738120 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6cd27-8454-454a-9f36-bbc9fee41832 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:44:17.740202 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING py.warnings [None req-01c6cd27-8454-454a-9f36-bbc9fee41832 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 20:44:17.740202 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: warnings.warn(msg) Oct 28 20:44:17.740202 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: Oct 28 20:44:17.741929 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6cd27-8454-454a-9f36-bbc9fee41832 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:44:17.765098 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 658/1309] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:44:17 2022] GET /identity/v3/projects => generated 2553 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:44:20.355616 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83174816-ede9-4024-a40e-a0a266d8e143 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:20.356428 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83174816-ede9-4024-a40e-a0a266d8e143 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:20.356428 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83174816-ede9-4024-a40e-a0a266d8e143 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:20.358040 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 652/1310] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:44:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:44:20.366232 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd6d57-1538-47b0-a0ec-851455077534 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:20.366971 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd6d57-1538-47b0-a0ec-851455077534 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:20.366971 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd6d57-1538-47b0-a0ec-851455077534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:20.474470 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-43fd6d57-1538-47b0-a0ec-851455077534 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:44:20.477153 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-43fd6d57-1538-47b0-a0ec-851455077534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:44:20.606212 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 659/1311] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:44:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:44:20.675876 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4b023-44be-4185-8244-5714a8be32cc None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:20.676189 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4b023-44be-4185-8244-5714a8be32cc None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:20.676973 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4b023-44be-4185-8244-5714a8be32cc None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:20.679149 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 653/1312] 10.222.0.49 () {54 vars in 963 bytes} [Fri Oct 28 20:44:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:44:20.689072 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720381e-d73e-4525-b767-e65ff0e9717c None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:20.689566 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720381e-d73e-4525-b767-e65ff0e9717c None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:20.690030 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720381e-d73e-4525-b767-e65ff0e9717c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:20.827506 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-d720381e-d73e-4525-b767-e65ff0e9717c None None] MFA Rules not processed for user `691a2da563a84da48ca8fd75a0bfe787`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:44:20.828785 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-d720381e-d73e-4525-b767-e65ff0e9717c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:44:20.916807 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 660/1313] 10.222.0.49 () {58 vars in 1060 bytes} [Fri Oct 28 20:44:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:44:20.926493 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4b023-44be-4185-8244-5714a8be32cc None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:44:20.928534 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-acd4b023-44be-4185-8244-5714a8be32cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:44:21.077127 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4b023-44be-4185-8244-5714a8be32cc None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:44:21.198358 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbec818-eb4a-43a9-8dd3-68432ee53b78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:44:21.199032 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbec818-eb4a-43a9-8dd3-68432ee53b78 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:21.199496 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbec818-eb4a-43a9-8dd3-68432ee53b78 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:21.199889 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbec818-eb4a-43a9-8dd3-68432ee53b78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:21.201980 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-adbec818-eb4a-43a9-8dd3-68432ee53b78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:44:21.349875 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbec818-eb4a-43a9-8dd3-68432ee53b78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:44:21.351628 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbec818-eb4a-43a9-8dd3-68432ee53b78 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:44:21.373539 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 654/1314] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:44:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:44:24.130341 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1da970-bea4-4454-a0e4-430c041b9b38 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:24.130843 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1da970-bea4-4454-a0e4-430c041b9b38 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:24.130932 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1da970-bea4-4454-a0e4-430c041b9b38 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:24.132701 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 661/1315] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:44:24.138103 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7eeb5c-97da-4549-84d0-75099a02f8ec None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:24.138544 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7eeb5c-97da-4549-84d0-75099a02f8ec None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:24.138679 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7eeb5c-97da-4549-84d0-75099a02f8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:24.204596 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-0e7eeb5c-97da-4549-84d0-75099a02f8ec None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:44:24.205782 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-0e7eeb5c-97da-4549-84d0-75099a02f8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:44:24.298465 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 655/1316] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:44:24.351163 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33011b9a-ccc1-469f-a9a6-74a941a98c0e None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:24.351448 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33011b9a-ccc1-469f-a9a6-74a941a98c0e None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:24.351722 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33011b9a-ccc1-469f-a9a6-74a941a98c0e None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:24.354087 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 662/1317] 10.222.0.49 () {54 vars in 963 bytes} [Fri Oct 28 20:44:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:44:24.360580 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3c332-1615-4097-90fc-8f6a853bf2eb None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:24.360863 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3c332-1615-4097-90fc-8f6a853bf2eb None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:24.361135 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3c332-1615-4097-90fc-8f6a853bf2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:24.437374 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-24b3c332-1615-4097-90fc-8f6a853bf2eb None None] MFA Rules not processed for user `691a2da563a84da48ca8fd75a0bfe787`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:44:24.438623 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-24b3c332-1615-4097-90fc-8f6a853bf2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:44:24.512612 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 656/1318] 10.222.0.49 () {58 vars in 1060 bytes} [Fri Oct 28 20:44:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:44:24.521826 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33011b9a-ccc1-469f-a9a6-74a941a98c0e None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:44:24.523364 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-33011b9a-ccc1-469f-a9a6-74a941a98c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:44:24.625908 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33011b9a-ccc1-469f-a9a6-74a941a98c0e None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:44:24.696346 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f6200-01c8-47b4-8eff-b4492df09012 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:44:24.697209 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f6200-01c8-47b4-8eff-b4492df09012 service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:24.697485 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f6200-01c8-47b4-8eff-b4492df09012 service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:24.697751 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f6200-01c8-47b4-8eff-b4492df09012 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:24.699395 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-b94f6200-01c8-47b4-8eff-b4492df09012 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:44:24.806667 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f6200-01c8-47b4-8eff-b4492df09012 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:44:24.808135 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f6200-01c8-47b4-8eff-b4492df09012 service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:44:24.825548 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 663/1319] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:44:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:44:27.734485 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28164e9c-726a-4f81-9ff4-7a15cc23f0f1 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:27.735047 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28164e9c-726a-4f81-9ff4-7a15cc23f0f1 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:27.735047 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28164e9c-726a-4f81-9ff4-7a15cc23f0f1 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:27.736845 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 657/1320] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:44:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:44:27.742221 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1f369-8b52-45d1-a7a0-fb8e0cf68969 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:27.742651 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1f369-8b52-45d1-a7a0-fb8e0cf68969 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:27.742767 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1f369-8b52-45d1-a7a0-fb8e0cf68969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:27.806749 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-51c1f369-8b52-45d1-a7a0-fb8e0cf68969 None None] MFA Rules not processed for user `4041574dcab14bf1acdf530a63ba0554`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:44:27.808098 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-51c1f369-8b52-45d1-a7a0-fb8e0cf68969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:44:27.903092 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 664/1321] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:44:27 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:44:27.945208 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28164e9c-726a-4f81-9ff4-7a15cc23f0f1 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:44:27.947330 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-28164e9c-726a-4f81-9ff4-7a15cc23f0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:44:28.047786 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28164e9c-726a-4f81-9ff4-7a15cc23f0f1 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:44:28.121518 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6c682-0028-4cb7-aab7-486e2c2e9be9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:44:28.122165 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6c682-0028-4cb7-aab7-486e2c2e9be9 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:28.122448 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6c682-0028-4cb7-aab7-486e2c2e9be9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:28.122718 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6c682-0028-4cb7-aab7-486e2c2e9be9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:28.124509 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-8fb6c682-0028-4cb7-aab7-486e2c2e9be9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:44:28.230787 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb6c682-0028-4cb7-aab7-486e2c2e9be9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:44:28.232275 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb6c682-0028-4cb7-aab7-486e2c2e9be9 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:44:28.250719 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 658/1322] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:44:27 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:44:31.204388 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346de5b-fe87-46b5-ab85-e7c3720a8412 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:31.204923 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346de5b-fe87-46b5-ab85-e7c3720a8412 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:31.204923 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346de5b-fe87-46b5-ab85-e7c3720a8412 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:31.206711 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 665/1323] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:44:31.211905 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd569be7-f87d-4618-8be1-32a75bde4286 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:31.212627 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd569be7-f87d-4618-8be1-32a75bde4286 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:31.212627 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd569be7-f87d-4618-8be1-32a75bde4286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:31.276782 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-fd569be7-f87d-4618-8be1-32a75bde4286 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:44:31.277965 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-fd569be7-f87d-4618-8be1-32a75bde4286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:44:31.369496 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 659/1324] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:44:31 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:44:31.409032 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346de5b-fe87-46b5-ab85-e7c3720a8412 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:44:31.410543 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-2346de5b-fe87-46b5-ab85-e7c3720a8412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:44:31.510160 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346de5b-fe87-46b5-ab85-e7c3720a8412 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:44:31.580391 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5394bf24-51b1-4915-9a73-852914e7e8c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:44:31.581030 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394bf24-51b1-4915-9a73-852914e7e8c3 service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:31.581307 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394bf24-51b1-4915-9a73-852914e7e8c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:31.581579 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394bf24-51b1-4915-9a73-852914e7e8c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:31.583207 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-5394bf24-51b1-4915-9a73-852914e7e8c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:44:31.689699 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5394bf24-51b1-4915-9a73-852914e7e8c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:44:31.691127 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5394bf24-51b1-4915-9a73-852914e7e8c3 service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:44:31.708510 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 666/1325] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:44:31 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:44:34.809366 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a9a73-1174-4198-98be-a077cbb41f63 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:34.810063 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a9a73-1174-4198-98be-a077cbb41f63 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:34.810063 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a9a73-1174-4198-98be-a077cbb41f63 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:34.811898 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 660/1326] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:44:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:44:34.817711 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01920e6f-3f9a-45cd-a9f4-c380ba349388 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:34.818249 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01920e6f-3f9a-45cd-a9f4-c380ba349388 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:34.818393 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01920e6f-3f9a-45cd-a9f4-c380ba349388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:34.891799 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-01920e6f-3f9a-45cd-a9f4-c380ba349388 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:44:34.893009 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-01920e6f-3f9a-45cd-a9f4-c380ba349388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:44:34.992253 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 667/1327] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:44:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:44:35.029394 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a9a73-1174-4198-98be-a077cbb41f63 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:44:35.031253 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-b49a9a73-1174-4198-98be-a077cbb41f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:44:35.137016 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a9a73-1174-4198-98be-a077cbb41f63 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:44:35.212084 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6826a-2268-4a1d-ae1a-893f73919a22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:44:35.212740 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6826a-2268-4a1d-ae1a-893f73919a22 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:35.213023 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6826a-2268-4a1d-ae1a-893f73919a22 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:35.213424 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6826a-2268-4a1d-ae1a-893f73919a22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:35.215206 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-9ee6826a-2268-4a1d-ae1a-893f73919a22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:44:35.329617 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee6826a-2268-4a1d-ae1a-893f73919a22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:44:35.331079 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee6826a-2268-4a1d-ae1a-893f73919a22 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:44:35.353152 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 661/1328] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:44:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:44:37.852124 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13047dff-bad6-4656-9979-7b2bfeb17a3b None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:37.853247 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13047dff-bad6-4656-9979-7b2bfeb17a3b None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:37.853381 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13047dff-bad6-4656-9979-7b2bfeb17a3b None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:37.856876 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 668/1329] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:44:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:44:37.861032 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8937b-c3bf-40ae-afd5-3381328c6fdf None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:37.861453 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8937b-c3bf-40ae-afd5-3381328c6fdf None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:37.861581 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8937b-c3bf-40ae-afd5-3381328c6fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:37.928378 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-b9f8937b-c3bf-40ae-afd5-3381328c6fdf None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:44:37.929562 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-b9f8937b-c3bf-40ae-afd5-3381328c6fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:44:38.025161 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 662/1330] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:44:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:44:38.070202 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13047dff-bad6-4656-9979-7b2bfeb17a3b None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:44:38.071898 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-13047dff-bad6-4656-9979-7b2bfeb17a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:44:38.181605 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13047dff-bad6-4656-9979-7b2bfeb17a3b None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:44:38.256097 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9e877-32ca-41a0-99d4-d47afac55b77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:44:38.256740 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9e877-32ca-41a0-99d4-d47afac55b77 service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:38.257012 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9e877-32ca-41a0-99d4-d47afac55b77 service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:38.257274 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9e877-32ca-41a0-99d4-d47afac55b77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:38.259589 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-bfc9e877-32ca-41a0-99d4-d47afac55b77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:44:38.369720 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc9e877-32ca-41a0-99d4-d47afac55b77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:44:38.371222 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc9e877-32ca-41a0-99d4-d47afac55b77 service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:44:38.389673 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 669/1331] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:44:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:44:40.832441 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4b8e9-39d7-4946-b343-199a89d6f05a None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:40.832988 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4b8e9-39d7-4946-b343-199a89d6f05a None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:40.832988 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4b8e9-39d7-4946-b343-199a89d6f05a None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:40.834945 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 663/1332] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:44:40.841360 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cfc33-f304-4ac3-a8b0-47b246a3eb2f None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:40.841875 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cfc33-f304-4ac3-a8b0-47b246a3eb2f None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:40.842088 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cfc33-f304-4ac3-a8b0-47b246a3eb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:40.915114 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-dd8cfc33-f304-4ac3-a8b0-47b246a3eb2f None None] MFA Rules not processed for user `4041574dcab14bf1acdf530a63ba0554`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:44:40.916381 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-dd8cfc33-f304-4ac3-a8b0-47b246a3eb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:44:41.015783 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 670/1333] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:44:40 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:44:41.056530 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4b8e9-39d7-4946-b343-199a89d6f05a None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:44:41.058046 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-4cb4b8e9-39d7-4946-b343-199a89d6f05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:44:41.162459 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4b8e9-39d7-4946-b343-199a89d6f05a None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:44:41.239827 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a699a4f-67d7-43dc-97e9-00f75027ed00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:44:41.240479 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a699a4f-67d7-43dc-97e9-00f75027ed00 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:41.240754 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a699a4f-67d7-43dc-97e9-00f75027ed00 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:41.241021 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a699a4f-67d7-43dc-97e9-00f75027ed00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:41.242699 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-5a699a4f-67d7-43dc-97e9-00f75027ed00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:44:41.359480 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a699a4f-67d7-43dc-97e9-00f75027ed00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:44:41.361020 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a699a4f-67d7-43dc-97e9-00f75027ed00 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:44:41.379053 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 664/1334] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:44:41 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:44:44.036531 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b246f9-01d4-44a5-b5e6-1d0514ee81e3 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:44.037059 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b246f9-01d4-44a5-b5e6-1d0514ee81e3 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:44.037059 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b246f9-01d4-44a5-b5e6-1d0514ee81e3 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:44.038871 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 671/1335] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:44:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:44:44.044221 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4233808-9071-44ad-95f7-ddc94ccba94b None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:44.044649 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4233808-9071-44ad-95f7-ddc94ccba94b None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:44.044774 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4233808-9071-44ad-95f7-ddc94ccba94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:44.113430 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-e4233808-9071-44ad-95f7-ddc94ccba94b None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:44:44.114629 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-e4233808-9071-44ad-95f7-ddc94ccba94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:44:44.219865 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 665/1336] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:44:44.264983 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b246f9-01d4-44a5-b5e6-1d0514ee81e3 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:44:44.266445 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-18b246f9-01d4-44a5-b5e6-1d0514ee81e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:44:44.393601 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b246f9-01d4-44a5-b5e6-1d0514ee81e3 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:44:44.487847 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7223d8-f8e1-403d-b7c0-e525d281c5df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:44:44.488388 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7223d8-f8e1-403d-b7c0-e525d281c5df service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:44.488672 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7223d8-f8e1-403d-b7c0-e525d281c5df service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:44.488958 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7223d8-f8e1-403d-b7c0-e525d281c5df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:44.490643 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-8e7223d8-f8e1-403d-b7c0-e525d281c5df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:44:44.607656 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7223d8-f8e1-403d-b7c0-e525d281c5df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:44:44.609975 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7223d8-f8e1-403d-b7c0-e525d281c5df service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:44:44.629629 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 672/1337] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:44:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:44:47.155517 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d8146-d80a-4fe0-abd7-5da727274bea None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:47.156399 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d8146-d80a-4fe0-abd7-5da727274bea None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:47.156494 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d8146-d80a-4fe0-abd7-5da727274bea None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:47.158433 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 666/1338] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:44:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:44:47.164300 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4feb7-d2e6-4359-a586-238d7e96c1c8 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:47.165289 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4feb7-d2e6-4359-a586-238d7e96c1c8 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:47.165560 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4feb7-d2e6-4359-a586-238d7e96c1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:47.231837 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-67e4feb7-d2e6-4359-a586-238d7e96c1c8 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:44:47.233027 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-67e4feb7-d2e6-4359-a586-238d7e96c1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:44:47.327216 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 673/1339] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:44:47.367964 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d8146-d80a-4fe0-abd7-5da727274bea None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:44:47.370924 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-e23d8146-d80a-4fe0-abd7-5da727274bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:44:47.482723 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d8146-d80a-4fe0-abd7-5da727274bea None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:44:47.486352 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9490a-1302-487c-8dd7-57050e9f163d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:44:47.486997 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9490a-1302-487c-8dd7-57050e9f163d service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:47.487276 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9490a-1302-487c-8dd7-57050e9f163d service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:47.487547 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9490a-1302-487c-8dd7-57050e9f163d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:47.489378 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-06d9490a-1302-487c-8dd7-57050e9f163d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:44:47.592488 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d9490a-1302-487c-8dd7-57050e9f163d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:44:47.593929 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d9490a-1302-487c-8dd7-57050e9f163d service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:44:47.612859 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 667/1340] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:44:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:44:50.669112 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3f7cc-424e-4be6-b5d8-60d2f86c4ba4 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:50.669734 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3f7cc-424e-4be6-b5d8-60d2f86c4ba4 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:50.669866 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3f7cc-424e-4be6-b5d8-60d2f86c4ba4 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:50.671866 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 674/1341] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:44:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:44:50.678252 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959083c0-3710-423b-bd9b-b645b1dc2517 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:50.678780 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959083c0-3710-423b-bd9b-b645b1dc2517 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:50.678780 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959083c0-3710-423b-bd9b-b645b1dc2517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:50.726685 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-959083c0-3710-423b-bd9b-b645b1dc2517 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:44:50.727974 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-959083c0-3710-423b-bd9b-b645b1dc2517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:44:50.802807 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 668/1342] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:44:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:44:50.848050 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3f7cc-424e-4be6-b5d8-60d2f86c4ba4 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:44:50.850220 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-16d3f7cc-424e-4be6-b5d8-60d2f86c4ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:44:50.863535 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3f7cc-424e-4be6-b5d8-60d2f86c4ba4 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:44:50.867055 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72e97a-1d01-4ac9-8600-4926486aa373 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:44:50.867676 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72e97a-1d01-4ac9-8600-4926486aa373 service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:50.868060 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72e97a-1d01-4ac9-8600-4926486aa373 service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:50.868328 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72e97a-1d01-4ac9-8600-4926486aa373 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:50.877008 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72e97a-1d01-4ac9-8600-4926486aa373 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:44:50.878414 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72e97a-1d01-4ac9-8600-4926486aa373 service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:44:50.888169 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 675/1343] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:44:50 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:44:55.301291 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326bc19-63bb-46ef-800c-41079a726c78 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:55.302154 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326bc19-63bb-46ef-800c-41079a726c78 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:55.302331 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326bc19-63bb-46ef-800c-41079a726c78 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:55.304315 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 669/1344] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:44:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:44:55.311762 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f9825-72a8-4788-a3ce-9599535d269a None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:55.312547 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f9825-72a8-4788-a3ce-9599535d269a None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:55.312830 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f9825-72a8-4788-a3ce-9599535d269a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:55.343492 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-678f9825-72a8-4788-a3ce-9599535d269a None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:44:55.344638 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-678f9825-72a8-4788-a3ce-9599535d269a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:44:55.354075 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 676/1345] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:44:55.393774 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326bc19-63bb-46ef-800c-41079a726c78 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:44:55.405516 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326bc19-63bb-46ef-800c-41079a726c78 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:44:55.409455 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a465ce-c1ad-47e1-a7b0-6a0548bb0176 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:44:55.410102 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a465ce-c1ad-47e1-a7b0-6a0548bb0176 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:55.410418 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a465ce-c1ad-47e1-a7b0-6a0548bb0176 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:55.410650 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a465ce-c1ad-47e1-a7b0-6a0548bb0176 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:55.420789 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a465ce-c1ad-47e1-a7b0-6a0548bb0176 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:44:55.422253 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a465ce-c1ad-47e1-a7b0-6a0548bb0176 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:44:55.432876 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 670/1346] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:44:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:44:58.502478 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e0d62-d623-4683-beb0-c65e86066eda None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:58.502994 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e0d62-d623-4683-beb0-c65e86066eda None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:58.502994 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e0d62-d623-4683-beb0-c65e86066eda None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:58.504810 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 677/1347] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:44:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:44:58.510583 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65891112-d653-442c-bfd6-2485ccef6878 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:58.511039 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65891112-d653-442c-bfd6-2485ccef6878 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:58.511254 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65891112-d653-442c-bfd6-2485ccef6878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:58.530239 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-65891112-d653-442c-bfd6-2485ccef6878 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:44:58.531644 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-65891112-d653-442c-bfd6-2485ccef6878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:44:58.540499 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 671/1348] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:44:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:44:58.577337 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e0d62-d623-4683-beb0-c65e86066eda None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:44:58.588976 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e0d62-d623-4683-beb0-c65e86066eda None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:44:58.593162 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23c2ce-25bd-46af-8586-11738d38ea33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:44:58.593821 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23c2ce-25bd-46af-8586-11738d38ea33 service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:44:58.594100 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23c2ce-25bd-46af-8586-11738d38ea33 service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:44:58.594372 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23c2ce-25bd-46af-8586-11738d38ea33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:44:58.604587 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23c2ce-25bd-46af-8586-11738d38ea33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:44:58.606021 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23c2ce-25bd-46af-8586-11738d38ea33 service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:44:58.615876 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 678/1349] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:44:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:45:03.238594 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec2313-6952-4f9d-b259-6258d01f431a None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:03.239092 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec2313-6952-4f9d-b259-6258d01f431a None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:03.239184 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec2313-6952-4f9d-b259-6258d01f431a None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:03.240974 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 672/1350] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:45:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:45:03.246892 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3efe6-a013-4f89-b34e-0c8855f29ac1 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:03.247331 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3efe6-a013-4f89-b34e-0c8855f29ac1 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:03.247441 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3efe6-a013-4f89-b34e-0c8855f29ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:03.266470 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-91d3efe6-a013-4f89-b34e-0c8855f29ac1 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:45:03.267661 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-91d3efe6-a013-4f89-b34e-0c8855f29ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:45:03.276317 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 679/1351] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:45:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:45:03.315239 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec2313-6952-4f9d-b259-6258d01f431a None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:45:03.327034 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec2313-6952-4f9d-b259-6258d01f431a None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:45:03.330796 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cfa829-2889-4369-bad3-1ca56e36d4eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:45:03.331511 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfa829-2889-4369-bad3-1ca56e36d4eb service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:03.331912 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfa829-2889-4369-bad3-1ca56e36d4eb service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:03.332253 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfa829-2889-4369-bad3-1ca56e36d4eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:03.341939 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cfa829-2889-4369-bad3-1ca56e36d4eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:45:03.343322 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cfa829-2889-4369-bad3-1ca56e36d4eb service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:45:03.353671 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 673/1352] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:45:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:45:09.527051 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21539e6a-e5e6-4c5b-ad23-ff7454d0d6ed None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:09.528076 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21539e6a-e5e6-4c5b-ad23-ff7454d0d6ed None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:09.528558 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21539e6a-e5e6-4c5b-ad23-ff7454d0d6ed None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:09.531150 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 680/1353] 10.222.0.49 () {54 vars in 921 bytes} [Fri Oct 28 20:45:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:45:09.538364 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b6cb4-bf1b-41f4-bca1-d6fe3b6b1173 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:09.538847 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b6cb4-bf1b-41f4-bca1-d6fe3b6b1173 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:09.538955 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b6cb4-bf1b-41f4-bca1-d6fe3b6b1173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:09.616986 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-ac6b6cb4-bf1b-41f4-bca1-d6fe3b6b1173 None None] MFA Rules not processed for user `938634e835b94a75af698aef6941958f`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:45:09.619727 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-ac6b6cb4-bf1b-41f4-bca1-d6fe3b6b1173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:45:09.704328 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 674/1354] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Oct 28 20:45:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:45:15.142995 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5bfcb-e247-48e2-a8aa-3dde1e00a5df None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:15.143860 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5bfcb-e247-48e2-a8aa-3dde1e00a5df None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:15.149537 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5bfcb-e247-48e2-a8aa-3dde1e00a5df None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:15.153804 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 681/1355] 10.222.0.49 () {54 vars in 921 bytes} [Fri Oct 28 20:45:15 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:45:15.163029 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acdaf3-bb64-408b-8edc-76ebfde0b620 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:15.165185 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acdaf3-bb64-408b-8edc-76ebfde0b620 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:15.165966 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acdaf3-bb64-408b-8edc-76ebfde0b620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:15.199647 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-73acdaf3-bb64-408b-8edc-76ebfde0b620 None None] MFA Rules not processed for user `938634e835b94a75af698aef6941958f`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:45:15.202037 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-73acdaf3-bb64-408b-8edc-76ebfde0b620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:45:15.232783 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 675/1356] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Oct 28 20:45:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:45:17.340235 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4eadce-b9ac-4149-92bf-d90458baa7e7 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:17.340919 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4eadce-b9ac-4149-92bf-d90458baa7e7 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:17.340919 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4eadce-b9ac-4149-92bf-d90458baa7e7 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:17.342569 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 682/1357] 10.222.0.49 () {54 vars in 921 bytes} [Fri Oct 28 20:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:45:17.348403 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2c22b-c087-4c5f-a742-0d8f964c9ea8 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:17.349236 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2c22b-c087-4c5f-a742-0d8f964c9ea8 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:17.349509 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2c22b-c087-4c5f-a742-0d8f964c9ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:17.369509 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-2ac2c22b-c087-4c5f-a742-0d8f964c9ea8 None None] MFA Rules not processed for user `938634e835b94a75af698aef6941958f`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:45:17.370729 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-2ac2c22b-c087-4c5f-a742-0d8f964c9ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:45:17.379467 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 676/1358] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Oct 28 20:45:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:45:21.639182 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626081d1-4703-41aa-bf3e-4cd3ebdaa7cd None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:21.640094 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626081d1-4703-41aa-bf3e-4cd3ebdaa7cd None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:21.640094 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626081d1-4703-41aa-bf3e-4cd3ebdaa7cd None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:21.641733 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 683/1359] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:45:21.647137 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7dff34-cb6b-4ef2-883e-a5a395696e50 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:21.647666 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7dff34-cb6b-4ef2-883e-a5a395696e50 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:21.647666 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7dff34-cb6b-4ef2-883e-a5a395696e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:21.671283 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-2d7dff34-cb6b-4ef2-883e-a5a395696e50 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:45:21.672986 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-2d7dff34-cb6b-4ef2-883e-a5a395696e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:45:21.685039 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 677/1360] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:45:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:45:21.737879 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801c376-1312-4c64-a749-99f8395b0de1 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:21.738288 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801c376-1312-4c64-a749-99f8395b0de1 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:21.738800 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801c376-1312-4c64-a749-99f8395b0de1 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:21.740829 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 684/1361] 10.222.0.49 () {54 vars in 959 bytes} [Fri Oct 28 20:45:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:45:21.749953 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba28ea-7ff7-4185-8c41-3636e1a75aa5 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:21.750232 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba28ea-7ff7-4185-8c41-3636e1a75aa5 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:21.750697 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba28ea-7ff7-4185-8c41-3636e1a75aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:21.810309 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-c1ba28ea-7ff7-4185-8c41-3636e1a75aa5 None None] MFA Rules not processed for user `04bc6ee009e34a5f82e2807db51523d3`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:45:21.811289 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-c1ba28ea-7ff7-4185-8c41-3636e1a75aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:45:21.931575 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 678/1362] 10.222.0.49 () {58 vars in 1056 bytes} [Fri Oct 28 20:45:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:45:21.940950 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801c376-1312-4c64-a749-99f8395b0de1 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:45:21.965027 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801c376-1312-4c64-a749-99f8395b0de1 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:45:21.972487 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c9883-3b42-47fa-8250-2641f6ef2af1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:45:21.973122 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c9883-3b42-47fa-8250-2641f6ef2af1 service nova] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:21.973411 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c9883-3b42-47fa-8250-2641f6ef2af1 service nova] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:21.973692 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c9883-3b42-47fa-8250-2641f6ef2af1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:21.983319 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c9883-3b42-47fa-8250-2641f6ef2af1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:45:21.985032 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c9883-3b42-47fa-8250-2641f6ef2af1 service nova] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:45:21.996686 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 685/1363] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:45:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:45:24.787454 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f658c8-c06a-436e-9ad1-4647092c9c0c None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:24.788061 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f658c8-c06a-436e-9ad1-4647092c9c0c None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:24.788061 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f658c8-c06a-436e-9ad1-4647092c9c0c None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:24.790120 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 679/1364] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:45:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:45:24.795556 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a0b08-e0e1-407f-aca1-c80957ac6fcb None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:24.796103 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a0b08-e0e1-407f-aca1-c80957ac6fcb None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:24.796180 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a0b08-e0e1-407f-aca1-c80957ac6fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:24.816039 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-a02a0b08-e0e1-407f-aca1-c80957ac6fcb None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:45:24.817584 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-a02a0b08-e0e1-407f-aca1-c80957ac6fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:45:24.826241 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 686/1365] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:45:24.873840 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f658c8-c06a-436e-9ad1-4647092c9c0c None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:45:24.891340 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f658c8-c06a-436e-9ad1-4647092c9c0c None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:45:24.896892 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7783f46-cfaa-4f3f-8e82-890c447a5427 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:45:24.897928 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7783f46-cfaa-4f3f-8e82-890c447a5427 service nova] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:24.899302 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7783f46-cfaa-4f3f-8e82-890c447a5427 service nova] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:24.899969 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7783f46-cfaa-4f3f-8e82-890c447a5427 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:24.910254 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7783f46-cfaa-4f3f-8e82-890c447a5427 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:45:24.911877 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7783f46-cfaa-4f3f-8e82-890c447a5427 service nova] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:45:24.925438 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 680/1366] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:45:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:45:27.773705 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fbc2b-7834-4d24-a898-8415f9a00f0c None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:27.774302 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fbc2b-7834-4d24-a898-8415f9a00f0c None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:27.774814 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fbc2b-7834-4d24-a898-8415f9a00f0c None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:27.776720 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 687/1367] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:45:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:45:27.783271 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5f230-a1bb-45b4-a520-0ce9fca7115e None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:27.783889 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5f230-a1bb-45b4-a520-0ce9fca7115e None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:27.783889 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5f230-a1bb-45b4-a520-0ce9fca7115e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:27.811565 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-3dd5f230-a1bb-45b4-a520-0ce9fca7115e None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:45:27.813042 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-3dd5f230-a1bb-45b4-a520-0ce9fca7115e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:45:27.822543 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 681/1368] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:45:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:45:27.874915 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146711b-5a9d-42a5-bc0a-05b3f6163b43 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:27.875200 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146711b-5a9d-42a5-bc0a-05b3f6163b43 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:27.875544 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146711b-5a9d-42a5-bc0a-05b3f6163b43 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:27.877636 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 688/1369] 10.222.0.49 () {54 vars in 959 bytes} [Fri Oct 28 20:45:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:45:27.883858 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a777a-1596-4245-8d46-fd4a41b605d5 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:27.884230 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a777a-1596-4245-8d46-fd4a41b605d5 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:27.884575 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a777a-1596-4245-8d46-fd4a41b605d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:27.908887 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-0f6a777a-1596-4245-8d46-fd4a41b605d5 None None] MFA Rules not processed for user `04bc6ee009e34a5f82e2807db51523d3`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:45:27.910520 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-0f6a777a-1596-4245-8d46-fd4a41b605d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:45:27.921227 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 682/1370] 10.222.0.49 () {58 vars in 1056 bytes} [Fri Oct 28 20:45:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:45:27.933863 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146711b-5a9d-42a5-bc0a-05b3f6163b43 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:45:27.955822 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146711b-5a9d-42a5-bc0a-05b3f6163b43 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:45:27.964554 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06da80-bee9-4437-99ee-2b006c156c2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:45:27.965108 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06da80-bee9-4437-99ee-2b006c156c2e service nova] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:27.965389 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06da80-bee9-4437-99ee-2b006c156c2e service nova] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:27.965666 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06da80-bee9-4437-99ee-2b006c156c2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:27.978115 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06da80-bee9-4437-99ee-2b006c156c2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:45:27.980184 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06da80-bee9-4437-99ee-2b006c156c2e service nova] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:45:27.994337 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 689/1371] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:45:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:45:30.588187 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fac089-0267-4e6a-91e3-2f33850f9c4c None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:30.588731 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fac089-0267-4e6a-91e3-2f33850f9c4c None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:30.588731 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fac089-0267-4e6a-91e3-2f33850f9c4c None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:30.590775 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 683/1372] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:45:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:45:30.596638 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e391f-5545-4884-8cdb-9ce35a0f885a None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:30.597167 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e391f-5545-4884-8cdb-9ce35a0f885a None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:30.597167 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e391f-5545-4884-8cdb-9ce35a0f885a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:30.620580 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-409e391f-5545-4884-8cdb-9ce35a0f885a None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:45:30.622640 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-409e391f-5545-4884-8cdb-9ce35a0f885a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:45:30.637173 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 690/1373] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:45:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:45:30.685086 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fac089-0267-4e6a-91e3-2f33850f9c4c None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:45:30.705944 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fac089-0267-4e6a-91e3-2f33850f9c4c None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:45:30.712562 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ec269-d6ed-4b4e-a434-396ac7e9c53e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:45:30.713222 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ec269-d6ed-4b4e-a434-396ac7e9c53e service nova] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:30.713678 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ec269-d6ed-4b4e-a434-396ac7e9c53e service nova] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:30.714126 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ec269-d6ed-4b4e-a434-396ac7e9c53e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:30.724064 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ec269-d6ed-4b4e-a434-396ac7e9c53e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:45:30.725963 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ec269-d6ed-4b4e-a434-396ac7e9c53e service nova] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:45:30.744138 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 684/1374] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:45:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:45:31.180625 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96a84f-a7b5-4ab6-9495-bcaaff27451b None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:31.181496 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96a84f-a7b5-4ab6-9495-bcaaff27451b None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:31.181997 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96a84f-a7b5-4ab6-9495-bcaaff27451b None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:31.190982 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e52b6f-3700-4289-ae96-1e63806eb3ca None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:31.191987 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e52b6f-3700-4289-ae96-1e63806eb3ca None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:31.192486 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e52b6f-3700-4289-ae96-1e63806eb3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:31.197295 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 691/1375] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:45:31 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:45:31.225271 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-57e52b6f-3700-4289-ae96-1e63806eb3ca None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:45:31.225271 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-57e52b6f-3700-4289-ae96-1e63806eb3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:45:31.239946 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 685/1376] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:45:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:45:31.686702 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257ec39-dfbf-4f16-9ae7-5af0164298f5 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:31.687589 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257ec39-dfbf-4f16-9ae7-5af0164298f5 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:31.688120 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257ec39-dfbf-4f16-9ae7-5af0164298f5 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:31.691268 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 692/1377] 10.222.0.49 () {54 vars in 962 bytes} [Fri Oct 28 20:45:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:45:31.699099 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40d9ed-3654-4b06-8d6b-532cc810d9ff None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:31.699928 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40d9ed-3654-4b06-8d6b-532cc810d9ff None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:31.699928 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40d9ed-3654-4b06-8d6b-532cc810d9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:31.778987 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-8f40d9ed-3654-4b06-8d6b-532cc810d9ff None None] MFA Rules not processed for user `f305aece531c412b9e0ac30be9f47667`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:45:31.781526 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-8f40d9ed-3654-4b06-8d6b-532cc810d9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:45:31.877132 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 686/1378] 10.222.0.49 () {58 vars in 1059 bytes} [Fri Oct 28 20:45:31 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:45:31.889101 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257ec39-dfbf-4f16-9ae7-5af0164298f5 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:45:31.901547 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257ec39-dfbf-4f16-9ae7-5af0164298f5 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:45:31.906878 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df959cb-28e8-4bca-a7d1-3dbe2cfc5041 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:45:31.907564 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df959cb-28e8-4bca-a7d1-3dbe2cfc5041 service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:31.907860 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df959cb-28e8-4bca-a7d1-3dbe2cfc5041 service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:31.908135 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df959cb-28e8-4bca-a7d1-3dbe2cfc5041 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:31.918929 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df959cb-28e8-4bca-a7d1-3dbe2cfc5041 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:45:31.920410 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df959cb-28e8-4bca-a7d1-3dbe2cfc5041 service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:45:31.946619 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 693/1379] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:45:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:45:33.540334 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012133f4-b8ee-4a13-a280-9b7990b3b5b8 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:33.540896 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012133f4-b8ee-4a13-a280-9b7990b3b5b8 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:33.541226 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012133f4-b8ee-4a13-a280-9b7990b3b5b8 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:33.544544 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 687/1380] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:45:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:45:33.550893 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67409a5-10c5-42cd-82f3-0ca3f415721c None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:33.551448 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67409a5-10c5-42cd-82f3-0ca3f415721c None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:33.551653 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67409a5-10c5-42cd-82f3-0ca3f415721c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:33.576203 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-c67409a5-10c5-42cd-82f3-0ca3f415721c None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:45:33.577777 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-c67409a5-10c5-42cd-82f3-0ca3f415721c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:45:33.587761 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 694/1381] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:45:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:45:33.635294 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012133f4-b8ee-4a13-a280-9b7990b3b5b8 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:45:33.652658 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012133f4-b8ee-4a13-a280-9b7990b3b5b8 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:45:33.658464 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041ca2c-b38d-42b0-a763-6e0395b6ce74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:45:33.659215 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041ca2c-b38d-42b0-a763-6e0395b6ce74 service nova] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:33.659531 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041ca2c-b38d-42b0-a763-6e0395b6ce74 service nova] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:33.659925 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041ca2c-b38d-42b0-a763-6e0395b6ce74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:33.670634 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1041ca2c-b38d-42b0-a763-6e0395b6ce74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:45:33.672287 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1041ca2c-b38d-42b0-a763-6e0395b6ce74 service nova] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:45:33.684089 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 688/1382] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:45:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:45:36.190202 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5521ae4-a7a8-43f1-b1ab-7fb6d44350ff None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:36.190714 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5521ae4-a7a8-43f1-b1ab-7fb6d44350ff None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:36.191086 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5521ae4-a7a8-43f1-b1ab-7fb6d44350ff None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:36.199477 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 695/1383] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:45:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:45:36.202137 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d21867-3405-4959-9e6f-7a38b86f0adf None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:36.202718 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d21867-3405-4959-9e6f-7a38b86f0adf None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:36.203106 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d21867-3405-4959-9e6f-7a38b86f0adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:36.230016 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-d7d21867-3405-4959-9e6f-7a38b86f0adf None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:45:36.231531 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-d7d21867-3405-4959-9e6f-7a38b86f0adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:45:36.250929 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 689/1384] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:45:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:45:36.305030 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5521ae4-a7a8-43f1-b1ab-7fb6d44350ff None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:45:36.330405 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5521ae4-a7a8-43f1-b1ab-7fb6d44350ff None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:45:36.338927 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e7e72-777c-41ae-b811-b0c2f2aaac06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:45:36.339640 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e7e72-777c-41ae-b811-b0c2f2aaac06 service nova] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:36.340129 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e7e72-777c-41ae-b811-b0c2f2aaac06 service nova] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:36.340511 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e7e72-777c-41ae-b811-b0c2f2aaac06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:36.352794 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e7e72-777c-41ae-b811-b0c2f2aaac06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:45:36.354577 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e7e72-777c-41ae-b811-b0c2f2aaac06 service nova] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:45:36.365109 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 696/1385] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:45:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:45:38.928052 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acda6a-587f-4e48-9e3e-93274eac9bb3 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:38.928688 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acda6a-587f-4e48-9e3e-93274eac9bb3 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:38.928688 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acda6a-587f-4e48-9e3e-93274eac9bb3 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:38.930953 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 690/1386] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:45:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:45:38.936569 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c47abf-2cb9-4976-9160-6292e71c6438 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:38.937046 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c47abf-2cb9-4976-9160-6292e71c6438 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:38.937131 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c47abf-2cb9-4976-9160-6292e71c6438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:38.955495 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-19c47abf-2cb9-4976-9160-6292e71c6438 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:45:38.956725 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-19c47abf-2cb9-4976-9160-6292e71c6438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:45:38.968143 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 697/1387] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:45:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:45:39.010037 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08acda6a-587f-4e48-9e3e-93274eac9bb3 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:45:39.034162 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08acda6a-587f-4e48-9e3e-93274eac9bb3 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:45:39.043942 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fabe3c8-bc55-4a0c-aa58-5925bb6f28e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:45:39.044975 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabe3c8-bc55-4a0c-aa58-5925bb6f28e4 service nova] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:39.045430 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabe3c8-bc55-4a0c-aa58-5925bb6f28e4 service nova] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:39.045877 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabe3c8-bc55-4a0c-aa58-5925bb6f28e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:39.060959 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fabe3c8-bc55-4a0c-aa58-5925bb6f28e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:45:39.063696 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fabe3c8-bc55-4a0c-aa58-5925bb6f28e4 service nova] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:45:39.081610 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 691/1388] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:45:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:45:41.916226 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6981d-0d9c-432d-9c87-ff065537b6a4 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:41.916827 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6981d-0d9c-432d-9c87-ff065537b6a4 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:41.917487 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6981d-0d9c-432d-9c87-ff065537b6a4 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:41.921998 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 698/1389] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:45:41 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:45:41.928662 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace70c4-f0eb-476a-a97e-7d3d865f8681 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:41.930050 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace70c4-f0eb-476a-a97e-7d3d865f8681 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:41.930323 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace70c4-f0eb-476a-a97e-7d3d865f8681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:41.950486 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-9ace70c4-f0eb-476a-a97e-7d3d865f8681 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:45:41.952052 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-9ace70c4-f0eb-476a-a97e-7d3d865f8681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:45:41.962411 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 692/1390] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:45:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:45:42.028651 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6981d-0d9c-432d-9c87-ff065537b6a4 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:45:42.050696 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6981d-0d9c-432d-9c87-ff065537b6a4 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:45:42.060432 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37164d-f857-413e-a82f-45ec1629ed61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:45:42.061517 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37164d-f857-413e-a82f-45ec1629ed61 service nova] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:42.061999 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37164d-f857-413e-a82f-45ec1629ed61 service nova] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:42.062379 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37164d-f857-413e-a82f-45ec1629ed61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:42.077046 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d37164d-f857-413e-a82f-45ec1629ed61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:45:42.080014 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d37164d-f857-413e-a82f-45ec1629ed61 service nova] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:45:42.098452 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 699/1391] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:45:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:45:44.609864 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6376cf9-cca6-4fc6-af9d-555479d39177 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:44.610887 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6376cf9-cca6-4fc6-af9d-555479d39177 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:44.610887 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6376cf9-cca6-4fc6-af9d-555479d39177 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:44.612542 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 693/1392] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:45:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:45:44.618577 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784665d8-0c7f-45d5-9a0b-f61a7305f5f0 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:44.619180 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784665d8-0c7f-45d5-9a0b-f61a7305f5f0 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:44.619276 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784665d8-0c7f-45d5-9a0b-f61a7305f5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:44.641708 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-784665d8-0c7f-45d5-9a0b-f61a7305f5f0 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:45:44.643132 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-784665d8-0c7f-45d5-9a0b-f61a7305f5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:45:44.652015 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 700/1393] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:45:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:45:44.698819 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6376cf9-cca6-4fc6-af9d-555479d39177 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:45:44.715073 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6376cf9-cca6-4fc6-af9d-555479d39177 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:45:44.720626 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1bd9c-806c-4332-bfd6-c85fe834b8f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:45:44.721267 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1bd9c-806c-4332-bfd6-c85fe834b8f7 service nova] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:44.721538 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1bd9c-806c-4332-bfd6-c85fe834b8f7 service nova] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:44.721811 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1bd9c-806c-4332-bfd6-c85fe834b8f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:44.730961 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1bd9c-806c-4332-bfd6-c85fe834b8f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:45:44.732525 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1bd9c-806c-4332-bfd6-c85fe834b8f7 service nova] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:45:44.742717 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 694/1394] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:45:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:45:47.205712 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d03203-2a44-44c3-acdd-0fc9a61506ea None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:47.206415 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d03203-2a44-44c3-acdd-0fc9a61506ea None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:47.206415 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d03203-2a44-44c3-acdd-0fc9a61506ea None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:47.208320 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 701/1395] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:45:47.213855 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d94076-41b2-4530-a079-bf993db2095b None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:47.214324 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d94076-41b2-4530-a079-bf993db2095b None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:47.214424 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d94076-41b2-4530-a079-bf993db2095b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:47.233162 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-04d94076-41b2-4530-a079-bf993db2095b None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:45:47.234594 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-04d94076-41b2-4530-a079-bf993db2095b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:45:47.243110 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 695/1396] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:45:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:45:47.290213 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d03203-2a44-44c3-acdd-0fc9a61506ea None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:45:47.304718 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d03203-2a44-44c3-acdd-0fc9a61506ea None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:45:47.310338 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a6e80-369e-4dbd-9169-6b5743a282f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:45:47.310980 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a6e80-369e-4dbd-9169-6b5743a282f8 service nova] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:47.311258 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a6e80-369e-4dbd-9169-6b5743a282f8 service nova] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:47.311527 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a6e80-369e-4dbd-9169-6b5743a282f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:47.324224 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3a6e80-369e-4dbd-9169-6b5743a282f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:45:47.326161 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3a6e80-369e-4dbd-9169-6b5743a282f8 service nova] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:45:47.337131 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 702/1397] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:45:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:45:49.839363 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae6dfe-6b8f-4918-b293-d8191e09be9e None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:49.840319 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae6dfe-6b8f-4918-b293-d8191e09be9e None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:49.840319 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae6dfe-6b8f-4918-b293-d8191e09be9e None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:49.842403 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 696/1398] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:45:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:45:49.848347 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61940dc-60c2-4a16-b06d-b5bca13b0b54 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:49.848948 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61940dc-60c2-4a16-b06d-b5bca13b0b54 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:49.848948 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61940dc-60c2-4a16-b06d-b5bca13b0b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:49.869718 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-b61940dc-60c2-4a16-b06d-b5bca13b0b54 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:45:49.870935 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-b61940dc-60c2-4a16-b06d-b5bca13b0b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:45:49.879123 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 703/1399] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:45:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:45:49.924045 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae6dfe-6b8f-4918-b293-d8191e09be9e None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:45:49.942006 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae6dfe-6b8f-4918-b293-d8191e09be9e None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:45:49.949694 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4920a-2527-4868-9198-01506b0d5ed6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:45:49.950342 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4920a-2527-4868-9198-01506b0d5ed6 service nova] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:49.950613 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4920a-2527-4868-9198-01506b0d5ed6 service nova] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:49.950887 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4920a-2527-4868-9198-01506b0d5ed6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:49.959793 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c4920a-2527-4868-9198-01506b0d5ed6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:45:49.961964 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c4920a-2527-4868-9198-01506b0d5ed6 service nova] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:45:49.972237 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 697/1400] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:45:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:45:50.626562 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4c26c-31ac-4b9d-85ab-4ee77f21e66d None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:50.626849 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4c26c-31ac-4b9d-85ab-4ee77f21e66d None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:50.627128 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4c26c-31ac-4b9d-85ab-4ee77f21e66d None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:50.628982 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 704/1401] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:45:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:45:50.637046 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863dd64-92b4-4d1f-8309-4b79622dfa48 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:50.637398 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863dd64-92b4-4d1f-8309-4b79622dfa48 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:50.637705 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863dd64-92b4-4d1f-8309-4b79622dfa48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:50.662357 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-e863dd64-92b4-4d1f-8309-4b79622dfa48 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:45:50.664396 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-e863dd64-92b4-4d1f-8309-4b79622dfa48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:45:50.672768 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 698/1402] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:45:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:45:50.733002 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2412e1c-ce17-487b-b7f2-b9b43f270ee1 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:50.733268 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2412e1c-ce17-487b-b7f2-b9b43f270ee1 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:50.733547 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2412e1c-ce17-487b-b7f2-b9b43f270ee1 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:50.735383 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 705/1403] 10.222.0.49 () {54 vars in 961 bytes} [Fri Oct 28 20:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:45:50.740976 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1bce4-64e8-4714-8d9f-ccb59130f58f None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:50.741307 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1bce4-64e8-4714-8d9f-ccb59130f58f None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:50.741586 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1bce4-64e8-4714-8d9f-ccb59130f58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:50.799300 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-d4f1bce4-64e8-4714-8d9f-ccb59130f58f None None] MFA Rules not processed for user `05029a41bd2b42febfd5ce91a3f28c24`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:45:50.800562 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-d4f1bce4-64e8-4714-8d9f-ccb59130f58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:45:50.903259 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 699/1404] 10.222.0.49 () {58 vars in 1058 bytes} [Fri Oct 28 20:45:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:45:50.911704 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2412e1c-ce17-487b-b7f2-b9b43f270ee1 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:45:50.924047 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2412e1c-ce17-487b-b7f2-b9b43f270ee1 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:45:50.928326 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711616b6-d6af-4c0e-974d-f77ac4ccdb77 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05029a41bd2b42febfd5ce91a3f28c24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:45:50.929234 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711616b6-d6af-4c0e-974d-f77ac4ccdb77 service glance] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:50.929570 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711616b6-d6af-4c0e-974d-f77ac4ccdb77 service glance] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:50.929892 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711616b6-d6af-4c0e-974d-f77ac4ccdb77 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:50.942237 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711616b6-d6af-4c0e-974d-f77ac4ccdb77 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:45:50.953064 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711616b6-d6af-4c0e-974d-f77ac4ccdb77 service glance] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:45:50.966429 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 706/1405] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:45:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:45:51.469409 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17a370-5e5a-4234-8ecb-b8cfccaa6dc6 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:51.469696 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17a370-5e5a-4234-8ecb-b8cfccaa6dc6 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:51.469969 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17a370-5e5a-4234-8ecb-b8cfccaa6dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:51.537442 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-7b17a370-5e5a-4234-8ecb-b8cfccaa6dc6 None None] MFA Rules not processed for user `78cde480dd8b4a85ac30895026bfc406`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:45:51.540073 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-7b17a370-5e5a-4234-8ecb-b8cfccaa6dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:45:51.653813 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 700/1406] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Oct 28 20:45:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:45:51.711505 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdd80d-06fd-4b8a-8fad-f645c65f2e28 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:51.712112 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdd80d-06fd-4b8a-8fad-f645c65f2e28 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:51.712728 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdd80d-06fd-4b8a-8fad-f645c65f2e28 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:51.715419 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 707/1407] 10.222.0.49 () {54 vars in 942 bytes} [Fri Oct 28 20:45:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:45:51.724595 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441a5ed-486d-4093-9412-fcf375900303 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:51.725174 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441a5ed-486d-4093-9412-fcf375900303 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:51.725473 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441a5ed-486d-4093-9412-fcf375900303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:51.811671 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-b441a5ed-486d-4093-9412-fcf375900303 None None] MFA Rules not processed for user `91d70db11d2d4923943bc6479bc49206`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:45:51.813184 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-b441a5ed-486d-4093-9412-fcf375900303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:45:51.906662 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 701/1408] 10.222.0.49 () {58 vars in 1039 bytes} [Fri Oct 28 20:45:51 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:45:51.919552 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fdd80d-06fd-4b8a-8fad-f645c65f2e28 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:45:51.936000 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fdd80d-06fd-4b8a-8fad-f645c65f2e28 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:45:51.942869 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bab216-3e86-40a0-a3c5-ace13e908453 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d70db11d2d4923943bc6479bc49206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:45:51.943893 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bab216-3e86-40a0-a3c5-ace13e908453 service swift] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:51.944178 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bab216-3e86-40a0-a3c5-ace13e908453 service swift] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:51.945031 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bab216-3e86-40a0-a3c5-ace13e908453 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:51.955572 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bab216-3e86-40a0-a3c5-ace13e908453 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:45:51.958092 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bab216-3e86-40a0-a3c5-ace13e908453 service swift] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:45:51.971975 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 708/1409] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Oct 28 20:45:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 20:45:52.588234 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fee7d-3746-496a-bcdf-ea789bd26e4b None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:52.588806 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fee7d-3746-496a-bcdf-ea789bd26e4b None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:52.589386 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fee7d-3746-496a-bcdf-ea789bd26e4b None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:52.591207 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 702/1410] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:45:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:45:52.597121 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f31a0-43bc-44b5-9eb2-e99a22fc1c4a None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:52.597675 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f31a0-43bc-44b5-9eb2-e99a22fc1c4a None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:52.598322 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f31a0-43bc-44b5-9eb2-e99a22fc1c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:52.617975 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-502f31a0-43bc-44b5-9eb2-e99a22fc1c4a None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:45:52.619350 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-502f31a0-43bc-44b5-9eb2-e99a22fc1c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:45:52.628038 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 709/1411] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:45:52.675069 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fee7d-3746-496a-bcdf-ea789bd26e4b None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:45:52.691010 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fee7d-3746-496a-bcdf-ea789bd26e4b None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:45:52.700415 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e872a24-7712-4643-94c2-2f147f931f10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:45:52.701694 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e872a24-7712-4643-94c2-2f147f931f10 service nova] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:45:52.702185 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e872a24-7712-4643-94c2-2f147f931f10 service nova] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:45:52.702689 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e872a24-7712-4643-94c2-2f147f931f10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:45:52.713699 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e872a24-7712-4643-94c2-2f147f931f10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:45:52.715704 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e872a24-7712-4643-94c2-2f147f931f10 service nova] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:45:52.727334 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 703/1412] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:45:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:46:15.704941 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf62e4-168b-477d-b06a-97343e48389f None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:15.705579 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf62e4-168b-477d-b06a-97343e48389f None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:15.705579 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf62e4-168b-477d-b06a-97343e48389f None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:15.707179 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 710/1413] 10.222.0.49 () {54 vars in 918 bytes} [Fri Oct 28 20:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:46:15.713295 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365708b-8c0c-40a5-96bf-01e042d55ce9 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:15.713939 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365708b-8c0c-40a5-96bf-01e042d55ce9 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:15.713939 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365708b-8c0c-40a5-96bf-01e042d55ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:15.732650 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-f365708b-8c0c-40a5-96bf-01e042d55ce9 None None] MFA Rules not processed for user `938634e835b94a75af698aef6941958f`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:46:15.733847 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-f365708b-8c0c-40a5-96bf-01e042d55ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:46:15.743001 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 704/1414] 10.222.0.49 () {58 vars in 1015 bytes} [Fri Oct 28 20:46:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:46:15.758116 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31799aa4-eeb1-4d10-9ca2-5f13f310453d None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:15.758398 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31799aa4-eeb1-4d10-9ca2-5f13f310453d None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:15.758670 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31799aa4-eeb1-4d10-9ca2-5f13f310453d None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:15.760501 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 711/1415] 10.222.0.49 () {54 vars in 918 bytes} [Fri Oct 28 20:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:46:15.766030 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f4ad9-8288-41ee-bc6a-373e5fb7f4e7 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:15.766312 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f4ad9-8288-41ee-bc6a-373e5fb7f4e7 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:15.766586 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f4ad9-8288-41ee-bc6a-373e5fb7f4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:15.786632 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-f38f4ad9-8288-41ee-bc6a-373e5fb7f4e7 None None] MFA Rules not processed for user `04bc6ee009e34a5f82e2807db51523d3`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:46:15.788703 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-f38f4ad9-8288-41ee-bc6a-373e5fb7f4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:46:15.798072 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 705/1416] 10.222.0.49 () {58 vars in 1015 bytes} [Fri Oct 28 20:46:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:46:18.659211 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1e1ba-3fdb-4988-b10c-4d9fd22d5460 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:18.659873 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1e1ba-3fdb-4988-b10c-4d9fd22d5460 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:18.659873 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1e1ba-3fdb-4988-b10c-4d9fd22d5460 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:18.661591 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 28 20:46:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:46:18.668013 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9dc35-122d-4fad-aca7-8a74646937c8 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:18.668896 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9dc35-122d-4fad-aca7-8a74646937c8 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:18.669265 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9dc35-122d-4fad-aca7-8a74646937c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:18.689344 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-0ed9dc35-122d-4fad-aca7-8a74646937c8 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:46:18.690547 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-0ed9dc35-122d-4fad-aca7-8a74646937c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:46:18.698991 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 28 20:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:46:18.742665 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1e1ba-3fdb-4988-b10c-4d9fd22d5460 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:46:18.758585 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1e1ba-3fdb-4988-b10c-4d9fd22d5460 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:46:18.764069 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ed27a-029d-4492-88d2-56fb9cf1db61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:46:18.764703 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ed27a-029d-4492-88d2-56fb9cf1db61 service nova] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:18.765059 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ed27a-029d-4492-88d2-56fb9cf1db61 service nova] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:18.765334 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ed27a-029d-4492-88d2-56fb9cf1db61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:18.773952 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ed27a-029d-4492-88d2-56fb9cf1db61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:46:18.775530 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ed27a-029d-4492-88d2-56fb9cf1db61 service nova] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:46:18.785378 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 713/1419] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:46:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:46:20.228129 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650366f-4834-497c-ad44-3e27cc611008 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:20.228681 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650366f-4834-497c-ad44-3e27cc611008 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:20.228681 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650366f-4834-497c-ad44-3e27cc611008 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:20.230461 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 20:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:46:20.236136 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0366c-979c-48b9-93ad-b1e84aa13da7 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:20.236733 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0366c-979c-48b9-93ad-b1e84aa13da7 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:20.236733 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0366c-979c-48b9-93ad-b1e84aa13da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:20.255686 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-e6c0366c-979c-48b9-93ad-b1e84aa13da7 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:46:20.257453 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-e6c0366c-979c-48b9-93ad-b1e84aa13da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:46:20.265700 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 20:46:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:46:20.430841 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650366f-4834-497c-ad44-3e27cc611008 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:46:20.445732 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650366f-4834-497c-ad44-3e27cc611008 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:46:20.451181 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d9f59-0113-4a59-a1a3-3fe6bf023bd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:46:20.451851 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d9f59-0113-4a59-a1a3-3fe6bf023bd0 service nova] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:20.452133 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d9f59-0113-4a59-a1a3-3fe6bf023bd0 service nova] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:20.452406 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d9f59-0113-4a59-a1a3-3fe6bf023bd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:20.461034 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d9f59-0113-4a59-a1a3-3fe6bf023bd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:46:20.462626 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d9f59-0113-4a59-a1a3-3fe6bf023bd0 service nova] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:46:20.472121 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 708/1422] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:46:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:46:21.828127 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9c42a-7a9d-4d38-a13c-a1bd3bdc3ecc None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:21.828788 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9c42a-7a9d-4d38-a13c-a1bd3bdc3ecc None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:21.828788 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9c42a-7a9d-4d38-a13c-a1bd3bdc3ecc None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:21.830526 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 20:46:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:46:21.837135 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412bd35-2619-4567-971b-40373239b046 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:21.837689 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412bd35-2619-4567-971b-40373239b046 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:21.837689 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412bd35-2619-4567-971b-40373239b046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:21.857966 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-8412bd35-2619-4567-971b-40373239b046 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:46:21.859194 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-8412bd35-2619-4567-971b-40373239b046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:46:21.868075 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 20:46:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:46:22.019057 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9c42a-7a9d-4d38-a13c-a1bd3bdc3ecc None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:46:22.034693 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9c42a-7a9d-4d38-a13c-a1bd3bdc3ecc None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:46:22.040195 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd99c6c-6895-426f-800c-25317f3014af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:46:22.040830 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd99c6c-6895-426f-800c-25317f3014af service nova] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:22.041109 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd99c6c-6895-426f-800c-25317f3014af service nova] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:22.041381 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd99c6c-6895-426f-800c-25317f3014af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:22.049760 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd99c6c-6895-426f-800c-25317f3014af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:46:22.051347 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd99c6c-6895-426f-800c-25317f3014af service nova] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:46:22.061440 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 716/1425] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:46:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:46:23.438480 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb87631-92d0-4a89-bbb8-a2de58c74d5b None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:23.439057 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb87631-92d0-4a89-bbb8-a2de58c74d5b None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:23.439057 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb87631-92d0-4a89-bbb8-a2de58c74d5b None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:23.440862 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 20:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:46:23.446325 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abefd6-0aae-497c-a2ba-112ac3982613 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:23.446758 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abefd6-0aae-497c-a2ba-112ac3982613 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:23.446944 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abefd6-0aae-497c-a2ba-112ac3982613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:23.465420 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-14abefd6-0aae-497c-a2ba-112ac3982613 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:46:23.466609 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-14abefd6-0aae-497c-a2ba-112ac3982613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:46:23.474474 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 20:46:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:46:23.636621 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb87631-92d0-4a89-bbb8-a2de58c74d5b None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:46:23.651516 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb87631-92d0-4a89-bbb8-a2de58c74d5b None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:46:23.657104 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce98682-3831-4f52-88d7-c6e964b56856 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:46:23.657741 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce98682-3831-4f52-88d7-c6e964b56856 service nova] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:23.658059 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce98682-3831-4f52-88d7-c6e964b56856 service nova] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:23.658275 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce98682-3831-4f52-88d7-c6e964b56856 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:23.668315 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce98682-3831-4f52-88d7-c6e964b56856 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:46:23.669903 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce98682-3831-4f52-88d7-c6e964b56856 service nova] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:46:23.679916 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 711/1428] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:46:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:46:25.042011 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292de4da-8ce7-42c2-afe2-2b070f2b1ee6 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:25.042562 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292de4da-8ce7-42c2-afe2-2b070f2b1ee6 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:25.042562 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292de4da-8ce7-42c2-afe2-2b070f2b1ee6 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:25.044398 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 20:46:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:46:25.049691 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab60864-ac88-47e3-86c7-7df01b69d33e None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:25.050203 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab60864-ac88-47e3-86c7-7df01b69d33e None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:25.050333 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab60864-ac88-47e3-86c7-7df01b69d33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:25.068573 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-3ab60864-ac88-47e3-86c7-7df01b69d33e None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:46:25.070440 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-3ab60864-ac88-47e3-86c7-7df01b69d33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:46:25.078108 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 20:46:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:46:25.229879 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292de4da-8ce7-42c2-afe2-2b070f2b1ee6 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:46:25.244697 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292de4da-8ce7-42c2-afe2-2b070f2b1ee6 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:46:25.250021 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b7d15-92f4-4034-a9c1-b546abc4735f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:46:25.250648 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b7d15-92f4-4034-a9c1-b546abc4735f service nova] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:25.250925 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b7d15-92f4-4034-a9c1-b546abc4735f service nova] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:25.251197 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b7d15-92f4-4034-a9c1-b546abc4735f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:25.260286 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b7d15-92f4-4034-a9c1-b546abc4735f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:46:25.261887 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b7d15-92f4-4034-a9c1-b546abc4735f service nova] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:46:25.271417 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 719/1431] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:46:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:46:26.578632 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbc9f1-9091-4bea-86f3-bcc9adad7214 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:26.579177 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbc9f1-9091-4bea-86f3-bcc9adad7214 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:26.579177 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbc9f1-9091-4bea-86f3-bcc9adad7214 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:26.581006 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 20:46:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:46:26.586277 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c95647-3c04-400c-9297-e7ce8c7dc2d9 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:26.586747 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c95647-3c04-400c-9297-e7ce8c7dc2d9 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:26.586841 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c95647-3c04-400c-9297-e7ce8c7dc2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:26.606176 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-b1c95647-3c04-400c-9297-e7ce8c7dc2d9 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:46:26.607355 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-b1c95647-3c04-400c-9297-e7ce8c7dc2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:46:26.614992 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 20:46:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:46:26.769297 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbc9f1-9091-4bea-86f3-bcc9adad7214 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:46:26.783727 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbc9f1-9091-4bea-86f3-bcc9adad7214 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:46:26.789709 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ca4f3-4a01-4d1c-8e33-3acc5432bb49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:46:26.790337 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ca4f3-4a01-4d1c-8e33-3acc5432bb49 service nova] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:26.790650 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ca4f3-4a01-4d1c-8e33-3acc5432bb49 service nova] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:26.790881 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ca4f3-4a01-4d1c-8e33-3acc5432bb49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:26.798886 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ca4f3-4a01-4d1c-8e33-3acc5432bb49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:46:26.800505 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ca4f3-4a01-4d1c-8e33-3acc5432bb49 service nova] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:46:26.810360 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 714/1434] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:46:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:46:28.109482 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930cfe4-5ad6-49df-88a4-402f86c40632 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:28.110038 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930cfe4-5ad6-49df-88a4-402f86c40632 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:28.110038 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930cfe4-5ad6-49df-88a4-402f86c40632 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:28.111852 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 20:46:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:46:28.117406 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb955550-12ad-4bdf-be60-e835d317e9bb None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:28.117891 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb955550-12ad-4bdf-be60-e835d317e9bb None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:28.117988 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb955550-12ad-4bdf-be60-e835d317e9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:28.136737 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-eb955550-12ad-4bdf-be60-e835d317e9bb None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:46:28.137951 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-eb955550-12ad-4bdf-be60-e835d317e9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:46:28.145881 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 20:46:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:46:28.298670 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930cfe4-5ad6-49df-88a4-402f86c40632 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:46:28.313755 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930cfe4-5ad6-49df-88a4-402f86c40632 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:46:28.319227 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802391f-51e5-44f9-ab3a-5d1764a66f46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:46:28.319891 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802391f-51e5-44f9-ab3a-5d1764a66f46 service nova] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:28.320178 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802391f-51e5-44f9-ab3a-5d1764a66f46 service nova] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:28.320444 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802391f-51e5-44f9-ab3a-5d1764a66f46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:28.328567 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802391f-51e5-44f9-ab3a-5d1764a66f46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:46:28.330142 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802391f-51e5-44f9-ab3a-5d1764a66f46 service nova] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:46:28.339499 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 722/1437] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:46:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:46:29.641581 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1dfe32-d2da-4637-b5e4-e2d617593686 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:29.642115 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1dfe32-d2da-4637-b5e4-e2d617593686 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:29.642115 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1dfe32-d2da-4637-b5e4-e2d617593686 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:29.644254 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 20:46:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:46:29.650287 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aec228-2b1e-4503-ad24-77e007aa0d03 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:29.650767 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aec228-2b1e-4503-ad24-77e007aa0d03 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:29.650895 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aec228-2b1e-4503-ad24-77e007aa0d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:29.669508 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-75aec228-2b1e-4503-ad24-77e007aa0d03 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:46:29.670704 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-75aec228-2b1e-4503-ad24-77e007aa0d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:46:29.678790 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 20:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:46:29.834939 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1dfe32-d2da-4637-b5e4-e2d617593686 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:46:29.849081 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1dfe32-d2da-4637-b5e4-e2d617593686 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:46:29.856182 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31cd45f-d897-4c9f-b156-fcdd6f24eb09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:46:29.856819 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cd45f-d897-4c9f-b156-fcdd6f24eb09 service nova] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:29.857093 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cd45f-d897-4c9f-b156-fcdd6f24eb09 service nova] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:29.857363 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cd45f-d897-4c9f-b156-fcdd6f24eb09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:29.866457 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31cd45f-d897-4c9f-b156-fcdd6f24eb09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:46:29.868061 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31cd45f-d897-4c9f-b156-fcdd6f24eb09 service nova] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:46:29.877274 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 717/1440] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:46:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:46:31.166675 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c8e85-a8cc-47c3-9cd5-7323465455e9 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:31.167224 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c8e85-a8cc-47c3-9cd5-7323465455e9 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:31.167224 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c8e85-a8cc-47c3-9cd5-7323465455e9 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:31.168993 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 20:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:46:31.174384 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03445ab-d475-4c49-b685-717f32c50904 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:31.174825 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03445ab-d475-4c49-b685-717f32c50904 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:31.174960 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03445ab-d475-4c49-b685-717f32c50904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:31.193553 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-c03445ab-d475-4c49-b685-717f32c50904 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:46:31.194787 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-c03445ab-d475-4c49-b685-717f32c50904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:46:31.202588 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 20:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:46:31.355064 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c8e85-a8cc-47c3-9cd5-7323465455e9 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:46:31.369597 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c8e85-a8cc-47c3-9cd5-7323465455e9 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:46:31.374822 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080b53b-041c-4210-9636-3f0db82f2320 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:46:31.375441 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080b53b-041c-4210-9636-3f0db82f2320 service nova] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:31.375711 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080b53b-041c-4210-9636-3f0db82f2320 service nova] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:31.376006 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080b53b-041c-4210-9636-3f0db82f2320 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:31.384022 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080b53b-041c-4210-9636-3f0db82f2320 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:46:31.385583 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080b53b-041c-4210-9636-3f0db82f2320 service nova] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:46:31.394694 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 725/1443] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:46:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:46:33.639304 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da248e-c209-4284-8255-dc9bce37ddd9 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:33.639841 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da248e-c209-4284-8255-dc9bce37ddd9 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:33.639841 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da248e-c209-4284-8255-dc9bce37ddd9 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:33.641613 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 28 20:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:46:33.647497 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b7133-3770-4467-b86e-eb3407cf30a8 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:33.648011 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b7133-3770-4467-b86e-eb3407cf30a8 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:33.648131 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b7133-3770-4467-b86e-eb3407cf30a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:33.667052 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-c88b7133-3770-4467-b86e-eb3407cf30a8 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:46:33.668397 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-c88b7133-3770-4467-b86e-eb3407cf30a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:46:33.676243 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 28 20:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:46:33.715137 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da248e-c209-4284-8255-dc9bce37ddd9 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:46:33.726288 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da248e-c209-4284-8255-dc9bce37ddd9 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:46:33.729807 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d9cc2-3576-4319-9c9d-63504dab9c49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:46:33.730459 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d9cc2-3576-4319-9c9d-63504dab9c49 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:33.730722 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d9cc2-3576-4319-9c9d-63504dab9c49 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:33.730993 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d9cc2-3576-4319-9c9d-63504dab9c49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:33.740981 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d9cc2-3576-4319-9c9d-63504dab9c49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:46:33.742616 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d9cc2-3576-4319-9c9d-63504dab9c49 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:46:33.752338 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 720/1446] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:46:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:46:36.299396 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1ffe2-3dbe-4a9d-bb89-c32cba469c16 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:36.300036 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1ffe2-3dbe-4a9d-bb89-c32cba469c16 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:36.300036 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1ffe2-3dbe-4a9d-bb89-c32cba469c16 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:36.301764 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 28 20:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:46:36.307899 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb221505-d3aa-4c8e-b76d-1cfd4c46ab2a None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:36.308389 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb221505-d3aa-4c8e-b76d-1cfd4c46ab2a None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:36.308488 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb221505-d3aa-4c8e-b76d-1cfd4c46ab2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:36.327755 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-bb221505-d3aa-4c8e-b76d-1cfd4c46ab2a None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:46:36.328949 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-bb221505-d3aa-4c8e-b76d-1cfd4c46ab2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:46:36.336742 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 28 20:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:46:36.376612 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1ffe2-3dbe-4a9d-bb89-c32cba469c16 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:46:36.387126 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1ffe2-3dbe-4a9d-bb89-c32cba469c16 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:46:36.390676 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42fc955-a35b-421a-88d6-392d14bfaa41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:46:36.391299 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fc955-a35b-421a-88d6-392d14bfaa41 service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:36.391573 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fc955-a35b-421a-88d6-392d14bfaa41 service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:36.391870 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fc955-a35b-421a-88d6-392d14bfaa41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:36.401158 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42fc955-a35b-421a-88d6-392d14bfaa41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:46:36.402513 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42fc955-a35b-421a-88d6-392d14bfaa41 service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:46:36.412782 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 728/1449] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:46:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:46:39.063833 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093ee76-063e-4cf6-b232-b678f836f5c3 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:39.064393 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093ee76-063e-4cf6-b232-b678f836f5c3 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:39.064393 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093ee76-063e-4cf6-b232-b678f836f5c3 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:39.066220 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 28 20:46:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:46:39.072210 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77921e61-021b-4b75-8edb-0c01533bdaad None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:39.072637 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77921e61-021b-4b75-8edb-0c01533bdaad None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:39.072789 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77921e61-021b-4b75-8edb-0c01533bdaad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:39.090674 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-77921e61-021b-4b75-8edb-0c01533bdaad None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:46:39.091887 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-77921e61-021b-4b75-8edb-0c01533bdaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:46:39.100087 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 28 20:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:46:39.140430 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093ee76-063e-4cf6-b232-b678f836f5c3 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:46:39.151536 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093ee76-063e-4cf6-b232-b678f836f5c3 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:46:39.155288 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e7b0f-e418-45c7-b9e7-3d616452cb6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:46:39.155945 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e7b0f-e418-45c7-b9e7-3d616452cb6a service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:39.156221 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e7b0f-e418-45c7-b9e7-3d616452cb6a service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:39.156487 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e7b0f-e418-45c7-b9e7-3d616452cb6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:39.165491 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e7b0f-e418-45c7-b9e7-3d616452cb6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:46:39.166969 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e7b0f-e418-45c7-b9e7-3d616452cb6a service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:46:39.176555 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 723/1452] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:46:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:46:41.689161 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c284f-371e-4797-892e-5cad13f446aa None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:41.689694 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c284f-371e-4797-892e-5cad13f446aa None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:41.689694 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c284f-371e-4797-892e-5cad13f446aa None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:41.691444 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 28 20:46:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:46:41.697255 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb17db7-a73b-49b9-b39e-b09b37afd5e2 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:41.697737 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb17db7-a73b-49b9-b39e-b09b37afd5e2 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:41.697877 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb17db7-a73b-49b9-b39e-b09b37afd5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:41.716631 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-3eb17db7-a73b-49b9-b39e-b09b37afd5e2 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:46:41.717917 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-3eb17db7-a73b-49b9-b39e-b09b37afd5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:46:41.726513 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 28 20:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:46:41.766303 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c284f-371e-4797-892e-5cad13f446aa None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:46:41.776812 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c284f-371e-4797-892e-5cad13f446aa None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:46:41.780542 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d3480-fdb1-4098-be72-47d46fb42a8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:46:41.781169 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d3480-fdb1-4098-be72-47d46fb42a8f service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:41.781444 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d3480-fdb1-4098-be72-47d46fb42a8f service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:41.781714 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d3480-fdb1-4098-be72-47d46fb42a8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:41.791245 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d3480-fdb1-4098-be72-47d46fb42a8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:46:41.792701 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d3480-fdb1-4098-be72-47d46fb42a8f service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:46:41.803326 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 731/1455] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:46:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:46:44.255363 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e24b0-d603-4f42-88e2-c677721dc6bc None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:44.256022 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e24b0-d603-4f42-88e2-c677721dc6bc None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:44.256120 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e24b0-d603-4f42-88e2-c677721dc6bc None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:44.257876 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 28 20:46:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:46:44.263347 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70352092-9d81-487f-808b-4b010a4758b0 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:44.263907 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70352092-9d81-487f-808b-4b010a4758b0 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:44.264016 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70352092-9d81-487f-808b-4b010a4758b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:44.282742 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-70352092-9d81-487f-808b-4b010a4758b0 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:46:44.283965 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-70352092-9d81-487f-808b-4b010a4758b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:46:44.292563 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 28 20:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:46:44.331800 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e24b0-d603-4f42-88e2-c677721dc6bc None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:46:44.342852 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e24b0-d603-4f42-88e2-c677721dc6bc None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:46:44.346306 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d3466-1ba0-407c-89da-84e4193f450d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:46:44.346935 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d3466-1ba0-407c-89da-84e4193f450d service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:44.347209 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d3466-1ba0-407c-89da-84e4193f450d service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:44.347474 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d3466-1ba0-407c-89da-84e4193f450d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:44.357081 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d3466-1ba0-407c-89da-84e4193f450d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:46:44.358514 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d3466-1ba0-407c-89da-84e4193f450d service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:46:44.368324 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 726/1458] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:46:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:46:46.890336 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f6c1b-1f4b-416a-817e-cf9e571d7823 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:46.890878 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f6c1b-1f4b-416a-817e-cf9e571d7823 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:46.890878 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f6c1b-1f4b-416a-817e-cf9e571d7823 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:46.892606 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 28 20:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:46:46.898851 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83d0bf-201f-4c5e-8f3c-17a984626e6c None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:46.899334 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83d0bf-201f-4c5e-8f3c-17a984626e6c None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:46.899457 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83d0bf-201f-4c5e-8f3c-17a984626e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:46.917256 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-0f83d0bf-201f-4c5e-8f3c-17a984626e6c None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:46:46.918438 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-0f83d0bf-201f-4c5e-8f3c-17a984626e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:46:46.926043 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 28 20:46:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:46:46.965860 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f6c1b-1f4b-416a-817e-cf9e571d7823 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:46:46.976529 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f6c1b-1f4b-416a-817e-cf9e571d7823 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:46:46.980087 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd4cb9-cc3d-4406-ba78-33ea4a0c96b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:46:46.980755 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd4cb9-cc3d-4406-ba78-33ea4a0c96b7 service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:46.981030 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd4cb9-cc3d-4406-ba78-33ea4a0c96b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:46.981303 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd4cb9-cc3d-4406-ba78-33ea4a0c96b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:46.991510 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd4cb9-cc3d-4406-ba78-33ea4a0c96b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:46:46.993022 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd4cb9-cc3d-4406-ba78-33ea4a0c96b7 service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:46:47.003107 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 734/1461] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:46:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:46:49.406805 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76f4bc-7110-4efa-afe5-ad35ca97782c None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:49.407362 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76f4bc-7110-4efa-afe5-ad35ca97782c None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:49.407362 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76f4bc-7110-4efa-afe5-ad35ca97782c None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:49.409146 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 28 20:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:46:49.414764 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b27bda-b44e-494e-8074-48aa61e9ba41 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:49.415220 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b27bda-b44e-494e-8074-48aa61e9ba41 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:49.415350 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b27bda-b44e-494e-8074-48aa61e9ba41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:49.433165 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-d2b27bda-b44e-494e-8074-48aa61e9ba41 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:46:49.434342 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-d2b27bda-b44e-494e-8074-48aa61e9ba41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:46:49.442008 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 28 20:46:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:46:49.481048 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76f4bc-7110-4efa-afe5-ad35ca97782c None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:46:49.492075 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76f4bc-7110-4efa-afe5-ad35ca97782c None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:46:49.495663 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4714ade-7f61-4ace-8209-dfc362f513a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:46:49.496414 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4714ade-7f61-4ace-8209-dfc362f513a7 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:49.496754 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4714ade-7f61-4ace-8209-dfc362f513a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:49.497029 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4714ade-7f61-4ace-8209-dfc362f513a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:49.507310 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4714ade-7f61-4ace-8209-dfc362f513a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:46:49.508892 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4714ade-7f61-4ace-8209-dfc362f513a7 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:46:49.518450 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 729/1464] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:46:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:46:51.932374 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d1875-7b82-4a4d-8a26-5f00c4819cb1 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:51.932952 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d1875-7b82-4a4d-8a26-5f00c4819cb1 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:51.932952 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d1875-7b82-4a4d-8a26-5f00c4819cb1 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:51.934737 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 28 20:46:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:46:51.940589 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd0e6e-47f3-45be-88a4-b7786a4a9469 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:51.941306 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd0e6e-47f3-45be-88a4-b7786a4a9469 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:51.941306 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd0e6e-47f3-45be-88a4-b7786a4a9469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:51.959925 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-59bd0e6e-47f3-45be-88a4-b7786a4a9469 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:46:51.961162 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-59bd0e6e-47f3-45be-88a4-b7786a4a9469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:46:51.969219 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 28 20:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:46:52.009301 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d1875-7b82-4a4d-8a26-5f00c4819cb1 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:46:52.020165 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d1875-7b82-4a4d-8a26-5f00c4819cb1 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:46:52.025404 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471197b-abb0-4443-b06e-8c50b6572e54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:46:52.026047 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471197b-abb0-4443-b06e-8c50b6572e54 service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:52.026536 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471197b-abb0-4443-b06e-8c50b6572e54 service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:52.027069 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471197b-abb0-4443-b06e-8c50b6572e54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:52.037913 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4471197b-abb0-4443-b06e-8c50b6572e54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:46:52.039374 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4471197b-abb0-4443-b06e-8c50b6572e54 service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:46:52.051057 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 737/1467] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:46:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:46:54.557279 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8cd24-9f99-4fb7-aecc-e932c2f35c78 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:54.557820 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8cd24-9f99-4fb7-aecc-e932c2f35c78 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:54.557820 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8cd24-9f99-4fb7-aecc-e932c2f35c78 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:54.559586 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 28 20:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:46:54.565140 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac13d7-0476-4941-b941-14f8ba582660 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:54.565965 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac13d7-0476-4941-b941-14f8ba582660 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:54.566247 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac13d7-0476-4941-b941-14f8ba582660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:54.584705 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-7aac13d7-0476-4941-b941-14f8ba582660 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:46:54.585894 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-7aac13d7-0476-4941-b941-14f8ba582660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:46:54.593742 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 28 20:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:46:54.631886 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8cd24-9f99-4fb7-aecc-e932c2f35c78 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:46:54.642359 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8cd24-9f99-4fb7-aecc-e932c2f35c78 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:46:54.645842 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9309d-0458-4fc9-8e60-ddd72a690d3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:46:54.647183 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9309d-0458-4fc9-8e60-ddd72a690d3f service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:54.647460 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9309d-0458-4fc9-8e60-ddd72a690d3f service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:54.647846 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9309d-0458-4fc9-8e60-ddd72a690d3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:54.657077 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9309d-0458-4fc9-8e60-ddd72a690d3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:46:54.658507 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9309d-0458-4fc9-8e60-ddd72a690d3f service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:46:54.668114 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 732/1470] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:46:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:46:57.053305 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa30957-987e-44f7-b05a-7d14ea514858 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:57.053860 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa30957-987e-44f7-b05a-7d14ea514858 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:57.053860 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa30957-987e-44f7-b05a-7d14ea514858 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:57.055649 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 739/1471] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 28 20:46:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:46:57.061182 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e7043-032c-4921-a9a5-46f162e030ae None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:57.061642 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e7043-032c-4921-a9a5-46f162e030ae None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:57.061749 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e7043-032c-4921-a9a5-46f162e030ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:57.079477 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-8c6e7043-032c-4921-a9a5-46f162e030ae None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:46:57.080704 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-8c6e7043-032c-4921-a9a5-46f162e030ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:46:57.089175 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 733/1472] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 28 20:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:46:57.126296 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa30957-987e-44f7-b05a-7d14ea514858 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:46:57.137265 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa30957-987e-44f7-b05a-7d14ea514858 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:46:57.140766 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625accfd-321b-430f-8f95-c70a7bb31e07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:46:57.141403 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625accfd-321b-430f-8f95-c70a7bb31e07 service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:46:57.141680 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625accfd-321b-430f-8f95-c70a7bb31e07 service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:46:57.141948 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625accfd-321b-430f-8f95-c70a7bb31e07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:46:57.151803 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625accfd-321b-430f-8f95-c70a7bb31e07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:46:57.153238 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625accfd-321b-430f-8f95-c70a7bb31e07 service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:46:57.163410 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 740/1473] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:46:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:47:16.001380 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ced77f-59a5-491d-a0b1-cc446d0ce707 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:47:16.002022 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ced77f-59a5-491d-a0b1-cc446d0ce707 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:47:16.002022 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ced77f-59a5-491d-a0b1-cc446d0ce707 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:47:16.003733 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 734/1474] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:47:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:47:16.009274 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9ea91-4c93-4b38-9e7f-4e6a8496e80e None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:47:16.009723 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9ea91-4c93-4b38-9e7f-4e6a8496e80e None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:47:16.009822 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9ea91-4c93-4b38-9e7f-4e6a8496e80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:47:16.027732 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-25b9ea91-4c93-4b38-9e7f-4e6a8496e80e None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:47:16.028955 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-25b9ea91-4c93-4b38-9e7f-4e6a8496e80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:47:16.037636 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 741/1475] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:47:16.086558 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c80b13-09d5-43e0-825c-29b83eb926f6 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:47:16.086841 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c80b13-09d5-43e0-825c-29b83eb926f6 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:47:16.087117 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c80b13-09d5-43e0-825c-29b83eb926f6 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:47:16.088931 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 735/1476] 10.222.0.49 () {54 vars in 961 bytes} [Fri Oct 28 20:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:47:16.094027 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8a336-cb63-40a4-bc4d-c05b48347187 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:47:16.094314 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8a336-cb63-40a4-bc4d-c05b48347187 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:47:16.094590 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8a336-cb63-40a4-bc4d-c05b48347187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:47:16.114144 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-b5a8a336-cb63-40a4-bc4d-c05b48347187 None None] MFA Rules not processed for user `05029a41bd2b42febfd5ce91a3f28c24`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:47:16.115439 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-b5a8a336-cb63-40a4-bc4d-c05b48347187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:47:16.123100 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 742/1477] 10.222.0.49 () {58 vars in 1058 bytes} [Fri Oct 28 20:47:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:47:16.131282 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c80b13-09d5-43e0-825c-29b83eb926f6 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:47:16.141913 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c80b13-09d5-43e0-825c-29b83eb926f6 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:47:16.145907 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66bc60c-099f-4b80-b4a9-fb677e68156b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05029a41bd2b42febfd5ce91a3f28c24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:47:16.146622 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bc60c-099f-4b80-b4a9-fb677e68156b service glance] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:47:16.146906 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bc60c-099f-4b80-b4a9-fb677e68156b service glance] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:47:16.147171 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bc60c-099f-4b80-b4a9-fb677e68156b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:47:16.156564 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66bc60c-099f-4b80-b4a9-fb677e68156b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:47:16.157997 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66bc60c-099f-4b80-b4a9-fb677e68156b service glance] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:47:16.168096 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 736/1478] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:47:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:47:18.615518 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b28acb-49f9-415a-870d-a2dc85385694 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:47:18.616113 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b28acb-49f9-415a-870d-a2dc85385694 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:47:18.616113 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b28acb-49f9-415a-870d-a2dc85385694 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:47:18.617853 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 743/1479] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:47:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:47:18.623274 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53da73-1798-4372-ac2c-bd0234d87da9 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:47:18.623721 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53da73-1798-4372-ac2c-bd0234d87da9 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:47:18.623880 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53da73-1798-4372-ac2c-bd0234d87da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:47:18.642590 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-1c53da73-1798-4372-ac2c-bd0234d87da9 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:47:18.643809 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-1c53da73-1798-4372-ac2c-bd0234d87da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:47:18.656401 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 737/1480] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:47:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:47:18.681095 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b28acb-49f9-415a-870d-a2dc85385694 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:47:18.694700 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b28acb-49f9-415a-870d-a2dc85385694 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:47:18.699023 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7677a27-3302-40f7-a5e2-aaded414abe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:47:18.699677 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7677a27-3302-40f7-a5e2-aaded414abe3 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:47:18.699973 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7677a27-3302-40f7-a5e2-aaded414abe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:47:18.700241 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7677a27-3302-40f7-a5e2-aaded414abe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:47:18.700963 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7677a27-3302-40f7-a5e2-aaded414abe3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:47:18.702833 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7677a27-3302-40f7-a5e2-aaded414abe3 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:47:18.717672 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 744/1481] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 20:47:18 2022] GET /identity/v3/projects => generated 2553 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:47:21.085627 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec415ee1-ec01-4bed-8589-ed1d4c8bbedc None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:47:21.086206 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec415ee1-ec01-4bed-8589-ed1d4c8bbedc None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:47:21.086206 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec415ee1-ec01-4bed-8589-ed1d4c8bbedc None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:47:21.088064 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 738/1482] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:47:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:47:21.093657 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c870250-4a53-433c-b735-13e136cda91e None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:47:21.094114 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c870250-4a53-433c-b735-13e136cda91e None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:47:21.094213 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c870250-4a53-433c-b735-13e136cda91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:47:21.112400 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-8c870250-4a53-433c-b735-13e136cda91e None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:47:21.113588 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-8c870250-4a53-433c-b735-13e136cda91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:47:21.121818 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 745/1483] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:47:21.165041 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec415ee1-ec01-4bed-8589-ed1d4c8bbedc None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:47:21.179772 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec415ee1-ec01-4bed-8589-ed1d4c8bbedc None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:47:21.185186 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2764089a-b7a5-42df-a425-88fb0b05b2b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:47:21.185804 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764089a-b7a5-42df-a425-88fb0b05b2b0 service nova] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:47:21.186077 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764089a-b7a5-42df-a425-88fb0b05b2b0 service nova] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:47:21.186344 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764089a-b7a5-42df-a425-88fb0b05b2b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:47:21.194368 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2764089a-b7a5-42df-a425-88fb0b05b2b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:47:21.196031 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2764089a-b7a5-42df-a425-88fb0b05b2b0 service nova] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:47:21.205778 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 739/1484] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:47:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:47:23.746334 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dc82c-343c-491e-833f-0d6dd4e876f9 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:47:23.746899 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dc82c-343c-491e-833f-0d6dd4e876f9 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:47:23.746899 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dc82c-343c-491e-833f-0d6dd4e876f9 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:47:23.748675 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 746/1485] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:47:23.753845 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656f299-336d-4cc4-bb23-4a5d3b799f69 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:47:23.754322 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656f299-336d-4cc4-bb23-4a5d3b799f69 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:47:23.754902 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656f299-336d-4cc4-bb23-4a5d3b799f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:47:23.773459 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-7656f299-336d-4cc4-bb23-4a5d3b799f69 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:47:23.774673 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-7656f299-336d-4cc4-bb23-4a5d3b799f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:47:23.783314 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 740/1486] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:47:23.820111 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8dc82c-343c-491e-833f-0d6dd4e876f9 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:47:23.830488 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8dc82c-343c-491e-833f-0d6dd4e876f9 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:47:23.834539 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9d934-e408-429a-bc05-c4e82e7ea372 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:47:23.835171 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9d934-e408-429a-bc05-c4e82e7ea372 service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:47:23.835447 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9d934-e408-429a-bc05-c4e82e7ea372 service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:47:23.835718 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9d934-e408-429a-bc05-c4e82e7ea372 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:47:23.844886 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9d934-e408-429a-bc05-c4e82e7ea372 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:47:23.846325 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9d934-e408-429a-bc05-c4e82e7ea372 service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:47:23.856174 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 747/1487] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:47:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:47:26.280594 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e4c2b-a9f6-41de-be59-2a4d35680c62 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:47:26.281161 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e4c2b-a9f6-41de-be59-2a4d35680c62 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:47:26.281271 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e4c2b-a9f6-41de-be59-2a4d35680c62 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:47:26.283008 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 741/1488] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:47:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:47:26.289055 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638eae9b-c235-4b69-92dc-d4bac079975d None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:47:26.289476 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638eae9b-c235-4b69-92dc-d4bac079975d None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:47:26.289637 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638eae9b-c235-4b69-92dc-d4bac079975d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:47:26.307675 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-638eae9b-c235-4b69-92dc-d4bac079975d None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:47:26.308893 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-638eae9b-c235-4b69-92dc-d4bac079975d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:47:26.316575 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 748/1489] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:47:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:47:26.355842 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e4c2b-a9f6-41de-be59-2a4d35680c62 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:47:26.367794 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e4c2b-a9f6-41de-be59-2a4d35680c62 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:47:26.371363 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375fe32-2547-4bbf-a0f5-2a9d314346fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:47:26.372035 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375fe32-2547-4bbf-a0f5-2a9d314346fb service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:47:26.372320 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375fe32-2547-4bbf-a0f5-2a9d314346fb service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:47:26.372591 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375fe32-2547-4bbf-a0f5-2a9d314346fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:47:26.382542 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375fe32-2547-4bbf-a0f5-2a9d314346fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:47:26.384115 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375fe32-2547-4bbf-a0f5-2a9d314346fb service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:47:26.393508 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 742/1490] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:47:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:47:28.923071 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabe4ae-d6a1-43e0-8ad4-17ae95c4d8b2 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:47:28.923641 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabe4ae-d6a1-43e0-8ad4-17ae95c4d8b2 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:47:28.923641 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabe4ae-d6a1-43e0-8ad4-17ae95c4d8b2 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:47:28.925433 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 749/1491] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:47:28.930869 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a698b55-219d-4372-8f0d-0472ed4cff6a None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:47:28.931277 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a698b55-219d-4372-8f0d-0472ed4cff6a None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:47:28.931413 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a698b55-219d-4372-8f0d-0472ed4cff6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:47:28.949805 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-7a698b55-219d-4372-8f0d-0472ed4cff6a None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:47:28.951005 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-7a698b55-219d-4372-8f0d-0472ed4cff6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:47:28.959365 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 743/1492] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:47:28.999669 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eabe4ae-d6a1-43e0-8ad4-17ae95c4d8b2 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:47:29.010735 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eabe4ae-d6a1-43e0-8ad4-17ae95c4d8b2 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:47:29.014473 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becae092-3e9c-49b0-970c-5db508a4639a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:47:29.015101 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becae092-3e9c-49b0-970c-5db508a4639a service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:47:29.015382 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becae092-3e9c-49b0-970c-5db508a4639a service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:47:29.015664 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becae092-3e9c-49b0-970c-5db508a4639a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:47:29.025284 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becae092-3e9c-49b0-970c-5db508a4639a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:47:29.026711 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becae092-3e9c-49b0-970c-5db508a4639a service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:47:29.036247 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 750/1493] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:47:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:47:31.589139 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f6cfe-d0d3-457f-bc0f-82cbb9fd3003 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:47:31.589653 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f6cfe-d0d3-457f-bc0f-82cbb9fd3003 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:47:31.589653 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f6cfe-d0d3-457f-bc0f-82cbb9fd3003 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:47:31.591422 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 744/1494] 10.222.0.49 () {54 vars in 926 bytes} [Fri Oct 28 20:47:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:47:31.596728 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91295f0a-8cd7-4e27-8801-206a4695741f None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:47:31.597121 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91295f0a-8cd7-4e27-8801-206a4695741f None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:47:31.597279 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91295f0a-8cd7-4e27-8801-206a4695741f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:47:31.615341 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-91295f0a-8cd7-4e27-8801-206a4695741f None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:47:31.616560 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-91295f0a-8cd7-4e27-8801-206a4695741f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:47:31.624317 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 751/1495] 10.222.0.49 () {58 vars in 1023 bytes} [Fri Oct 28 20:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:47:31.664543 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f6cfe-d0d3-457f-bc0f-82cbb9fd3003 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:47:31.675657 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f6cfe-d0d3-457f-bc0f-82cbb9fd3003 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:47:31.679421 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054d1d3-4ca1-49e9-b0ba-6a7cc991c60a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:47:31.680091 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054d1d3-4ca1-49e9-b0ba-6a7cc991c60a service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:47:31.680370 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054d1d3-4ca1-49e9-b0ba-6a7cc991c60a service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:47:31.680639 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054d1d3-4ca1-49e9-b0ba-6a7cc991c60a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:47:31.691261 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e054d1d3-4ca1-49e9-b0ba-6a7cc991c60a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:47:31.693452 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e054d1d3-4ca1-49e9-b0ba-6a7cc991c60a service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:47:31.704076 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 745/1496] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:47:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:49:00.871062 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf4c8b-5f70-4b41-9821-95cf2162fc62 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:49:00.871652 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf4c8b-5f70-4b41-9821-95cf2162fc62 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:49:00.871652 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf4c8b-5f70-4b41-9821-95cf2162fc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:49:00.891531 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-c3cf4c8b-5f70-4b41-9821-95cf2162fc62 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:49:00.892771 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-c3cf4c8b-5f70-4b41-9821-95cf2162fc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:49:00.900476 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 752/1497] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:49:00.909442 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83fce82-18d0-4339-a5e6-8d359f8852f6 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:49:00.909976 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83fce82-18d0-4339-a5e6-8d359f8852f6 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:49:00.909976 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83fce82-18d0-4339-a5e6-8d359f8852f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:49:00.928082 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-d83fce82-18d0-4339-a5e6-8d359f8852f6 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:49:00.929255 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-d83fce82-18d0-4339-a5e6-8d359f8852f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:49:00.936906 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 746/1498] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:49:00.942343 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf4c8b-5f70-4b41-9821-95cf2162fc62 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:49:00.951856 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf4c8b-5f70-4b41-9821-95cf2162fc62 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:49:00.956574 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b037da8-f1ea-4f41-9711-cec6b7eb16d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:49:00.957221 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b037da8-f1ea-4f41-9711-cec6b7eb16d7 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:49:00.957495 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b037da8-f1ea-4f41-9711-cec6b7eb16d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:49:00.957760 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b037da8-f1ea-4f41-9711-cec6b7eb16d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:49:00.958460 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b037da8-f1ea-4f41-9711-cec6b7eb16d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:49:00.958783 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b037da8-f1ea-4f41-9711-cec6b7eb16d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:49:00.959813 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING py.warnings [None req-0b037da8-f1ea-4f41-9711-cec6b7eb16d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 20:49:00.959813 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: warnings.warn(msg) Oct 28 20:49:00.959813 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: Oct 28 20:49:00.960681 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b037da8-f1ea-4f41-9711-cec6b7eb16d7 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:49:00.972313 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 753/1499] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:49:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:49:00.980711 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83fce82-18d0-4339-a5e6-8d359f8852f6 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:49:00.990427 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83fce82-18d0-4339-a5e6-8d359f8852f6 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:49:00.994957 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f66e83-b54f-479e-8e38-1ebb0d962e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:49:00.995601 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f66e83-b54f-479e-8e38-1ebb0d962e1a admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:49:00.995920 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f66e83-b54f-479e-8e38-1ebb0d962e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:49:00.996691 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f66e83-b54f-479e-8e38-1ebb0d962e1a admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:49:00.996881 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f66e83-b54f-479e-8e38-1ebb0d962e1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:49:00.998615 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING py.warnings [None req-31f66e83-b54f-479e-8e38-1ebb0d962e1a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 20:49:00.998615 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: warnings.warn(msg) Oct 28 20:49:00.998615 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: Oct 28 20:49:00.999841 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f66e83-b54f-479e-8e38-1ebb0d962e1a admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:49:01.037703 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 747/1500] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:49:00 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:49:01.041191 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b037da8-f1ea-4f41-9711-cec6b7eb16d7 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:49:01.051607 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b037da8-f1ea-4f41-9711-cec6b7eb16d7 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:49:01.109057 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dfe35-ef1d-4505-9090-c1ba4bb1b377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:49:01.109728 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dfe35-ef1d-4505-9090-c1ba4bb1b377 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:49:01.110010 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dfe35-ef1d-4505-9090-c1ba4bb1b377 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:49:01.110286 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dfe35-ef1d-4505-9090-c1ba4bb1b377 admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:49:01.111021 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5dfe35-ef1d-4505-9090-c1ba4bb1b377 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:49:01.112599 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING py.warnings [None req-9a5dfe35-ef1d-4505-9090-c1ba4bb1b377 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 20:49:01.112599 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: warnings.warn(msg) Oct 28 20:49:01.112599 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: Oct 28 20:49:01.113966 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5dfe35-ef1d-4505-9090-c1ba4bb1b377 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:49:01.136038 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 754/1501] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:49:01 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:49:01.140052 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f66e83-b54f-479e-8e38-1ebb0d962e1a admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:49:01.150616 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f66e83-b54f-479e-8e38-1ebb0d962e1a admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:49:01.155441 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ee883-073b-43b4-96a6-1b7d5d48a07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:49:01.156132 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ee883-073b-43b4-96a6-1b7d5d48a07d admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:49:01.156406 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ee883-073b-43b4-96a6-1b7d5d48a07d admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:49:01.156677 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ee883-073b-43b4-96a6-1b7d5d48a07d admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:49:01.157395 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ee883-073b-43b4-96a6-1b7d5d48a07d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:49:01.158938 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING py.warnings [None req-450ee883-073b-43b4-96a6-1b7d5d48a07d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 20:49:01.158938 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: warnings.warn(msg) Oct 28 20:49:01.158938 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: Oct 28 20:49:01.160334 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ee883-073b-43b4-96a6-1b7d5d48a07d admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:49:01.175653 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 748/1502] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:49:01.180445 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dfe35-ef1d-4505-9090-c1ba4bb1b377 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:49:01.197741 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dfe35-ef1d-4505-9090-c1ba4bb1b377 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:49:01.202518 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a8048-b22e-4330-be74-1d61cdbb429a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:49:01.203197 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a8048-b22e-4330-be74-1d61cdbb429a admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:49:01.203476 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a8048-b22e-4330-be74-1d61cdbb429a admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:49:01.203763 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a8048-b22e-4330-be74-1d61cdbb429a admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:49:01.204503 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a8048-b22e-4330-be74-1d61cdbb429a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:49:01.205547 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING py.warnings [None req-696a8048-b22e-4330-be74-1d61cdbb429a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 20:49:01.205547 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: warnings.warn(msg) Oct 28 20:49:01.205547 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: Oct 28 20:49:01.206438 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a8048-b22e-4330-be74-1d61cdbb429a admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:49:01.220742 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 755/1503] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:49:01.225574 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ee883-073b-43b4-96a6-1b7d5d48a07d admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:49:01.235650 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ee883-073b-43b4-96a6-1b7d5d48a07d admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:49:01.246797 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef813936-737d-42f7-be41-dfe62ee7f3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:49:01.247991 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef813936-737d-42f7-be41-dfe62ee7f3e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:49:01.248271 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef813936-737d-42f7-be41-dfe62ee7f3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:49:01.248539 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef813936-737d-42f7-be41-dfe62ee7f3e3 admin admin] PATH_INFO: `/v3/projects/9ad8d03fdd5a49f38ed1b5ec8a6ded54/users/f38894acff9b444ea579a393bf2601b0/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:49:01.265152 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef813936-737d-42f7-be41-dfe62ee7f3e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ad8d03fdd5a49f38ed1b5ec8a6ded54, user_id=f38894acff9b444ea579a393bf2601b0, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:49:01.266208 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING py.warnings [None req-ef813936-737d-42f7-be41-dfe62ee7f3e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 20:49:01.266208 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: warnings.warn(msg) Oct 28 20:49:01.266208 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: Oct 28 20:49:01.271416 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef813936-737d-42f7-be41-dfe62ee7f3e3 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:49:01.283466 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 749/1504] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:49:01 2022] PUT /identity/v3/projects/9ad8d03fdd5a49f38ed1b5ec8a6ded54/users/f38894acff9b444ea579a393bf2601b0/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:49:01.304029 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd392c9-e873-46f9-ae98-4fa34b5076ef None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:49:01.304387 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd392c9-e873-46f9-ae98-4fa34b5076ef None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:49:01.304674 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd392c9-e873-46f9-ae98-4fa34b5076ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:49:01.334577 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-5dd392c9-e873-46f9-ae98-4fa34b5076ef None None] MFA Rules not processed for user `f38894acff9b444ea579a393bf2601b0`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:49:01.335860 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-5dd392c9-e873-46f9-ae98-4fa34b5076ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:49:01.402488 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 756/1505] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:49:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:49:01.416508 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b0338-e1d1-4b84-8f82-13554accc2ab None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:49:01.416804 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b0338-e1d1-4b84-8f82-13554accc2ab None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:49:01.417094 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b0338-e1d1-4b84-8f82-13554accc2ab None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:49:01.418889 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 750/1506] 10.222.0.49 () {54 vars in 962 bytes} [Fri Oct 28 20:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:49:01.427018 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fbdc2-ab9f-4733-b8ff-f6c583ad97c6 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:49:01.427281 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fbdc2-ab9f-4733-b8ff-f6c583ad97c6 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:49:01.427556 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fbdc2-ab9f-4733-b8ff-f6c583ad97c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:49:01.446638 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-e34fbdc2-ab9f-4733-b8ff-f6c583ad97c6 None None] MFA Rules not processed for user `f305aece531c412b9e0ac30be9f47667`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:49:01.447864 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-e34fbdc2-ab9f-4733-b8ff-f6c583ad97c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:49:01.497505 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 757/1507] 10.222.0.49 () {58 vars in 1059 bytes} [Fri Oct 28 20:49:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:49:01.505619 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b0338-e1d1-4b84-8f82-13554accc2ab None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:49:01.516276 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b0338-e1d1-4b84-8f82-13554accc2ab None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:49:01.521413 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94e999-59e2-4c8b-9016-8d9f6562be68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:49:01.522055 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94e999-59e2-4c8b-9016-8d9f6562be68 service cinder] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:49:01.522336 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94e999-59e2-4c8b-9016-8d9f6562be68 service cinder] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:49:01.522605 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94e999-59e2-4c8b-9016-8d9f6562be68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:49:01.531486 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b94e999-59e2-4c8b-9016-8d9f6562be68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:49:01.533051 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b94e999-59e2-4c8b-9016-8d9f6562be68 service cinder] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:49:01.542389 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 751/1508] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:49:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:49:01.590910 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629d16e-db10-41a9-9b5a-c6630129d3d8 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:49:01.591201 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629d16e-db10-41a9-9b5a-c6630129d3d8 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:49:01.591481 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629d16e-db10-41a9-9b5a-c6630129d3d8 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:49:01.593265 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 758/1509] 10.222.0.49 () {52 vars in 830 bytes} [Fri Oct 28 20:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:49:01.597020 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94e999-59e2-4c8b-9016-8d9f6562be68 service cinder] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:49:01.659445 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94e999-59e2-4c8b-9016-8d9f6562be68 service cinder] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:49:01.664390 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165de099-779a-484e-9c43-fe59f2779b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:49:01.665263 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165de099-779a-484e-9c43-fe59f2779b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:49:01.665535 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165de099-779a-484e-9c43-fe59f2779b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:49:01.665803 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165de099-779a-484e-9c43-fe59f2779b86 admin admin] PATH_INFO: `/v3/users/f38894acff9b444ea579a393bf2601b0` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:49:01.666990 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165de099-779a-484e-9c43-fe59f2779b86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f38894acff9b444ea579a393bf2601b0)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:49:01.668062 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING py.warnings [None req-165de099-779a-484e-9c43-fe59f2779b86 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 20:49:01.668062 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: warnings.warn(msg) Oct 28 20:49:01.668062 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: Oct 28 20:49:01.669325 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165de099-779a-484e-9c43-fe59f2779b86 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:49:01.740440 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-165de099-779a-484e-9c43-fe59f2779b86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f38894acff9b444ea579a393bf2601b0'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:49:01.755555 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-165de099-779a-484e-9c43-fe59f2779b86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f38894acff9b444ea579a393bf2601b0'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:49:01.756343 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-165de099-779a-484e-9c43-fe59f2779b86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f38894acff9b444ea579a393bf2601b0'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:49:01.775754 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-165de099-779a-484e-9c43-fe59f2779b86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f38894acff9b444ea579a393bf2601b0'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:49:01.776788 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-165de099-779a-484e-9c43-fe59f2779b86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f38894acff9b444ea579a393bf2601b0'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:49:01.796291 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 752/1510] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:49:01 2022] DELETE /identity/v3/users/f38894acff9b444ea579a393bf2601b0 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:49:01.801378 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd56ada-ed08-492f-83e6-54a3a03c01f6 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:49:01.801687 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd56ada-ed08-492f-83e6-54a3a03c01f6 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:49:01.801958 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd56ada-ed08-492f-83e6-54a3a03c01f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:49:01.820419 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-8dd56ada-ed08-492f-83e6-54a3a03c01f6 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:49:01.821676 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-8dd56ada-ed08-492f-83e6-54a3a03c01f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:49:01.887805 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 759/1511] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:49:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:49:01.898758 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165de099-779a-484e-9c43-fe59f2779b86 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:49:01.900231 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-165de099-779a-484e-9c43-fe59f2779b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:49:01.957594 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165de099-779a-484e-9c43-fe59f2779b86 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:49:01.961246 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad9b2e-50ce-4afd-9f50-46ffb420752c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:49:01.961912 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad9b2e-50ce-4afd-9f50-46ffb420752c service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:49:01.962180 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad9b2e-50ce-4afd-9f50-46ffb420752c service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:49:01.962448 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad9b2e-50ce-4afd-9f50-46ffb420752c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:49:01.972635 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad9b2e-50ce-4afd-9f50-46ffb420752c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:49:01.974088 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad9b2e-50ce-4afd-9f50-46ffb420752c service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:49:01.983720 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 753/1512] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:49:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:49:02.331775 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd56ada-ed08-492f-83e6-54a3a03c01f6 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:49:02.334326 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-8dd56ada-ed08-492f-83e6-54a3a03c01f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:49:02.346537 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd56ada-ed08-492f-83e6-54a3a03c01f6 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:49:02.351858 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfac36d-0fb8-4a43-aa80-45d7f8710ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:49:02.352643 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfac36d-0fb8-4a43-aa80-45d7f8710ea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:49:02.352920 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfac36d-0fb8-4a43-aa80-45d7f8710ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:49:02.353193 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfac36d-0fb8-4a43-aa80-45d7f8710ea1 admin admin] PATH_INFO: `/v3/projects/9ad8d03fdd5a49f38ed1b5ec8a6ded54` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:49:02.355090 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfac36d-0fb8-4a43-aa80-45d7f8710ea1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ad8d03fdd5a49f38ed1b5ec8a6ded54)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:49:02.356334 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING py.warnings [None req-adfac36d-0fb8-4a43-aa80-45d7f8710ea1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 20:49:02.356334 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: warnings.warn(msg) Oct 28 20:49:02.356334 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: Oct 28 20:49:02.357533 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfac36d-0fb8-4a43-aa80-45d7f8710ea1 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:49:02.424662 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-adfac36d-0fb8-4a43-aa80-45d7f8710ea1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ad8d03fdd5a49f38ed1b5ec8a6ded54', 'request_id': 'req-adfac36d-0fb8-4a43-aa80-45d7f8710ea1'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:49:02.433688 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-adfac36d-0fb8-4a43-aa80-45d7f8710ea1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ad8d03fdd5a49f38ed1b5ec8a6ded54', 'request_id': 'req-adfac36d-0fb8-4a43-aa80-45d7f8710ea1'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:49:02.444090 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-adfac36d-0fb8-4a43-aa80-45d7f8710ea1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ad8d03fdd5a49f38ed1b5ec8a6ded54', 'request_id': 'req-adfac36d-0fb8-4a43-aa80-45d7f8710ea1'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:49:02.462420 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-adfac36d-0fb8-4a43-aa80-45d7f8710ea1 admin admin] The token cache is being invalidate because project 9ad8d03fdd5a49f38ed1b5ec8a6ded54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:49:02.462703 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-adfac36d-0fb8-4a43-aa80-45d7f8710ea1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:49:02.463439 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-adfac36d-0fb8-4a43-aa80-45d7f8710ea1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:49:02.465141 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 760/1513] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:49:02 2022] DELETE /identity/v3/projects/9ad8d03fdd5a49f38ed1b5ec8a6ded54 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:50:35.307842 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9f0a0-f57b-4701-bb17-edffb47abecb None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:50:35.308454 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9f0a0-f57b-4701-bb17-edffb47abecb None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:50:35.308454 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9f0a0-f57b-4701-bb17-edffb47abecb None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:50:35.310258 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 20:50:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:50:35.315507 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22218348-eaf4-4ff9-a247-5755fe754a19 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:50:35.316021 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22218348-eaf4-4ff9-a247-5755fe754a19 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:50:35.316136 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22218348-eaf4-4ff9-a247-5755fe754a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:50:35.336373 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-22218348-eaf4-4ff9-a247-5755fe754a19 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:50:35.337561 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-22218348-eaf4-4ff9-a247-5755fe754a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:50:35.398424 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 20:50:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:50:35.554783 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9f0a0-f57b-4701-bb17-edffb47abecb None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:50:35.556430 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-3db9f0a0-f57b-4701-bb17-edffb47abecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:50:35.629714 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9f0a0-f57b-4701-bb17-edffb47abecb None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:50:35.634979 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0a56c-6487-42bb-9b22-eac7849eb876 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:50:35.635610 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0a56c-6487-42bb-9b22-eac7849eb876 service nova] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:50:35.635918 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0a56c-6487-42bb-9b22-eac7849eb876 service nova] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:50:35.636190 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0a56c-6487-42bb-9b22-eac7849eb876 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:50:35.644232 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b0a56c-6487-42bb-9b22-eac7849eb876 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:50:35.645806 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b0a56c-6487-42bb-9b22-eac7849eb876 service nova] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:50:35.655243 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 755/1516] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:50:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:50:36.228904 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb48c39-3642-4bff-a991-3cc610d1c313 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:50:36.229197 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb48c39-3642-4bff-a991-3cc610d1c313 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:50:36.229472 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb48c39-3642-4bff-a991-3cc610d1c313 None None] PATH_INFO: `/v3` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:50:36.230774 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 762/1517] 10.222.0.26 () {54 vars in 925 bytes} [Fri Oct 28 20:50:36 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:50:36.250422 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e14a2-d2ba-4f27-8d32-4d758385a844 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:50:36.250703 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e14a2-d2ba-4f27-8d32-4d758385a844 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:50:36.250972 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e14a2-d2ba-4f27-8d32-4d758385a844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:50:36.270243 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-707e14a2-d2ba-4f27-8d32-4d758385a844 None None] MFA Rules not processed for user `938634e835b94a75af698aef6941958f`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:50:36.271382 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-707e14a2-d2ba-4f27-8d32-4d758385a844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:50:36.335727 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 756/1518] 10.222.0.26 () {58 vars in 1015 bytes} [Fri Oct 28 20:50:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:50:36.991062 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095a1c0-c7f5-48ff-835f-8af55db7cbca None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:50:36.991627 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095a1c0-c7f5-48ff-835f-8af55db7cbca None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:50:36.991627 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095a1c0-c7f5-48ff-835f-8af55db7cbca None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:50:36.993432 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 763/1519] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 20:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:50:36.998327 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e97e9e-5530-4fd9-98ba-6fcbd26c13ee None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:50:36.998712 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e97e9e-5530-4fd9-98ba-6fcbd26c13ee None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:50:36.999017 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e97e9e-5530-4fd9-98ba-6fcbd26c13ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:50:37.021778 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-f4e97e9e-5530-4fd9-98ba-6fcbd26c13ee None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:50:37.022958 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-f4e97e9e-5530-4fd9-98ba-6fcbd26c13ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:50:37.030840 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 757/1520] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 20:50:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:50:37.186414 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095a1c0-c7f5-48ff-835f-8af55db7cbca None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:50:37.201723 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095a1c0-c7f5-48ff-835f-8af55db7cbca None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:50:37.207134 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f2091-09ca-4b34-a1cc-e5fdf6f38111 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:50:37.207762 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f2091-09ca-4b34-a1cc-e5fdf6f38111 service nova] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:50:37.208085 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f2091-09ca-4b34-a1cc-e5fdf6f38111 service nova] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:50:37.208314 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f2091-09ca-4b34-a1cc-e5fdf6f38111 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:50:37.216482 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f2091-09ca-4b34-a1cc-e5fdf6f38111 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:50:37.218116 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f2091-09ca-4b34-a1cc-e5fdf6f38111 service nova] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:50:37.228361 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 764/1521] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:50:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:50:40.348507 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ef8c4-153f-4903-85b7-dce156278bf7 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:50:40.349054 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ef8c4-153f-4903-85b7-dce156278bf7 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:50:40.349170 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ef8c4-153f-4903-85b7-dce156278bf7 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:50:40.350939 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 758/1522] 10.222.0.49 () {54 vars in 960 bytes} [Fri Oct 28 20:50:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:50:40.356203 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a49e9-7e9c-4418-b612-c814b08136fa None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:50:40.356640 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a49e9-7e9c-4418-b612-c814b08136fa None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:50:40.356769 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a49e9-7e9c-4418-b612-c814b08136fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:50:40.374556 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-3b6a49e9-7e9c-4418-b612-c814b08136fa None None] MFA Rules not processed for user `938634e835b94a75af698aef6941958f`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:50:40.375795 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-3b6a49e9-7e9c-4418-b612-c814b08136fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:50:40.384257 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 765/1523] 10.222.0.49 () {58 vars in 1057 bytes} [Fri Oct 28 20:50:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:50:40.391892 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ef8c4-153f-4903-85b7-dce156278bf7 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:50:40.405760 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ef8c4-153f-4903-85b7-dce156278bf7 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:50:40.411183 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66efe169-05d0-4ffe-b701-8f98346a65f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '938634e835b94a75af698aef6941958f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:50:40.411829 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efe169-05d0-4ffe-b701-8f98346a65f4 service placement] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:50:40.412106 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efe169-05d0-4ffe-b701-8f98346a65f4 service placement] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:50:40.412375 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efe169-05d0-4ffe-b701-8f98346a65f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:50:40.420467 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66efe169-05d0-4ffe-b701-8f98346a65f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:50:40.422077 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66efe169-05d0-4ffe-b701-8f98346a65f4 service placement] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:50:40.431518 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 759/1524] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:50:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:50:48.969005 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1441b-6392-4675-82f1-fb16ebc445f8 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:50:48.969610 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1441b-6392-4675-82f1-fb16ebc445f8 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:50:48.969610 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1441b-6392-4675-82f1-fb16ebc445f8 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:50:48.971316 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 20:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:50:48.976719 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbdaf5-ee5c-4369-96f0-3cd2e370b125 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:50:48.977198 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbdaf5-ee5c-4369-96f0-3cd2e370b125 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:50:48.977311 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbdaf5-ee5c-4369-96f0-3cd2e370b125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:50:48.996738 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-a4cbdaf5-ee5c-4369-96f0-3cd2e370b125 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:50:48.998272 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-a4cbdaf5-ee5c-4369-96f0-3cd2e370b125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:50:49.006971 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 20:50:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:50:49.164134 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1441b-6392-4675-82f1-fb16ebc445f8 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:50:49.178791 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1441b-6392-4675-82f1-fb16ebc445f8 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:50:49.184191 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a588e62-3dd8-4061-a2bd-9879447cca3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:50:49.184816 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a588e62-3dd8-4061-a2bd-9879447cca3f service nova] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:50:49.185095 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a588e62-3dd8-4061-a2bd-9879447cca3f service nova] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:50:49.185368 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a588e62-3dd8-4061-a2bd-9879447cca3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:50:49.194003 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a588e62-3dd8-4061-a2bd-9879447cca3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:50:49.195601 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a588e62-3dd8-4061-a2bd-9879447cca3f service nova] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:50:49.204949 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 767/1527] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:50:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:50:50.531506 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab8338-bb10-4587-bf6d-b46cee82a4fc None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:50:50.532128 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab8338-bb10-4587-bf6d-b46cee82a4fc None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:50:50.532128 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab8338-bb10-4587-bf6d-b46cee82a4fc None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:50:50.533762 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 20:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:50:50.539358 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56408f73-af5f-491e-ae98-588512a798e1 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:50:50.539804 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56408f73-af5f-491e-ae98-588512a798e1 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:50:50.539934 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56408f73-af5f-491e-ae98-588512a798e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:50:50.557908 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-56408f73-af5f-491e-ae98-588512a798e1 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:50:50.559089 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-56408f73-af5f-491e-ae98-588512a798e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:50:50.567010 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 20:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:50:50.720397 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab8338-bb10-4587-bf6d-b46cee82a4fc None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:50:50.735110 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab8338-bb10-4587-bf6d-b46cee82a4fc None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:50:50.740551 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b78ff28-3dbf-4771-b02e-6c925f793067 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:50:50.741175 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78ff28-3dbf-4771-b02e-6c925f793067 service nova] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:50:50.741451 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78ff28-3dbf-4771-b02e-6c925f793067 service nova] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:50:50.741710 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78ff28-3dbf-4771-b02e-6c925f793067 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:50:50.749687 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b78ff28-3dbf-4771-b02e-6c925f793067 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:50:50.751532 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b78ff28-3dbf-4771-b02e-6c925f793067 service nova] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:50:50.760852 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 762/1530] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:50:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:50:54.952447 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed31edb-33a0-44d9-98d9-e2c4fb5b8fcb None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:50:54.953013 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed31edb-33a0-44d9-98d9-e2c4fb5b8fcb None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:50:54.953013 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed31edb-33a0-44d9-98d9-e2c4fb5b8fcb None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:50:54.954767 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 28 20:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:50:54.960751 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e82f6-7c28-498f-b21e-fc22ce26241e None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:50:54.961170 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e82f6-7c28-498f-b21e-fc22ce26241e None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:50:54.961289 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e82f6-7c28-498f-b21e-fc22ce26241e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:50:54.979611 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-fb1e82f6-7c28-498f-b21e-fc22ce26241e None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:50:54.980834 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-fb1e82f6-7c28-498f-b21e-fc22ce26241e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:50:54.988603 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 28 20:50:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:50:55.026479 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed31edb-33a0-44d9-98d9-e2c4fb5b8fcb None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:50:55.028530 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-6ed31edb-33a0-44d9-98d9-e2c4fb5b8fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:50:55.084814 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed31edb-33a0-44d9-98d9-e2c4fb5b8fcb None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:50:55.088697 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1e5d7-3f5f-409d-87ce-059550163f8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:50:55.089338 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1e5d7-3f5f-409d-87ce-059550163f8c service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:50:55.089614 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1e5d7-3f5f-409d-87ce-059550163f8c service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:50:55.089888 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1e5d7-3f5f-409d-87ce-059550163f8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:50:55.100140 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1e5d7-3f5f-409d-87ce-059550163f8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:50:55.101577 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1e5d7-3f5f-409d-87ce-059550163f8c service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:50:55.110908 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 770/1533] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:50:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:50:57.453453 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc4bd6-c27e-4674-a73a-f6e8fee4c9fa None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:50:57.454039 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc4bd6-c27e-4674-a73a-f6e8fee4c9fa None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:50:57.454039 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc4bd6-c27e-4674-a73a-f6e8fee4c9fa None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:50:57.455971 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 28 20:50:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:50:57.462345 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5985300-af51-4c1f-afae-6e58ee2ab491 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:50:57.462951 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5985300-af51-4c1f-afae-6e58ee2ab491 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:50:57.462951 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5985300-af51-4c1f-afae-6e58ee2ab491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:50:57.481888 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-a5985300-af51-4c1f-afae-6e58ee2ab491 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:50:57.482977 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-a5985300-af51-4c1f-afae-6e58ee2ab491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:50:57.490889 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 28 20:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:50:57.527115 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc4bd6-c27e-4674-a73a-f6e8fee4c9fa None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:50:57.528892 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-46fc4bd6-c27e-4674-a73a-f6e8fee4c9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:50:57.542174 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc4bd6-c27e-4674-a73a-f6e8fee4c9fa None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:50:57.545599 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49566a1-74dd-4bad-b72c-ae08bb759dcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:50:57.546220 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49566a1-74dd-4bad-b72c-ae08bb759dcc service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:50:57.546494 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49566a1-74dd-4bad-b72c-ae08bb759dcc service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:50:57.546760 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49566a1-74dd-4bad-b72c-ae08bb759dcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:50:57.555597 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49566a1-74dd-4bad-b72c-ae08bb759dcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:50:57.557455 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49566a1-74dd-4bad-b72c-ae08bb759dcc service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:50:57.568326 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 765/1536] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:50:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:51:01.438477 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f07384-868d-4b39-98c2-75000b1470c9 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:51:01.439035 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f07384-868d-4b39-98c2-75000b1470c9 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:51:01.439035 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f07384-868d-4b39-98c2-75000b1470c9 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:51:01.440875 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 28 20:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:51:01.446336 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b461a4-d410-405c-afb8-72988022bb0e None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:51:01.446788 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b461a4-d410-405c-afb8-72988022bb0e None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:51:01.446885 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b461a4-d410-405c-afb8-72988022bb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:51:01.464563 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-e1b461a4-d410-405c-afb8-72988022bb0e None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:51:01.465744 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-e1b461a4-d410-405c-afb8-72988022bb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:51:01.474160 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 28 20:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:51:01.734251 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f07384-868d-4b39-98c2-75000b1470c9 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:51:01.736109 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-b7f07384-868d-4b39-98c2-75000b1470c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:51:01.796090 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f07384-868d-4b39-98c2-75000b1470c9 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:51:01.799592 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee3c84-d7f6-42f5-a996-ff2b29fbc886 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:51:01.800270 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee3c84-d7f6-42f5-a996-ff2b29fbc886 service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:51:01.800551 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee3c84-d7f6-42f5-a996-ff2b29fbc886 service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:51:01.800826 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee3c84-d7f6-42f5-a996-ff2b29fbc886 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:51:01.810805 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee3c84-d7f6-42f5-a996-ff2b29fbc886 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:51:01.812291 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee3c84-d7f6-42f5-a996-ff2b29fbc886 service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:51:01.822647 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 773/1539] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:51:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:51:04.204110 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd27325-0b2a-426b-8f56-8331d7a75bb1 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:51:04.204674 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd27325-0b2a-426b-8f56-8331d7a75bb1 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:51:04.204674 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd27325-0b2a-426b-8f56-8331d7a75bb1 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:51:04.206483 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 767/1540] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 28 20:51:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:51:04.211853 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e34ce8-53d0-43d6-98cf-d40f1ae46312 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:51:04.212295 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e34ce8-53d0-43d6-98cf-d40f1ae46312 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:51:04.212403 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e34ce8-53d0-43d6-98cf-d40f1ae46312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:51:04.232393 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-29e34ce8-53d0-43d6-98cf-d40f1ae46312 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:51:04.233593 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-29e34ce8-53d0-43d6-98cf-d40f1ae46312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:51:04.242044 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 774/1541] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 28 20:51:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:51:04.500191 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd27325-0b2a-426b-8f56-8331d7a75bb1 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:51:04.501867 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-1bd27325-0b2a-426b-8f56-8331d7a75bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:51:04.514865 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd27325-0b2a-426b-8f56-8331d7a75bb1 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:51:04.518390 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c1b41-fc85-44d6-bcf5-4a3e7e6b04bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:51:04.519008 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c1b41-fc85-44d6-bcf5-4a3e7e6b04bc service cinder] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:51:04.519285 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c1b41-fc85-44d6-bcf5-4a3e7e6b04bc service cinder] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:51:04.519547 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c1b41-fc85-44d6-bcf5-4a3e7e6b04bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:51:04.529378 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c1b41-fc85-44d6-bcf5-4a3e7e6b04bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:51:04.530823 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c1b41-fc85-44d6-bcf5-4a3e7e6b04bc service cinder] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:51:04.542068 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 768/1542] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:51:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:52:56.835410 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1733e7-64d1-429d-b63e-bd5ae684d63f None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:56.836083 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1733e7-64d1-429d-b63e-bd5ae684d63f None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:56.836083 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1733e7-64d1-429d-b63e-bd5ae684d63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:56.871131 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-3a1733e7-64d1-429d-b63e-bd5ae684d63f None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:52:56.872494 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-3a1733e7-64d1-429d-b63e-bd5ae684d63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:52:56.880972 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 775/1543] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:52:56.883505 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc0057-9346-42a7-a329-d3ac88f7aaac None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:56.884042 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc0057-9346-42a7-a329-d3ac88f7aaac None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:56.884151 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc0057-9346-42a7-a329-d3ac88f7aaac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:56.890233 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c1210-f84b-46de-b245-e5a4253f7821 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:56.890519 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c1210-f84b-46de-b245-e5a4253f7821 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:56.890793 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c1210-f84b-46de-b245-e5a4253f7821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:56.913012 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-7ccc0057-9346-42a7-a329-d3ac88f7aaac None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:52:56.914553 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-7ccc0057-9346-42a7-a329-d3ac88f7aaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:52:56.915196 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-343c1210-f84b-46de-b245-e5a4253f7821 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:52:56.916418 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-343c1210-f84b-46de-b245-e5a4253f7821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:52:56.929203 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 769/1544] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:52:56.938656 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54583efc-e288-471f-8c22-0379fbe4d973 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:56.939227 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54583efc-e288-471f-8c22-0379fbe4d973 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:56.939681 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54583efc-e288-471f-8c22-0379fbe4d973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:56.957939 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 776/1545] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:52:56.963024 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c1210-f84b-46de-b245-e5a4253f7821 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:56.968085 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-54583efc-e288-471f-8c22-0379fbe4d973 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:52:56.969311 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-54583efc-e288-471f-8c22-0379fbe4d973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:52:56.977747 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c1210-f84b-46de-b245-e5a4253f7821 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:56.982443 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 770/1546] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:52:56.983928 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6093e1-9fce-4efd-ac3b-b9111824d02b None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:56.984496 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6093e1-9fce-4efd-ac3b-b9111824d02b None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:56.984945 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6093e1-9fce-4efd-ac3b-b9111824d02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:56.990153 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94e9d8-fa4e-4355-953f-f59552b431ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:56.991345 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94e9d8-fa4e-4355-953f-f59552b431ed admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:56.991623 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94e9d8-fa4e-4355-953f-f59552b431ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:56.995797 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94e9d8-fa4e-4355-953f-f59552b431ed admin admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:56.995797 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94e9d8-fa4e-4355-953f-f59552b431ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:52:56.995797 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94e9d8-fa4e-4355-953f-f59552b431ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:56.995797 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94e9d8-fa4e-4355-953f-f59552b431ed admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:57.020980 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-2f6093e1-9fce-4efd-ac3b-b9111824d02b None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:52:57.022274 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 777/1547] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:52:57.022779 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-2f6093e1-9fce-4efd-ac3b-b9111824d02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:52:57.023781 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94e9d8-fa4e-4355-953f-f59552b431ed admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:57.037980 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 771/1548] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:52:57.048011 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d1e2a-2480-4a47-bbab-363750bed90b None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:57.048590 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d1e2a-2480-4a47-bbab-363750bed90b None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:57.049032 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d1e2a-2480-4a47-bbab-363750bed90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:57.058581 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94e9d8-fa4e-4355-953f-f59552b431ed admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:57.083798 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-502d1e2a-2480-4a47-bbab-363750bed90b None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:52:57.084949 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9809b6d-fccd-480e-ad22-6b82ef958c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:57.085612 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-502d1e2a-2480-4a47-bbab-363750bed90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:52:57.086675 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9809b6d-fccd-480e-ad22-6b82ef958c4c admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:57.087430 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9809b6d-fccd-480e-ad22-6b82ef958c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:57.087946 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9809b6d-fccd-480e-ad22-6b82ef958c4c admin admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:57.089337 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9809b6d-fccd-480e-ad22-6b82ef958c4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:52:57.089871 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9809b6d-fccd-480e-ad22-6b82ef958c4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:57.093213 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9809b6d-fccd-480e-ad22-6b82ef958c4c admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:57.101232 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 772/1549] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:52:57.102375 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d1e2a-2480-4a47-bbab-363750bed90b None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:57.122985 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d1e2a-2480-4a47-bbab-363750bed90b None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:57.129792 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 778/1550] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:52:57.136795 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9809b6d-fccd-480e-ad22-6b82ef958c4c admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:57.145103 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695efc0c-629a-4989-96dc-f14be90ab79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:57.146598 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695efc0c-629a-4989-96dc-f14be90ab79b admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:57.147069 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695efc0c-629a-4989-96dc-f14be90ab79b admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:57.147496 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695efc0c-629a-4989-96dc-f14be90ab79b admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:57.155773 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695efc0c-629a-4989-96dc-f14be90ab79b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:57.158750 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695efc0c-629a-4989-96dc-f14be90ab79b admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:57.168527 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9809b6d-fccd-480e-ad22-6b82ef958c4c admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:57.180861 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e44a7-762d-4e97-9839-93f86ba81a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:57.181843 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e44a7-762d-4e97-9839-93f86ba81a89 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:57.182281 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e44a7-762d-4e97-9839-93f86ba81a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:57.182732 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e44a7-762d-4e97-9839-93f86ba81a89 admin admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:57.183630 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e44a7-762d-4e97-9839-93f86ba81a89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:52:57.184156 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e44a7-762d-4e97-9839-93f86ba81a89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:57.185979 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e44a7-762d-4e97-9839-93f86ba81a89 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:57.212806 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 779/1551] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:52:57.214539 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d5c0c-7101-42a8-943c-5b59b6fb366a None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:57.215039 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d5c0c-7101-42a8-943c-5b59b6fb366a None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:57.215562 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d5c0c-7101-42a8-943c-5b59b6fb366a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:57.236992 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 773/1552] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:52:57 2022] POST /identity/v3/projects => generated 393 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:52:57.238523 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695efc0c-629a-4989-96dc-f14be90ab79b admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:57.252786 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-d98d5c0c-7101-42a8-943c-5b59b6fb366a None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:52:57.255627 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-d98d5c0c-7101-42a8-943c-5b59b6fb366a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:52:57.328365 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695efc0c-629a-4989-96dc-f14be90ab79b admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:57.335963 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda27c5e-b3e2-4fba-9d5c-1805811ce10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:57.336170 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 780/1553] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:52:57.336858 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d5c0c-7101-42a8-943c-5b59b6fb366a None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:57.337005 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda27c5e-b3e2-4fba-9d5c-1805811ce10a admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:57.337442 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda27c5e-b3e2-4fba-9d5c-1805811ce10a admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:57.337900 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda27c5e-b3e2-4fba-9d5c-1805811ce10a admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:57.339118 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda27c5e-b3e2-4fba-9d5c-1805811ce10a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:57.342816 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda27c5e-b3e2-4fba-9d5c-1805811ce10a admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:57.350975 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d5c0c-7101-42a8-943c-5b59b6fb366a None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:57.355598 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71defa8-88da-4da6-bd05-7b9348006535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:57.356292 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71defa8-88da-4da6-bd05-7b9348006535 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:57.356576 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71defa8-88da-4da6-bd05-7b9348006535 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:57.356844 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71defa8-88da-4da6-bd05-7b9348006535 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:57.357538 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71defa8-88da-4da6-bd05-7b9348006535 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:57.358737 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING py.warnings [None req-c71defa8-88da-4da6-bd05-7b9348006535 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 20:52:57.358737 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: warnings.warn(msg) Oct 28 20:52:57.358737 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: Oct 28 20:52:57.359983 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71defa8-88da-4da6-bd05-7b9348006535 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:57.383822 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 774/1554] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:52:57 2022] POST /identity/v3/projects => generated 389 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:52:57.385237 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0920db-188f-467f-9415-6c2856f198a1 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:57.385677 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0920db-188f-467f-9415-6c2856f198a1 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:57.386081 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0920db-188f-467f-9415-6c2856f198a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:57.398604 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 781/1555] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:52:57 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:52:57.398604 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8a29e-6bb3-4be2-8ef7-9f56302d34d7 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:57.398604 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8a29e-6bb3-4be2-8ef7-9f56302d34d7 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:57.398604 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8a29e-6bb3-4be2-8ef7-9f56302d34d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:57.407437 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-5e0920db-188f-467f-9415-6c2856f198a1 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:52:57.408721 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-5e0920db-188f-467f-9415-6c2856f198a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:52:57.416419 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-fac8a29e-6bb3-4be2-8ef7-9f56302d34d7 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:52:57.417888 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-fac8a29e-6bb3-4be2-8ef7-9f56302d34d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:52:57.475365 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 775/1556] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:52:57.476746 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0920db-188f-467f-9415-6c2856f198a1 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:57.482919 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 782/1557] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:52:57.489471 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0920db-188f-467f-9415-6c2856f198a1 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:57.490888 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafde4f-093b-4b21-a419-e11d0dcef35e None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:57.491371 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafde4f-093b-4b21-a419-e11d0dcef35e None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:57.491866 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafde4f-093b-4b21-a419-e11d0dcef35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:57.494708 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ea5dc-9189-4e9a-9f20-43981a0f31c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:57.495385 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ea5dc-9189-4e9a-9f20-43981a0f31c3 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:57.495666 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ea5dc-9189-4e9a-9f20-43981a0f31c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:57.495973 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ea5dc-9189-4e9a-9f20-43981a0f31c3 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:57.496668 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ea5dc-9189-4e9a-9f20-43981a0f31c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:57.497702 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING py.warnings [None req-1c6ea5dc-9189-4e9a-9f20-43981a0f31c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 20:52:57.497702 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: warnings.warn(msg) Oct 28 20:52:57.497702 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: Oct 28 20:52:57.498952 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ea5dc-9189-4e9a-9f20-43981a0f31c3 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:57.520095 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-8fafde4f-093b-4b21-a419-e11d0dcef35e None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:52:57.521323 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-8fafde4f-093b-4b21-a419-e11d0dcef35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:52:57.523007 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 776/1558] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:52:57 2022] POST /identity/v3/users => generated 297 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:52:57.524374 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61ba89-16b0-4ed7-993f-a3c74561fda2 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:57.524814 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61ba89-16b0-4ed7-993f-a3c74561fda2 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:57.525122 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61ba89-16b0-4ed7-993f-a3c74561fda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:57.530595 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 783/1559] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:52:57.531987 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2275f5-197b-4451-9d30-f2bc6a2aebd0 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:57.532262 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2275f5-197b-4451-9d30-f2bc6a2aebd0 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:57.532539 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2275f5-197b-4451-9d30-f2bc6a2aebd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:57.547426 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-bd61ba89-16b0-4ed7-993f-a3c74561fda2 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:52:57.548696 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-bd61ba89-16b0-4ed7-993f-a3c74561fda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:52:57.553836 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-cf2275f5-197b-4451-9d30-f2bc6a2aebd0 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:52:57.555045 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-cf2275f5-197b-4451-9d30-f2bc6a2aebd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:52:57.557670 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 777/1560] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:52:57.558495 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61ba89-16b0-4ed7-993f-a3c74561fda2 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:57.570075 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 784/1561] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:52:57.570075 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2275f5-197b-4451-9d30-f2bc6a2aebd0 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:57.574181 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61ba89-16b0-4ed7-993f-a3c74561fda2 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:57.576560 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2275f5-197b-4451-9d30-f2bc6a2aebd0 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:57.579110 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f9986-1876-465d-9926-90a9f3d61b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:57.579997 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f9986-1876-465d-9926-90a9f3d61b2b admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:57.580272 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f9986-1876-465d-9926-90a9f3d61b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:57.580540 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f9986-1876-465d-9926-90a9f3d61b2b admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:57.581243 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f9986-1876-465d-9926-90a9f3d61b2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:57.581531 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0cdbb-7cf8-4c76-add9-f3cb9ae488e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:57.582224 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0cdbb-7cf8-4c76-add9-f3cb9ae488e3 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:57.582492 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0cdbb-7cf8-4c76-add9-f3cb9ae488e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:57.582769 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0cdbb-7cf8-4c76-add9-f3cb9ae488e3 admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:57.583323 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f9986-1876-465d-9926-90a9f3d61b2b admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:57.583486 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca0cdbb-7cf8-4c76-add9-f3cb9ae488e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:57.585455 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca0cdbb-7cf8-4c76-add9-f3cb9ae488e3 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:57.611590 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 785/1562] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:52:57 2022] POST /identity/v3/users => generated 289 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:52:57.612649 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 778/1563] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:52:57 2022] POST /identity/v3/users => generated 295 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:52:57.615688 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed556c-657b-4d43-b6a4-405f9cba6cac None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:57.616179 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed556c-657b-4d43-b6a4-405f9cba6cac None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:57.616779 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed556c-657b-4d43-b6a4-405f9cba6cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:57.619992 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6233e8b-edbf-41ac-9291-7418417f5acb None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:57.620467 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6233e8b-edbf-41ac-9291-7418417f5acb None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:57.620946 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6233e8b-edbf-41ac-9291-7418417f5acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:57.645365 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-21ed556c-657b-4d43-b6a4-405f9cba6cac None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:52:57.647201 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-21ed556c-657b-4d43-b6a4-405f9cba6cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:52:57.648033 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-e6233e8b-edbf-41ac-9291-7418417f5acb None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:52:57.649900 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-e6233e8b-edbf-41ac-9291-7418417f5acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:52:57.660386 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 779/1564] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:52:57.661740 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed556c-657b-4d43-b6a4-405f9cba6cac None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:57.668058 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 786/1565] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:52:57.669544 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d2f14-1eb9-4149-9400-118d9f66577e None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:57.669824 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d2f14-1eb9-4149-9400-118d9f66577e None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:57.670146 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d2f14-1eb9-4149-9400-118d9f66577e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:57.675010 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed556c-657b-4d43-b6a4-405f9cba6cac None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:57.681313 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a2235-3a74-470c-ac3b-fe77647f0460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:57.682084 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a2235-3a74-470c-ac3b-fe77647f0460 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:57.682420 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a2235-3a74-470c-ac3b-fe77647f0460 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:57.682753 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a2235-3a74-470c-ac3b-fe77647f0460 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:57.683541 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a2235-3a74-470c-ac3b-fe77647f0460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:57.685872 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a2235-3a74-470c-ac3b-fe77647f0460 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:57.690204 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-f55d2f14-1eb9-4149-9400-118d9f66577e None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:52:57.691988 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-f55d2f14-1eb9-4149-9400-118d9f66577e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:52:57.701508 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 780/1566] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:52:57.701508 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce49aec-3f64-43b7-b9d3-abb22a25b57e None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:57.701508 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce49aec-3f64-43b7-b9d3-abb22a25b57e None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:57.701508 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce49aec-3f64-43b7-b9d3-abb22a25b57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:57.704775 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 787/1567] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:52:57.706183 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d2f14-1eb9-4149-9400-118d9f66577e None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:57.720272 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d2f14-1eb9-4149-9400-118d9f66577e None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:57.721686 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-2ce49aec-3f64-43b7-b9d3-abb22a25b57e None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:52:57.723541 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-2ce49aec-3f64-43b7-b9d3-abb22a25b57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:52:57.725653 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b6016-fbdb-4abb-aa9b-4b00df815791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:57.726258 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b6016-fbdb-4abb-aa9b-4b00df815791 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:57.726542 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b6016-fbdb-4abb-aa9b-4b00df815791 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:57.726808 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b6016-fbdb-4abb-aa9b-4b00df815791 admin admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:57.727638 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b6016-fbdb-4abb-aa9b-4b00df815791 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:52:57.727970 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b6016-fbdb-4abb-aa9b-4b00df815791 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:57.729592 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b6016-fbdb-4abb-aa9b-4b00df815791 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:57.732476 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 781/1568] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:52:57.733495 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce49aec-3f64-43b7-b9d3-abb22a25b57e None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:57.744114 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce49aec-3f64-43b7-b9d3-abb22a25b57e None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:57.747672 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 788/1569] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:52:57.747672 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b6016-fbdb-4abb-aa9b-4b00df815791 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:57.753978 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df3b10-ffd6-4724-939f-271cb84f8726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:57.755117 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df3b10-ffd6-4724-939f-271cb84f8726 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:57.755596 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df3b10-ffd6-4724-939f-271cb84f8726 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:57.756124 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df3b10-ffd6-4724-939f-271cb84f8726 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:57.757485 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df3b10-ffd6-4724-939f-271cb84f8726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:57.760501 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df3b10-ffd6-4724-939f-271cb84f8726 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:57.770778 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b6016-fbdb-4abb-aa9b-4b00df815791 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:57.772687 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 782/1570] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:52:57.774402 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df3b10-ffd6-4724-939f-271cb84f8726 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:57.785944 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a48772-283d-43a8-8603-464fdd89b244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:57.786774 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df3b10-ffd6-4724-939f-271cb84f8726 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:57.787135 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a48772-283d-43a8-8603-464fdd89b244 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:57.787623 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a48772-283d-43a8-8603-464fdd89b244 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:57.787936 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a48772-283d-43a8-8603-464fdd89b244 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:57.789001 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a48772-283d-43a8-8603-464fdd89b244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:57.790798 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a48772-283d-43a8-8603-464fdd89b244 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:57.794469 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123dcfa5-0187-4ede-b9b5-060808f75da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:57.795507 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dcfa5-0187-4ede-b9b5-060808f75da3 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:57.796008 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dcfa5-0187-4ede-b9b5-060808f75da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:57.796454 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dcfa5-0187-4ede-b9b5-060808f75da3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:57.797765 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123dcfa5-0187-4ede-b9b5-060808f75da3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:52:57.798120 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123dcfa5-0187-4ede-b9b5-060808f75da3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:57.799226 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING py.warnings [None req-123dcfa5-0187-4ede-b9b5-060808f75da3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 20:52:57.799226 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: warnings.warn(msg) Oct 28 20:52:57.799226 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: Oct 28 20:52:57.800412 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123dcfa5-0187-4ede-b9b5-060808f75da3 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:57.804848 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 789/1571] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:52:57.805848 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a48772-283d-43a8-8603-464fdd89b244 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:57.814377 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 783/1572] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:52:57.815233 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123dcfa5-0187-4ede-b9b5-060808f75da3 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:57.816556 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a48772-283d-43a8-8603-464fdd89b244 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:57.821458 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed0fbb-dd49-4339-ad49-ed6d6113e717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:57.822136 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed0fbb-dd49-4339-ad49-ed6d6113e717 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:57.822607 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed0fbb-dd49-4339-ad49-ed6d6113e717 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:57.823078 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed0fbb-dd49-4339-ad49-ed6d6113e717 admin admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:57.824827 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed0fbb-dd49-4339-ad49-ed6d6113e717 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:52:57.825383 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed0fbb-dd49-4339-ad49-ed6d6113e717 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:57.827521 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123dcfa5-0187-4ede-b9b5-060808f75da3 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:57.828578 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed0fbb-dd49-4339-ad49-ed6d6113e717 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:57.832989 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d0aee-554d-4c89-ae47-8de0a97a13d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:57.833655 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d0aee-554d-4c89-ae47-8de0a97a13d8 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:57.833929 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d0aee-554d-4c89-ae47-8de0a97a13d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:57.834207 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d0aee-554d-4c89-ae47-8de0a97a13d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:57.834942 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d0aee-554d-4c89-ae47-8de0a97a13d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:57.836620 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d0aee-554d-4c89-ae47-8de0a97a13d8 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:57.843899 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 790/1573] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:52:57.844762 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed0fbb-dd49-4339-ad49-ed6d6113e717 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:57.848669 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 784/1574] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:52:57.849835 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d0aee-554d-4c89-ae47-8de0a97a13d8 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:57.856635 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed0fbb-dd49-4339-ad49-ed6d6113e717 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:57.861356 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f28aa-ae9a-405d-b2a5-950be90526ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:57.862070 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f28aa-ae9a-405d-b2a5-950be90526ce admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:57.862293 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f28aa-ae9a-405d-b2a5-950be90526ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:57.862560 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f28aa-ae9a-405d-b2a5-950be90526ce admin admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:57.863335 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f28aa-ae9a-405d-b2a5-950be90526ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:52:57.863635 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f28aa-ae9a-405d-b2a5-950be90526ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:57.865279 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f28aa-ae9a-405d-b2a5-950be90526ce admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:57.869589 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d0aee-554d-4c89-ae47-8de0a97a13d8 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:57.877032 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a75b4f-ac35-4747-8843-abaf29176063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:57.877824 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 791/1575] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:52:57.878082 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a75b4f-ac35-4747-8843-abaf29176063 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:57.879081 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a75b4f-ac35-4747-8843-abaf29176063 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:57.879190 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f28aa-ae9a-405d-b2a5-950be90526ce admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:57.879575 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a75b4f-ac35-4747-8843-abaf29176063 admin admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:57.880992 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a75b4f-ac35-4747-8843-abaf29176063 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:52:57.881538 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a75b4f-ac35-4747-8843-abaf29176063 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:57.884766 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a75b4f-ac35-4747-8843-abaf29176063 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:57.890524 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f28aa-ae9a-405d-b2a5-950be90526ce admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:57.896367 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e8086-8c6c-4e46-9702-a01deb20698e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:57.897079 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e8086-8c6c-4e46-9702-a01deb20698e admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:57.897368 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e8086-8c6c-4e46-9702-a01deb20698e admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:57.897640 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e8086-8c6c-4e46-9702-a01deb20698e admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:57.898359 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e8086-8c6c-4e46-9702-a01deb20698e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:57.900632 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e8086-8c6c-4e46-9702-a01deb20698e admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:57.906879 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 785/1576] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:52:57.908521 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a75b4f-ac35-4747-8843-abaf29176063 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:57.926254 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a75b4f-ac35-4747-8843-abaf29176063 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:57.932166 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4401da-871b-4d09-9cf6-2dc8f0f23d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:57.932850 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4401da-871b-4d09-9cf6-2dc8f0f23d73 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:57.933069 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 792/1577] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:52:57 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:52:57.933194 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4401da-871b-4d09-9cf6-2dc8f0f23d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:57.933416 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4401da-871b-4d09-9cf6-2dc8f0f23d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:57.934128 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4401da-871b-4d09-9cf6-2dc8f0f23d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:57.934522 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e8086-8c6c-4e46-9702-a01deb20698e admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:57.935844 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4401da-871b-4d09-9cf6-2dc8f0f23d73 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:57.947105 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 786/1578] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:52:57.951123 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4401da-871b-4d09-9cf6-2dc8f0f23d73 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:57.962738 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4401da-871b-4d09-9cf6-2dc8f0f23d73 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:58.005578 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e8086-8c6c-4e46-9702-a01deb20698e admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:58.010488 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51ae8f-f99a-4c43-9ab8-83c17b1355af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:58.011153 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51ae8f-f99a-4c43-9ab8-83c17b1355af admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:58.011592 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51ae8f-f99a-4c43-9ab8-83c17b1355af admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:58.011899 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51ae8f-f99a-4c43-9ab8-83c17b1355af admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:58.012635 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb51ae8f-f99a-4c43-9ab8-83c17b1355af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:58.014243 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb51ae8f-f99a-4c43-9ab8-83c17b1355af admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:58.029037 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58d547-8b6b-4984-a5aa-fde518652109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:58.030084 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58d547-8b6b-4984-a5aa-fde518652109 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:58.030527 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58d547-8b6b-4984-a5aa-fde518652109 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:58.030979 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58d547-8b6b-4984-a5aa-fde518652109 admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:58.035384 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 793/1579] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:52:58.035631 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58d547-8b6b-4984-a5aa-fde518652109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:58.035813 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51ae8f-f99a-4c43-9ab8-83c17b1355af admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:58.035948 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58d547-8b6b-4984-a5aa-fde518652109 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:58.047863 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51ae8f-f99a-4c43-9ab8-83c17b1355af admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:58.054228 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3264e1-8a7f-4ae6-86ed-cd7511310112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:58.055253 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3264e1-8a7f-4ae6-86ed-cd7511310112 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:58.055563 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3264e1-8a7f-4ae6-86ed-cd7511310112 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:58.055977 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3264e1-8a7f-4ae6-86ed-cd7511310112 admin admin] PATH_INFO: `/v3/projects/99fe5983d1c6464796b4c24984ceb0c4/users/48c87597846e44f186da0c969a2579bf/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:58.076557 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 787/1580] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:52:57 2022] POST /identity/v3/projects => generated 405 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:52:58.076557 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58d547-8b6b-4984-a5aa-fde518652109 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:58.079480 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3264e1-8a7f-4ae6-86ed-cd7511310112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99fe5983d1c6464796b4c24984ceb0c4, user_id=48c87597846e44f186da0c969a2579bf, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:58.080636 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING py.warnings [None req-ba3264e1-8a7f-4ae6-86ed-cd7511310112 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 20:52:58.080636 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: warnings.warn(msg) Oct 28 20:52:58.080636 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: Oct 28 20:52:58.083255 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3264e1-8a7f-4ae6-86ed-cd7511310112 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:58.098726 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 794/1581] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:52:58 2022] PUT /identity/v3/projects/99fe5983d1c6464796b4c24984ceb0c4/users/48c87597846e44f186da0c969a2579bf/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:52:58.100383 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3264e1-8a7f-4ae6-86ed-cd7511310112 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:58.141211 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58d547-8b6b-4984-a5aa-fde518652109 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:58.172838 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3264e1-8a7f-4ae6-86ed-cd7511310112 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:58.178138 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3007ebb-750f-4d9f-9409-68addd4ba9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:58.178958 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3007ebb-750f-4d9f-9409-68addd4ba9f5 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:58.179332 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3007ebb-750f-4d9f-9409-68addd4ba9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:58.179701 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3007ebb-750f-4d9f-9409-68addd4ba9f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:58.180545 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3007ebb-750f-4d9f-9409-68addd4ba9f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:58.182603 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3007ebb-750f-4d9f-9409-68addd4ba9f5 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:58.205011 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf23e11-16f8-42c2-8673-bd73fecd521d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:58.205847 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf23e11-16f8-42c2-8673-bd73fecd521d admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:58.206237 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf23e11-16f8-42c2-8673-bd73fecd521d admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:58.207436 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf23e11-16f8-42c2-8673-bd73fecd521d admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:58.208339 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf23e11-16f8-42c2-8673-bd73fecd521d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:58.210231 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 795/1582] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:52:58 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:52:58.210838 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf23e11-16f8-42c2-8673-bd73fecd521d admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:58.211041 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3007ebb-750f-4d9f-9409-68addd4ba9f5 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:58.242806 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 788/1583] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:52:58 2022] POST /identity/v3/projects => generated 403 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:52:58.244080 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf23e11-16f8-42c2-8673-bd73fecd521d admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:58.283226 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3007ebb-750f-4d9f-9409-68addd4ba9f5 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:58.319094 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf23e11-16f8-42c2-8673-bd73fecd521d admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:58.325089 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ddebee-266e-4d9c-a953-8e1ce42ad912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:58.325969 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ddebee-266e-4d9c-a953-8e1ce42ad912 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:58.326495 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ddebee-266e-4d9c-a953-8e1ce42ad912 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:58.326995 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ddebee-266e-4d9c-a953-8e1ce42ad912 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:58.328114 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ddebee-266e-4d9c-a953-8e1ce42ad912 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:58.330651 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ddebee-266e-4d9c-a953-8e1ce42ad912 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:58.345403 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc4812-5579-494a-88dd-561e0db7b6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:58.346077 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc4812-5579-494a-88dd-561e0db7b6c4 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:58.346356 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc4812-5579-494a-88dd-561e0db7b6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:58.346628 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc4812-5579-494a-88dd-561e0db7b6c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:58.347912 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fc4812-5579-494a-88dd-561e0db7b6c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:58.350130 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fc4812-5579-494a-88dd-561e0db7b6c4 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:58.356469 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 789/1584] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:52:58 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:52:58.357862 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ddebee-266e-4d9c-a953-8e1ce42ad912 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:58.372901 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ddebee-266e-4d9c-a953-8e1ce42ad912 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:58.377921 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b179f2-40fb-4545-b040-43b64539c6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:58.378800 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 796/1585] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:52:58 2022] POST /identity/v3/projects => generated 371 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:52:58.383003 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b179f2-40fb-4545-b040-43b64539c6d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:58.383003 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b179f2-40fb-4545-b040-43b64539c6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:58.383286 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc4812-5579-494a-88dd-561e0db7b6c4 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:58.383433 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b179f2-40fb-4545-b040-43b64539c6d3 admin admin] PATH_INFO: `/v3/projects/dca1f27b8d344d09bd6637d783fa6361/users/59e07e89a62b42a4974f3b226cc2b8a0/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:58.397638 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b179f2-40fb-4545-b040-43b64539c6d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dca1f27b8d344d09bd6637d783fa6361, user_id=59e07e89a62b42a4974f3b226cc2b8a0, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:58.401375 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b179f2-40fb-4545-b040-43b64539c6d3 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:58.421890 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 790/1586] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:52:58 2022] PUT /identity/v3/projects/dca1f27b8d344d09bd6637d783fa6361/users/59e07e89a62b42a4974f3b226cc2b8a0/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:52:58.421890 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b179f2-40fb-4545-b040-43b64539c6d3 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:58.453693 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc4812-5579-494a-88dd-561e0db7b6c4 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:58.492096 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b179f2-40fb-4545-b040-43b64539c6d3 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:58.499079 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0348e5-40ea-48f9-a663-2ee07d21fe2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:58.500180 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0348e5-40ea-48f9-a663-2ee07d21fe2e admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:58.500625 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0348e5-40ea-48f9-a663-2ee07d21fe2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:58.501066 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0348e5-40ea-48f9-a663-2ee07d21fe2e admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:58.501999 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0348e5-40ea-48f9-a663-2ee07d21fe2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:58.504647 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0348e5-40ea-48f9-a663-2ee07d21fe2e admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:58.523140 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d44f32-2014-474b-b8fc-6111c67d95e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:58.524052 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d44f32-2014-474b-b8fc-6111c67d95e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:58.524334 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d44f32-2014-474b-b8fc-6111c67d95e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:58.524608 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d44f32-2014-474b-b8fc-6111c67d95e1 admin admin] PATH_INFO: `/v3/projects/908c94b386f2491aa46bed4be1d5ea84/users/7781cf44c6cb47a8adac1e187e9a8dac/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:58.530271 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 791/1587] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:52:58 2022] POST /identity/v3/users => generated 303 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:52:58.531873 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8270e6-04e4-4d3c-92a2-b9b9a84adea3 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:58.532316 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8270e6-04e4-4d3c-92a2-b9b9a84adea3 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:58.532723 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8270e6-04e4-4d3c-92a2-b9b9a84adea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:58.541478 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d44f32-2014-474b-b8fc-6111c67d95e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=908c94b386f2491aa46bed4be1d5ea84, user_id=7781cf44c6cb47a8adac1e187e9a8dac, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:58.544248 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d44f32-2014-474b-b8fc-6111c67d95e1 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:58.553601 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-cd8270e6-04e4-4d3c-92a2-b9b9a84adea3 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:52:58.554829 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-cd8270e6-04e4-4d3c-92a2-b9b9a84adea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:52:58.561979 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 797/1588] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:52:58 2022] PUT /identity/v3/projects/908c94b386f2491aa46bed4be1d5ea84/users/7781cf44c6cb47a8adac1e187e9a8dac/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:52:58.563476 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d44f32-2014-474b-b8fc-6111c67d95e1 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:58.624154 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 792/1589] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:52:58.625727 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8270e6-04e4-4d3c-92a2-b9b9a84adea3 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:58.635269 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d44f32-2014-474b-b8fc-6111c67d95e1 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:58.639992 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8270e6-04e4-4d3c-92a2-b9b9a84adea3 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:58.640441 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572ade0-524a-4320-b7ac-60378c99016c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:58.641152 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572ade0-524a-4320-b7ac-60378c99016c admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:58.641432 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572ade0-524a-4320-b7ac-60378c99016c admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:58.641710 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572ade0-524a-4320-b7ac-60378c99016c admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:58.642403 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0572ade0-524a-4320-b7ac-60378c99016c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:58.645032 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0572ade0-524a-4320-b7ac-60378c99016c admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:58.646220 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a529b7-c595-492f-b3e8-c51e131c1e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:58.646900 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a529b7-c595-492f-b3e8-c51e131c1e23 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:58.647182 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a529b7-c595-492f-b3e8-c51e131c1e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:58.647456 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a529b7-c595-492f-b3e8-c51e131c1e23 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:58.648250 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a529b7-c595-492f-b3e8-c51e131c1e23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:58.650607 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a529b7-c595-492f-b3e8-c51e131c1e23 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:58.669885 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 798/1590] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:52:58 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:52:58.671225 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572ade0-524a-4320-b7ac-60378c99016c admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:58.680432 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 793/1591] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:52:58 2022] POST /identity/v3/users => generated 302 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:52:58.680432 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a529b7-c595-492f-b3e8-c51e131c1e23 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:58.682801 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572ade0-524a-4320-b7ac-60378c99016c admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:58.687644 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066a049-2649-4548-9242-ba1fe596da78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:58.688357 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066a049-2649-4548-9242-ba1fe596da78 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:58.688637 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066a049-2649-4548-9242-ba1fe596da78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:58.688912 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066a049-2649-4548-9242-ba1fe596da78 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:58.689640 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066a049-2649-4548-9242-ba1fe596da78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:58.690971 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a529b7-c595-492f-b3e8-c51e131c1e23 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:58.691336 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066a049-2649-4548-9242-ba1fe596da78 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:58.698129 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45e23b-d580-47a8-a4e0-bdbc7a5d8012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:58.699212 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45e23b-d580-47a8-a4e0-bdbc7a5d8012 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:58.699670 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45e23b-d580-47a8-a4e0-bdbc7a5d8012 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:58.700055 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45e23b-d580-47a8-a4e0-bdbc7a5d8012 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:58.701310 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45e23b-d580-47a8-a4e0-bdbc7a5d8012 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:58.704239 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45e23b-d580-47a8-a4e0-bdbc7a5d8012 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:58.705342 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 799/1592] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:52:58.707627 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6ab22-0ab4-4d7a-a19f-29a70c77b48f None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:58.708036 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6ab22-0ab4-4d7a-a19f-29a70c77b48f None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:58.708220 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6ab22-0ab4-4d7a-a19f-29a70c77b48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:58.727725 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-4dc6ab22-0ab4-4d7a-a19f-29a70c77b48f None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:52:58.728538 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 794/1593] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:52:58 2022] POST /identity/v3/users => generated 286 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:52:58.733773 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-4dc6ab22-0ab4-4d7a-a19f-29a70c77b48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:52:58.733945 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45e23b-d580-47a8-a4e0-bdbc7a5d8012 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:58.739769 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 800/1594] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:52:58.741261 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41abbe-7c94-463f-99d5-2679c3d5cf52 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:58.741618 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41abbe-7c94-463f-99d5-2679c3d5cf52 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:58.742087 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41abbe-7c94-463f-99d5-2679c3d5cf52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:58.745285 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45e23b-d580-47a8-a4e0-bdbc7a5d8012 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:58.751007 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd371aa-dd54-48e3-bbde-4485d815f95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:58.751684 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd371aa-dd54-48e3-bbde-4485d815f95d admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:58.752027 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd371aa-dd54-48e3-bbde-4485d815f95d admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:58.752299 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd371aa-dd54-48e3-bbde-4485d815f95d admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:58.753035 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd371aa-dd54-48e3-bbde-4485d815f95d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:58.754762 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd371aa-dd54-48e3-bbde-4485d815f95d admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:58.766091 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-3a41abbe-7c94-463f-99d5-2679c3d5cf52 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:52:58.768034 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-3a41abbe-7c94-463f-99d5-2679c3d5cf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:52:58.771194 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 795/1595] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:52:58.771194 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd371aa-dd54-48e3-bbde-4485d815f95d admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:58.779041 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 801/1596] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:52:58.779943 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41abbe-7c94-463f-99d5-2679c3d5cf52 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:58.792118 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41abbe-7c94-463f-99d5-2679c3d5cf52 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:58.797330 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb9937-7cab-4058-8d71-5d1b9a2d75d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:58.798007 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb9937-7cab-4058-8d71-5d1b9a2d75d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:58.798290 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb9937-7cab-4058-8d71-5d1b9a2d75d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:58.798567 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb9937-7cab-4058-8d71-5d1b9a2d75d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:58.799310 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb9937-7cab-4058-8d71-5d1b9a2d75d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:58.800980 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb9937-7cab-4058-8d71-5d1b9a2d75d9 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:58.812038 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 802/1597] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:52:58.812917 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb9937-7cab-4058-8d71-5d1b9a2d75d9 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:58.824335 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb9937-7cab-4058-8d71-5d1b9a2d75d9 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:58.829339 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f045f-9fb0-4bba-b7bf-4f96e837e91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:58.830030 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f045f-9fb0-4bba-b7bf-4f96e837e91e admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:58.830308 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f045f-9fb0-4bba-b7bf-4f96e837e91e admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:58.830583 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f045f-9fb0-4bba-b7bf-4f96e837e91e admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:58.831344 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f045f-9fb0-4bba-b7bf-4f96e837e91e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:58.833926 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f045f-9fb0-4bba-b7bf-4f96e837e91e admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:58.842629 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd371aa-dd54-48e3-bbde-4485d815f95d admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:58.845059 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 803/1598] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:52:58.845940 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f045f-9fb0-4bba-b7bf-4f96e837e91e admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:58.850837 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa88df7-c348-43cd-83a1-69261f22ffea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:58.851917 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa88df7-c348-43cd-83a1-69261f22ffea service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:58.852382 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa88df7-c348-43cd-83a1-69261f22ffea service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:58.852837 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa88df7-c348-43cd-83a1-69261f22ffea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:58.862136 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f045f-9fb0-4bba-b7bf-4f96e837e91e admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:58.868925 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa88df7-c348-43cd-83a1-69261f22ffea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:58.869198 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130500b-edac-43d5-a445-d540093b3b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:58.870211 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130500b-edac-43d5-a445-d540093b3b73 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:58.870663 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130500b-edac-43d5-a445-d540093b3b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:58.871107 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130500b-edac-43d5-a445-d540093b3b73 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:58.871474 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa88df7-c348-43cd-83a1-69261f22ffea service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:58.872359 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130500b-edac-43d5-a445-d540093b3b73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:58.875685 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130500b-edac-43d5-a445-d540093b3b73 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:58.887700 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 796/1599] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:52:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:52:58.888954 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa88df7-c348-43cd-83a1-69261f22ffea service neutron] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:58.892205 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 804/1600] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:52:58.893730 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130500b-edac-43d5-a445-d540093b3b73 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:58.902265 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa88df7-c348-43cd-83a1-69261f22ffea service neutron] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:58.907558 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130500b-edac-43d5-a445-d540093b3b73 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:58.908183 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96c093-5998-40fb-9528-d44cedfb8819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:58.909136 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96c093-5998-40fb-9528-d44cedfb8819 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:58.909513 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96c093-5998-40fb-9528-d44cedfb8819 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:58.910529 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96c093-5998-40fb-9528-d44cedfb8819 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:58.911720 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96c093-5998-40fb-9528-d44cedfb8819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:58.914508 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5db26-7ca1-4f92-b49b-c08f12397c51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:58.914846 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96c093-5998-40fb-9528-d44cedfb8819 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:58.915289 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5db26-7ca1-4f92-b49b-c08f12397c51 service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:58.915727 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5db26-7ca1-4f92-b49b-c08f12397c51 service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:58.916211 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5db26-7ca1-4f92-b49b-c08f12397c51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:58.928739 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5db26-7ca1-4f92-b49b-c08f12397c51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:58.930219 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5db26-7ca1-4f92-b49b-c08f12397c51 service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:58.937173 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 797/1601] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:52:58.937173 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96c093-5998-40fb-9528-d44cedfb8819 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:58.945768 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 805/1602] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:52:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:52:58.947478 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5db26-7ca1-4f92-b49b-c08f12397c51 service neutron] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:58.954622 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96c093-5998-40fb-9528-d44cedfb8819 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:58.956209 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5db26-7ca1-4f92-b49b-c08f12397c51 service neutron] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:58.960917 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe8534-1f1e-47a3-814d-a27948456687 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:58.961694 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe8534-1f1e-47a3-814d-a27948456687 service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:58.961998 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe8534-1f1e-47a3-814d-a27948456687 service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:58.962341 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe8534-1f1e-47a3-814d-a27948456687 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:58.964447 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186c3c6-e2c0-4c3f-af3d-db0a6f555b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:58.965662 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186c3c6-e2c0-4c3f-af3d-db0a6f555b03 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:58.966235 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186c3c6-e2c0-4c3f-af3d-db0a6f555b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:58.966856 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186c3c6-e2c0-4c3f-af3d-db0a6f555b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:58.968364 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186c3c6-e2c0-4c3f-af3d-db0a6f555b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:58.971801 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186c3c6-e2c0-4c3f-af3d-db0a6f555b03 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:58.973284 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe8534-1f1e-47a3-814d-a27948456687 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:58.974824 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe8534-1f1e-47a3-814d-a27948456687 service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:58.986271 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 806/1603] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:52:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:52:58.987081 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe8534-1f1e-47a3-814d-a27948456687 service neutron] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:58.997075 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 798/1604] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:52:58.997075 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186c3c6-e2c0-4c3f-af3d-db0a6f555b03 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:59.001412 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe8534-1f1e-47a3-814d-a27948456687 service neutron] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:59.007067 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38559809-e121-4a0d-8b6e-30c828204d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:59.007759 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38559809-e121-4a0d-8b6e-30c828204d4f admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:59.008299 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38559809-e121-4a0d-8b6e-30c828204d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:59.008575 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38559809-e121-4a0d-8b6e-30c828204d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:59.009557 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38559809-e121-4a0d-8b6e-30c828204d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:59.011004 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38559809-e121-4a0d-8b6e-30c828204d4f admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:59.016495 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186c3c6-e2c0-4c3f-af3d-db0a6f555b03 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:59.023217 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 807/1605] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:52:59.026824 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4a66c-3bfe-4163-bcfa-c7544bd4f49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:59.027566 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38559809-e121-4a0d-8b6e-30c828204d4f admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:59.028139 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4a66c-3bfe-4163-bcfa-c7544bd4f49d admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:59.028937 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4a66c-3bfe-4163-bcfa-c7544bd4f49d admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:59.029431 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4a66c-3bfe-4163-bcfa-c7544bd4f49d admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:59.031261 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4a66c-3bfe-4163-bcfa-c7544bd4f49d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:59.035402 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4a66c-3bfe-4163-bcfa-c7544bd4f49d admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:59.039482 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38559809-e121-4a0d-8b6e-30c828204d4f admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:59.045856 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9304a50-18f1-4b4a-b07a-ab827455133d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:59.046759 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9304a50-18f1-4b4a-b07a-ab827455133d admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:59.047072 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9304a50-18f1-4b4a-b07a-ab827455133d admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:59.047378 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9304a50-18f1-4b4a-b07a-ab827455133d admin admin] PATH_INFO: `/v3/projects/c09c53c40108411b8b37620f637000e2/users/5dec57310b724afa966fd56650707e54/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:59.063841 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 799/1606] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:52:59.063841 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4a66c-3bfe-4163-bcfa-c7544bd4f49d admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:59.069461 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9304a50-18f1-4b4a-b07a-ab827455133d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c09c53c40108411b8b37620f637000e2, user_id=5dec57310b724afa966fd56650707e54, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:59.072269 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9304a50-18f1-4b4a-b07a-ab827455133d admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:59.079298 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4a66c-3bfe-4163-bcfa-c7544bd4f49d admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:59.085536 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd93b7-6932-4185-bd84-b1021d424799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:59.086225 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd93b7-6932-4185-bd84-b1021d424799 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:59.086516 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd93b7-6932-4185-bd84-b1021d424799 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:59.086832 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd93b7-6932-4185-bd84-b1021d424799 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:59.087493 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd93b7-6932-4185-bd84-b1021d424799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:59.089176 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd93b7-6932-4185-bd84-b1021d424799 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:59.091176 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 808/1607] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:52:59 2022] PUT /identity/v3/projects/c09c53c40108411b8b37620f637000e2/users/5dec57310b724afa966fd56650707e54/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:52:59.092089 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9304a50-18f1-4b4a-b07a-ab827455133d admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:59.101604 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 800/1608] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:52:59.102588 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd93b7-6932-4185-bd84-b1021d424799 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:59.115179 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd93b7-6932-4185-bd84-b1021d424799 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:59.183976 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9304a50-18f1-4b4a-b07a-ab827455133d admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:59.189670 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f733287-7d63-4a70-8ea3-142e56665cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:59.190650 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f733287-7d63-4a70-8ea3-142e56665cba admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:59.191046 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f733287-7d63-4a70-8ea3-142e56665cba admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:59.191277 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f733287-7d63-4a70-8ea3-142e56665cba admin admin] PATH_INFO: `/v3/projects/852949f745ee4e23959a221981897741/users/d20d4d82516c4cdaad51140a4abf88f2/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:59.206189 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62504f04-851f-49d4-ad61-08c4e9c51938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:59.208332 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62504f04-851f-49d4-ad61-08c4e9c51938 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:59.208814 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62504f04-851f-49d4-ad61-08c4e9c51938 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:59.209240 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f733287-7d63-4a70-8ea3-142e56665cba admin admin] RBAC: Authorizing `identity:create_grant(project_id=852949f745ee4e23959a221981897741, user_id=d20d4d82516c4cdaad51140a4abf88f2, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:59.209360 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62504f04-851f-49d4-ad61-08c4e9c51938 admin admin] PATH_INFO: `/v3/projects/aa76b14bb1ff4a7383ff932ec1df8e10/users/a9a00ca081c24dde98c89e398267133f/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:59.212226 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f733287-7d63-4a70-8ea3-142e56665cba admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:59.231321 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 809/1609] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:52:59 2022] PUT /identity/v3/projects/852949f745ee4e23959a221981897741/users/d20d4d82516c4cdaad51140a4abf88f2/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:52:59.232343 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f733287-7d63-4a70-8ea3-142e56665cba admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:59.239715 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62504f04-851f-49d4-ad61-08c4e9c51938 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa76b14bb1ff4a7383ff932ec1df8e10, user_id=a9a00ca081c24dde98c89e398267133f, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:59.245258 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62504f04-851f-49d4-ad61-08c4e9c51938 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:59.264541 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 801/1610] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:52:59 2022] PUT /identity/v3/projects/aa76b14bb1ff4a7383ff932ec1df8e10/users/a9a00ca081c24dde98c89e398267133f/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:52:59.270895 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5f5be-37ee-45e9-8f33-cea018e2c698 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:59.271180 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5f5be-37ee-45e9-8f33-cea018e2c698 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:59.271460 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5f5be-37ee-45e9-8f33-cea018e2c698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:59.292318 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-10f5f5be-37ee-45e9-8f33-cea018e2c698 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:52:59.293083 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-10f5f5be-37ee-45e9-8f33-cea018e2c698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:52:59.333677 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f733287-7d63-4a70-8ea3-142e56665cba admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:59.361444 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 802/1611] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:52:59.362421 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5f5be-37ee-45e9-8f33-cea018e2c698 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:59.372777 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5f5be-37ee-45e9-8f33-cea018e2c698 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:59.378019 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28176a84-acc4-49e1-81d9-85139e495a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:59.379999 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28176a84-acc4-49e1-81d9-85139e495a1b admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:59.380481 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28176a84-acc4-49e1-81d9-85139e495a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:59.380838 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28176a84-acc4-49e1-81d9-85139e495a1b admin admin] PATH_INFO: `/v3/projects/634dffc393384b14abedbd8c3e05a238/users/150d90c8e5ea41eca2c5b80085e4ec09/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:59.397804 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28176a84-acc4-49e1-81d9-85139e495a1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=634dffc393384b14abedbd8c3e05a238, user_id=150d90c8e5ea41eca2c5b80085e4ec09, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:59.402551 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28176a84-acc4-49e1-81d9-85139e495a1b admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:59.418926 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 803/1612] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:52:59 2022] PUT /identity/v3/projects/634dffc393384b14abedbd8c3e05a238/users/150d90c8e5ea41eca2c5b80085e4ec09/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:52:59.420710 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb8997-55e4-42a0-9f49-ac8971d8fdf8 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:59.421007 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb8997-55e4-42a0-9f49-ac8971d8fdf8 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:59.421282 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb8997-55e4-42a0-9f49-ac8971d8fdf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:59.442208 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-89bb8997-55e4-42a0-9f49-ac8971d8fdf8 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:52:59.443462 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-89bb8997-55e4-42a0-9f49-ac8971d8fdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:52:59.447927 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ad6ac-202e-46a2-9186-e0ab9dca4ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:59.450011 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ad6ac-202e-46a2-9186-e0ab9dca4ef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:59.450835 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ad6ac-202e-46a2-9186-e0ab9dca4ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:59.452556 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ad6ac-202e-46a2-9186-e0ab9dca4ef3 admin admin] PATH_INFO: `/v3/projects/ce28cbe8493949d6bba61fde5753536f/users/627058634a024c1a92c08b1744626267/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:59.473918 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ad6ac-202e-46a2-9186-e0ab9dca4ef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce28cbe8493949d6bba61fde5753536f, user_id=627058634a024c1a92c08b1744626267, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:59.477146 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ad6ac-202e-46a2-9186-e0ab9dca4ef3 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:59.498584 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 810/1613] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:52:59 2022] PUT /identity/v3/projects/ce28cbe8493949d6bba61fde5753536f/users/627058634a024c1a92c08b1744626267/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:52:59.500648 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdd6d9-fcbf-421d-9548-c1b19265135b None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:59.501292 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdd6d9-fcbf-421d-9548-c1b19265135b None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:59.501870 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdd6d9-fcbf-421d-9548-c1b19265135b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:59.534703 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 804/1614] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:52:59.539983 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb8997-55e4-42a0-9f49-ac8971d8fdf8 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:59.540160 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-b1cdd6d9-fcbf-421d-9548-c1b19265135b None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:52:59.540160 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-b1cdd6d9-fcbf-421d-9548-c1b19265135b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:52:59.602040 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb8997-55e4-42a0-9f49-ac8971d8fdf8 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:59.622924 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 811/1615] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:52:59.624452 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706db55-fa47-4cd2-9d75-be7a32f1bae8 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:59.624901 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706db55-fa47-4cd2-9d75-be7a32f1bae8 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:59.624901 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706db55-fa47-4cd2-9d75-be7a32f1bae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:59.660386 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253541e-7450-4f88-96d5-1bc7bfaafe86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:59.661150 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253541e-7450-4f88-96d5-1bc7bfaafe86 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:59.661524 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253541e-7450-4f88-96d5-1bc7bfaafe86 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:59.661850 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253541e-7450-4f88-96d5-1bc7bfaafe86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:59.674066 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3253541e-7450-4f88-96d5-1bc7bfaafe86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:59.675591 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3253541e-7450-4f88-96d5-1bc7bfaafe86 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:59.698028 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-f706db55-fa47-4cd2-9d75-be7a32f1bae8 None None] MFA Rules not processed for user `150d90c8e5ea41eca2c5b80085e4ec09`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:52:59.700585 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-f706db55-fa47-4cd2-9d75-be7a32f1bae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:52:59.714776 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 805/1616] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:52:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:52:59.718651 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303cc5b-4068-423d-aba1-4dd82373ec25 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:59.719171 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303cc5b-4068-423d-aba1-4dd82373ec25 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:59.719634 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303cc5b-4068-423d-aba1-4dd82373ec25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:59.797310 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-f303cc5b-4068-423d-aba1-4dd82373ec25 None None] MFA Rules not processed for user `627058634a024c1a92c08b1744626267`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:52:59.799485 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-f303cc5b-4068-423d-aba1-4dd82373ec25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:52:59.857131 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 812/1617] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:52:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:52:59.858780 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706db55-fa47-4cd2-9d75-be7a32f1bae8 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:59.876114 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706db55-fa47-4cd2-9d75-be7a32f1bae8 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:59.883720 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4907882-fbed-4556-8587-9187d3c9b28e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:59.885338 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4907882-fbed-4556-8587-9187d3c9b28e service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:59.885901 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4907882-fbed-4556-8587-9187d3c9b28e service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:59.886714 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4907882-fbed-4556-8587-9187d3c9b28e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:59.909006 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4907882-fbed-4556-8587-9187d3c9b28e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:59.912991 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4907882-fbed-4556-8587-9187d3c9b28e service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:59.935135 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 813/1618] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:52:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:52:59.936716 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4907882-fbed-4556-8587-9187d3c9b28e service neutron] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:59.949502 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4907882-fbed-4556-8587-9187d3c9b28e service neutron] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:52:59.956364 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85423337-454b-45f7-9805-0fbcc5eddc0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:52:59.958350 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85423337-454b-45f7-9805-0fbcc5eddc0c service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:52:59.958495 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85423337-454b-45f7-9805-0fbcc5eddc0c service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:52:59.958695 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85423337-454b-45f7-9805-0fbcc5eddc0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:52:59.981548 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85423337-454b-45f7-9805-0fbcc5eddc0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:52:59.982975 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85423337-454b-45f7-9805-0fbcc5eddc0c service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:52:59.995871 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 806/1619] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:52:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:52:59.995871 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303cc5b-4068-423d-aba1-4dd82373ec25 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:52:59.999647 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 814/1620] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:52:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:53:00.001203 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85423337-454b-45f7-9805-0fbcc5eddc0c service neutron] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:00.011097 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85423337-454b-45f7-9805-0fbcc5eddc0c service neutron] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:00.016244 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62c901-b422-42ef-bbf3-e1933996b9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:00.016967 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62c901-b422-42ef-bbf3-e1933996b9d1 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:00.017282 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62c901-b422-42ef-bbf3-e1933996b9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:00.017690 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62c901-b422-42ef-bbf3-e1933996b9d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:00.018451 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f62c901-b422-42ef-bbf3-e1933996b9d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:00.021182 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f62c901-b422-42ef-bbf3-e1933996b9d1 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:00.032475 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303cc5b-4068-423d-aba1-4dd82373ec25 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:00.067934 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfb390-2ca4-4509-8f84-b0ccd43d90d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:00.069807 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfb390-2ca4-4509-8f84-b0ccd43d90d1 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:00.070305 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfb390-2ca4-4509-8f84-b0ccd43d90d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:00.070877 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfb390-2ca4-4509-8f84-b0ccd43d90d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:00.072870 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdfb390-2ca4-4509-8f84-b0ccd43d90d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:00.075843 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 815/1621] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:52:59 2022] POST /identity/v3/projects => generated 405 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:53:00.080231 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdfb390-2ca4-4509-8f84-b0ccd43d90d1 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:00.082566 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62c901-b422-42ef-bbf3-e1933996b9d1 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:00.174127 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 807/1622] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:52:59 2022] POST /identity/v3/projects => generated 373 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:53:00.181309 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfb390-2ca4-4509-8f84-b0ccd43d90d1 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:00.333055 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62c901-b422-42ef-bbf3-e1933996b9d1 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:00.410638 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfb390-2ca4-4509-8f84-b0ccd43d90d1 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:00.421908 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022cbd75-34cd-4ace-9d2c-ec0177c8172a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:00.423543 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cbd75-34cd-4ace-9d2c-ec0177c8172a admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:00.424676 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cbd75-34cd-4ace-9d2c-ec0177c8172a admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:00.426027 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cbd75-34cd-4ace-9d2c-ec0177c8172a admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:00.430162 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022cbd75-34cd-4ace-9d2c-ec0177c8172a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:00.437900 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022cbd75-34cd-4ace-9d2c-ec0177c8172a admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:00.479411 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c64fa-7c9c-4877-94d4-730c8079f2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:00.480674 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c64fa-7c9c-4877-94d4-730c8079f2cb admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:00.481140 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c64fa-7c9c-4877-94d4-730c8079f2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:00.481670 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c64fa-7c9c-4877-94d4-730c8079f2cb admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:00.482753 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 808/1623] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:53:00 2022] POST /identity/v3/users => generated 293 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:53:00.487132 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c64fa-7c9c-4877-94d4-730c8079f2cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:00.493048 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c64fa-7c9c-4877-94d4-730c8079f2cb admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:00.500318 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022cbd75-34cd-4ace-9d2c-ec0177c8172a admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:00.559250 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022cbd75-34cd-4ace-9d2c-ec0177c8172a admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:00.569382 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 816/1624] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:53:00 2022] POST /identity/v3/users => generated 309 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:53:00.579202 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2c356-b85f-48b8-a0af-acdd22dd54aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:00.580234 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c64fa-7c9c-4877-94d4-730c8079f2cb admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:00.580554 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2c356-b85f-48b8-a0af-acdd22dd54aa admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:00.581092 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2c356-b85f-48b8-a0af-acdd22dd54aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:00.582555 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2c356-b85f-48b8-a0af-acdd22dd54aa admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:00.584743 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2c356-b85f-48b8-a0af-acdd22dd54aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:00.588208 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2c356-b85f-48b8-a0af-acdd22dd54aa admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:00.610035 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c64fa-7c9c-4877-94d4-730c8079f2cb admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:00.618056 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 809/1625] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:53:00.619500 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2c356-b85f-48b8-a0af-acdd22dd54aa admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:00.621763 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c116d26-a636-4d5e-bd96-7678cc64a9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:00.623070 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c116d26-a636-4d5e-bd96-7678cc64a9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:00.623892 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c116d26-a636-4d5e-bd96-7678cc64a9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:00.625378 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c116d26-a636-4d5e-bd96-7678cc64a9a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:00.626982 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c116d26-a636-4d5e-bd96-7678cc64a9a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:00.634880 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c116d26-a636-4d5e-bd96-7678cc64a9a7 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:00.642072 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2c356-b85f-48b8-a0af-acdd22dd54aa admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:00.656556 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117389f4-4203-44a1-9afa-525afd03efa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:00.659165 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117389f4-4203-44a1-9afa-525afd03efa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:00.661004 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117389f4-4203-44a1-9afa-525afd03efa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:00.661004 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117389f4-4203-44a1-9afa-525afd03efa6 admin admin] PATH_INFO: `/v3/projects/59c096c5dbef4988b4a065c6d7fafaf0/users/9add5462c3d4490592b37855b24bb646/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:00.694062 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 817/1626] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:53:00.695691 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c116d26-a636-4d5e-bd96-7678cc64a9a7 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:00.723027 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117389f4-4203-44a1-9afa-525afd03efa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c096c5dbef4988b4a065c6d7fafaf0, user_id=9add5462c3d4490592b37855b24bb646, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:00.728765 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c116d26-a636-4d5e-bd96-7678cc64a9a7 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:00.734614 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117389f4-4203-44a1-9afa-525afd03efa6 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:00.749063 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad27804-6cec-4151-819d-f2d6fb5972f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:00.751567 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad27804-6cec-4151-819d-f2d6fb5972f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:00.752121 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad27804-6cec-4151-819d-f2d6fb5972f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:00.752767 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad27804-6cec-4151-819d-f2d6fb5972f9 admin admin] PATH_INFO: `/v3/projects/bde1b7c11cbb488bb284f071f6410cc9/users/f4ad9f165af548cb931be3a7fa088052/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:00.777868 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 810/1627] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:53:00 2022] PUT /identity/v3/projects/59c096c5dbef4988b4a065c6d7fafaf0/users/9add5462c3d4490592b37855b24bb646/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:00.780127 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117389f4-4203-44a1-9afa-525afd03efa6 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:00.802075 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad27804-6cec-4151-819d-f2d6fb5972f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bde1b7c11cbb488bb284f071f6410cc9, user_id=f4ad9f165af548cb931be3a7fa088052, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:00.809472 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad27804-6cec-4151-819d-f2d6fb5972f9 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:00.843117 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 818/1628] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:53:00 2022] PUT /identity/v3/projects/bde1b7c11cbb488bb284f071f6410cc9/users/f4ad9f165af548cb931be3a7fa088052/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:00.849427 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad27804-6cec-4151-819d-f2d6fb5972f9 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:00.949255 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117389f4-4203-44a1-9afa-525afd03efa6 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:01.076546 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad27804-6cec-4151-819d-f2d6fb5972f9 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:01.090444 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd93eb9-fea5-40ba-aca1-cd5b3054fb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:01.091554 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd93eb9-fea5-40ba-aca1-cd5b3054fb85 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:01.092070 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd93eb9-fea5-40ba-aca1-cd5b3054fb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:01.092546 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd93eb9-fea5-40ba-aca1-cd5b3054fb85 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:01.093853 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd93eb9-fea5-40ba-aca1-cd5b3054fb85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:01.098667 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd93eb9-fea5-40ba-aca1-cd5b3054fb85 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:01.116204 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 819/1629] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:53:01.117188 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd93eb9-fea5-40ba-aca1-cd5b3054fb85 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:01.129550 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd93eb9-fea5-40ba-aca1-cd5b3054fb85 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:01.134893 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8daf7a-2a76-40b3-b6af-b7d220e58ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:01.135956 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8daf7a-2a76-40b3-b6af-b7d220e58ae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:01.136485 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8daf7a-2a76-40b3-b6af-b7d220e58ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:01.136779 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8daf7a-2a76-40b3-b6af-b7d220e58ae6 admin admin] PATH_INFO: `/v3/projects/bde1b7c11cbb488bb284f071f6410cc9/users/f4ad9f165af548cb931be3a7fa088052/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:01.139089 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8daf7a-2a76-40b3-b6af-b7d220e58ae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bde1b7c11cbb488bb284f071f6410cc9, user_id=f4ad9f165af548cb931be3a7fa088052, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:01.142500 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8daf7a-2a76-40b3-b6af-b7d220e58ae6 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:01.145939 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ea361-a360-48b5-9cf3-57a1da998477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:01.149457 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ea361-a360-48b5-9cf3-57a1da998477 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:01.151112 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ea361-a360-48b5-9cf3-57a1da998477 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:01.151570 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ea361-a360-48b5-9cf3-57a1da998477 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:01.155082 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ea361-a360-48b5-9cf3-57a1da998477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:01.158352 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ea361-a360-48b5-9cf3-57a1da998477 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:01.167455 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 820/1630] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:53:01 2022] PUT /identity/v3/projects/bde1b7c11cbb488bb284f071f6410cc9/users/f4ad9f165af548cb931be3a7fa088052/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:01.169106 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa67658-3dac-41bf-9cff-89f4f08f25c6 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:01.169396 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa67658-3dac-41bf-9cff-89f4f08f25c6 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:01.169672 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa67658-3dac-41bf-9cff-89f4f08f25c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:01.185687 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 811/1631] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:53:01.193459 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ea361-a360-48b5-9cf3-57a1da998477 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:01.207872 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-1aa67658-3dac-41bf-9cff-89f4f08f25c6 None None] MFA Rules not processed for user `f4ad9f165af548cb931be3a7fa088052`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:01.209136 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-1aa67658-3dac-41bf-9cff-89f4f08f25c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:01.219205 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ea361-a360-48b5-9cf3-57a1da998477 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:01.307000 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 821/1632] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:01 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:01.334365 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa67658-3dac-41bf-9cff-89f4f08f25c6 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:01.350857 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64dda69-77ed-4a8f-8139-0256a15fc662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:01.351922 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64dda69-77ed-4a8f-8139-0256a15fc662 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:01.352121 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64dda69-77ed-4a8f-8139-0256a15fc662 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:01.352396 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64dda69-77ed-4a8f-8139-0256a15fc662 admin admin] PATH_INFO: `/v3/projects/59c096c5dbef4988b4a065c6d7fafaf0/users/9add5462c3d4490592b37855b24bb646/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:01.354604 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64dda69-77ed-4a8f-8139-0256a15fc662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c096c5dbef4988b4a065c6d7fafaf0, user_id=9add5462c3d4490592b37855b24bb646, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:01.357914 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64dda69-77ed-4a8f-8139-0256a15fc662 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:01.373527 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 812/1633] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:53:01 2022] PUT /identity/v3/projects/59c096c5dbef4988b4a065c6d7fafaf0/users/9add5462c3d4490592b37855b24bb646/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:01.384411 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375b741-644c-430d-9ef6-9da84c6909f5 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:01.384747 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375b741-644c-430d-9ef6-9da84c6909f5 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:01.385020 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375b741-644c-430d-9ef6-9da84c6909f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:01.443330 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-9375b741-644c-430d-9ef6-9da84c6909f5 None None] MFA Rules not processed for user `9add5462c3d4490592b37855b24bb646`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:01.445555 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-9375b741-644c-430d-9ef6-9da84c6909f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:01.466828 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa67658-3dac-41bf-9cff-89f4f08f25c6 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:01.572579 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc23b2-eb8f-4ab2-8880-4a026a752d8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:01.573642 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc23b2-eb8f-4ab2-8880-4a026a752d8a service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:01.573935 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc23b2-eb8f-4ab2-8880-4a026a752d8a service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:01.574212 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc23b2-eb8f-4ab2-8880-4a026a752d8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:01.638446 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 813/1634] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:01 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:01.658173 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375b741-644c-430d-9ef6-9da84c6909f5 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:01.677365 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375b741-644c-430d-9ef6-9da84c6909f5 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:01.689314 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463be5fe-fc29-46be-aad0-faecd2c1e8c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:01.690016 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463be5fe-fc29-46be-aad0-faecd2c1e8c7 service cinder] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:01.690300 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463be5fe-fc29-46be-aad0-faecd2c1e8c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:01.690605 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463be5fe-fc29-46be-aad0-faecd2c1e8c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:01.716203 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463be5fe-fc29-46be-aad0-faecd2c1e8c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:01.717795 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463be5fe-fc29-46be-aad0-faecd2c1e8c7 service cinder] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:01.733149 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc23b2-eb8f-4ab2-8880-4a026a752d8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:01.735349 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc23b2-eb8f-4ab2-8880-4a026a752d8a service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:01.742014 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 814/1635] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:53:01 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:53:01.772217 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 822/1636] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:53:01 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:53:02.242023 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463be5fe-fc29-46be-aad0-faecd2c1e8c7 service cinder] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:02.408807 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463be5fe-fc29-46be-aad0-faecd2c1e8c7 service cinder] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:02.418795 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc68306-0266-4c46-8ba5-3a3703234308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:02.419916 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc68306-0266-4c46-8ba5-3a3703234308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:02.420679 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc68306-0266-4c46-8ba5-3a3703234308 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:02.421019 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc68306-0266-4c46-8ba5-3a3703234308 admin admin] PATH_INFO: `/v3/users/627058634a024c1a92c08b1744626267` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:02.423470 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc68306-0266-4c46-8ba5-3a3703234308 admin admin] RBAC: Authorizing `identity:delete_user(user_id=627058634a024c1a92c08b1744626267)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:02.429118 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc68306-0266-4c46-8ba5-3a3703234308 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:02.543613 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-edc68306-0266-4c46-8ba5-3a3703234308 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '627058634a024c1a92c08b1744626267'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:02.563275 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-edc68306-0266-4c46-8ba5-3a3703234308 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '627058634a024c1a92c08b1744626267'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:02.566401 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-edc68306-0266-4c46-8ba5-3a3703234308 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '627058634a024c1a92c08b1744626267'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:02.587397 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-edc68306-0266-4c46-8ba5-3a3703234308 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '627058634a024c1a92c08b1744626267'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:02.588170 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-edc68306-0266-4c46-8ba5-3a3703234308 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '627058634a024c1a92c08b1744626267'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:02.612030 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 815/1637] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:53:02 2022] DELETE /identity/v3/users/627058634a024c1a92c08b1744626267 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:02.616223 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b021e-9fe3-4fb3-b3f8-89764d8a2a86 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:02.616764 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b021e-9fe3-4fb3-b3f8-89764d8a2a86 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:02.617554 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b021e-9fe3-4fb3-b3f8-89764d8a2a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:02.650333 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc68306-0266-4c46-8ba5-3a3703234308 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:02.653255 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-edc68306-0266-4c46-8ba5-3a3703234308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:02.681861 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-676b021e-9fe3-4fb3-b3f8-89764d8a2a86 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:02.684537 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-676b021e-9fe3-4fb3-b3f8-89764d8a2a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:02.825609 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc68306-0266-4c46-8ba5-3a3703234308 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:02.834407 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3938e-7a0f-4a65-8eab-bc68d0619ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:02.836000 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3938e-7a0f-4a65-8eab-bc68d0619ea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:02.837115 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3938e-7a0f-4a65-8eab-bc68d0619ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:02.837460 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3938e-7a0f-4a65-8eab-bc68d0619ea7 admin admin] PATH_INFO: `/v3/users/150d90c8e5ea41eca2c5b80085e4ec09` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:02.840269 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3938e-7a0f-4a65-8eab-bc68d0619ea7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=150d90c8e5ea41eca2c5b80085e4ec09)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:02.841996 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3938e-7a0f-4a65-8eab-bc68d0619ea7 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:02.864889 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 823/1638] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:02.909137 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b021e-9fe3-4fb3-b3f8-89764d8a2a86 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:02.912003 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-676b021e-9fe3-4fb3-b3f8-89764d8a2a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:02.987059 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-4ab3938e-7a0f-4a65-8eab-bc68d0619ea7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '150d90c8e5ea41eca2c5b80085e4ec09'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:03.012389 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-4ab3938e-7a0f-4a65-8eab-bc68d0619ea7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '150d90c8e5ea41eca2c5b80085e4ec09'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:03.017864 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-4ab3938e-7a0f-4a65-8eab-bc68d0619ea7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '150d90c8e5ea41eca2c5b80085e4ec09'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:03.061503 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-4ab3938e-7a0f-4a65-8eab-bc68d0619ea7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '150d90c8e5ea41eca2c5b80085e4ec09'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:03.062550 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-4ab3938e-7a0f-4a65-8eab-bc68d0619ea7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '150d90c8e5ea41eca2c5b80085e4ec09'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:03.082380 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b021e-9fe3-4fb3-b3f8-89764d8a2a86 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:03.089014 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c618d-2a1a-4e8c-99b1-9bd570cafd0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:03.089841 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c618d-2a1a-4e8c-99b1-9bd570cafd0b service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:03.090329 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c618d-2a1a-4e8c-99b1-9bd570cafd0b service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:03.090631 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c618d-2a1a-4e8c-99b1-9bd570cafd0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:03.091191 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 816/1639] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:53:02 2022] DELETE /identity/v3/users/150d90c8e5ea41eca2c5b80085e4ec09 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:53:03.095049 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-5c4c618d-2a1a-4e8c-99b1-9bd570cafd0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:03.095951 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436ea67-6767-4f63-b69b-1ccb7c5fa03e None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:03.096346 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436ea67-6767-4f63-b69b-1ccb7c5fa03e None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:03.096732 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436ea67-6767-4f63-b69b-1ccb7c5fa03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:03.135788 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c618d-2a1a-4e8c-99b1-9bd570cafd0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:03.140374 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c618d-2a1a-4e8c-99b1-9bd570cafd0b service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:03.163422 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-d436ea67-6767-4f63-b69b-1ccb7c5fa03e None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:03.167604 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-d436ea67-6767-4f63-b69b-1ccb7c5fa03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:03.178653 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 824/1640] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:53:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:53:03.271817 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 817/1641] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:03.319189 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c618d-2a1a-4e8c-99b1-9bd570cafd0b service neutron] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:03.320705 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-5c4c618d-2a1a-4e8c-99b1-9bd570cafd0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:03.339986 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c618d-2a1a-4e8c-99b1-9bd570cafd0b service neutron] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:03.392486 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e03cc-7390-4e3b-b006-6bcd7b5f0fcd None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:03.392681 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e03cc-7390-4e3b-b006-6bcd7b5f0fcd None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:03.392954 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e03cc-7390-4e3b-b006-6bcd7b5f0fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:03.415274 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b11ed3-b2d7-49cb-aa5f-76310747e5d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:03.416593 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b11ed3-b2d7-49cb-aa5f-76310747e5d1 service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:03.417046 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b11ed3-b2d7-49cb-aa5f-76310747e5d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:03.419066 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b11ed3-b2d7-49cb-aa5f-76310747e5d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:03.433604 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b11ed3-b2d7-49cb-aa5f-76310747e5d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:03.435412 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b11ed3-b2d7-49cb-aa5f-76310747e5d1 service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:03.451287 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 825/1642] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:53:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:53:03.452342 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-ba6e03cc-7390-4e3b-b006-6bcd7b5f0fcd None None] MFA Rules not processed for user `d20d4d82516c4cdaad51140a4abf88f2`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:03.453616 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-ba6e03cc-7390-4e3b-b006-6bcd7b5f0fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:03.528716 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 818/1643] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:03 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:53:03.533053 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b11ed3-b2d7-49cb-aa5f-76310747e5d1 service neutron] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:03.537343 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-77b11ed3-b2d7-49cb-aa5f-76310747e5d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:03.567151 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b11ed3-b2d7-49cb-aa5f-76310747e5d1 service neutron] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:03.578838 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368f16a-b6db-4d75-8379-77f07fe6f7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:03.580436 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368f16a-b6db-4d75-8379-77f07fe6f7d2 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:03.581378 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368f16a-b6db-4d75-8379-77f07fe6f7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:03.582345 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368f16a-b6db-4d75-8379-77f07fe6f7d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:03.585973 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368f16a-b6db-4d75-8379-77f07fe6f7d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:03.592549 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368f16a-b6db-4d75-8379-77f07fe6f7d2 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:03.666914 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 826/1644] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:53:03 2022] POST /identity/v3/projects => generated 405 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:53:03.672282 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e03cc-7390-4e3b-b006-6bcd7b5f0fcd None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:03.688870 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e03cc-7390-4e3b-b006-6bcd7b5f0fcd None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:03.778946 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff94c2d-56fd-4180-8b33-0c48e4838e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:03.780567 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff94c2d-56fd-4180-8b33-0c48e4838e7d admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:03.781149 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff94c2d-56fd-4180-8b33-0c48e4838e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:03.781794 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff94c2d-56fd-4180-8b33-0c48e4838e7d admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:03.782778 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff94c2d-56fd-4180-8b33-0c48e4838e7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:03.785844 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff94c2d-56fd-4180-8b33-0c48e4838e7d admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:03.811707 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 819/1645] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:53:03 2022] POST /identity/v3/users => generated 309 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:53:03.816649 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368f16a-b6db-4d75-8379-77f07fe6f7d2 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:03.832196 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368f16a-b6db-4d75-8379-77f07fe6f7d2 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:03.839315 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f1013-8804-4501-b151-e7d2c5d0dea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:03.840602 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f1013-8804-4501-b151-e7d2c5d0dea1 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:03.841096 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f1013-8804-4501-b151-e7d2c5d0dea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:03.841587 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f1013-8804-4501-b151-e7d2c5d0dea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:03.843160 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f1013-8804-4501-b151-e7d2c5d0dea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:03.845434 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f1013-8804-4501-b151-e7d2c5d0dea1 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:03.861524 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 827/1646] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:53:03.866789 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff94c2d-56fd-4180-8b33-0c48e4838e7d admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:03.881415 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff94c2d-56fd-4180-8b33-0c48e4838e7d admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:03.887665 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1246c-2463-4132-aeaa-26e4b98710b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:03.888654 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1246c-2463-4132-aeaa-26e4b98710b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:03.888938 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1246c-2463-4132-aeaa-26e4b98710b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:03.889345 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1246c-2463-4132-aeaa-26e4b98710b8 admin admin] PATH_INFO: `/v3/projects/06a40991fcad4e018c09a7d43406d71e/users/f2475ef9c236483bb4470199ff24f82a/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:03.913016 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf1246c-2463-4132-aeaa-26e4b98710b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06a40991fcad4e018c09a7d43406d71e, user_id=f2475ef9c236483bb4470199ff24f82a, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:03.916235 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf1246c-2463-4132-aeaa-26e4b98710b8 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:03.940604 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 820/1647] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:53:03 2022] PUT /identity/v3/projects/06a40991fcad4e018c09a7d43406d71e/users/f2475ef9c236483bb4470199ff24f82a/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:03.943332 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f1013-8804-4501-b151-e7d2c5d0dea1 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:03.958503 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f1013-8804-4501-b151-e7d2c5d0dea1 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:04.042037 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896479e-e87d-449f-a5aa-6260520c248a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:04.042957 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896479e-e87d-449f-a5aa-6260520c248a admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:04.043247 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896479e-e87d-449f-a5aa-6260520c248a admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:04.043577 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896479e-e87d-449f-a5aa-6260520c248a admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:04.044410 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896479e-e87d-449f-a5aa-6260520c248a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:04.046444 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896479e-e87d-449f-a5aa-6260520c248a admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:04.066360 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 828/1648] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:53:04.068232 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1246c-2463-4132-aeaa-26e4b98710b8 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:04.089982 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1246c-2463-4132-aeaa-26e4b98710b8 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:04.099499 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70b45d-09ed-496a-a0df-021fb80540a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:04.100694 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70b45d-09ed-496a-a0df-021fb80540a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:04.101467 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70b45d-09ed-496a-a0df-021fb80540a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:04.102088 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70b45d-09ed-496a-a0df-021fb80540a7 admin admin] PATH_INFO: `/v3/projects/06a40991fcad4e018c09a7d43406d71e/users/f2475ef9c236483bb4470199ff24f82a/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:04.105555 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70b45d-09ed-496a-a0df-021fb80540a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06a40991fcad4e018c09a7d43406d71e, user_id=f2475ef9c236483bb4470199ff24f82a, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:04.109156 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70b45d-09ed-496a-a0df-021fb80540a7 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:04.134595 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 821/1649] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:53:04 2022] PUT /identity/v3/projects/06a40991fcad4e018c09a7d43406d71e/users/f2475ef9c236483bb4470199ff24f82a/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:53:04.933146 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896479e-e87d-449f-a5aa-6260520c248a admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:04.935092 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-a896479e-e87d-449f-a5aa-6260520c248a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:04.966597 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896479e-e87d-449f-a5aa-6260520c248a admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:04.968453 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70b45d-09ed-496a-a0df-021fb80540a7 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:04.971682 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-5d70b45d-09ed-496a-a0df-021fb80540a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:05.075433 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70b45d-09ed-496a-a0df-021fb80540a7 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:05.082337 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45320dcc-8c98-4376-9a04-f677c784cd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:05.083422 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45320dcc-8c98-4376-9a04-f677c784cd69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:05.083710 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45320dcc-8c98-4376-9a04-f677c784cd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:05.084174 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45320dcc-8c98-4376-9a04-f677c784cd69 admin admin] PATH_INFO: `/v3/projects/ce28cbe8493949d6bba61fde5753536f` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:05.087254 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45320dcc-8c98-4376-9a04-f677c784cd69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce28cbe8493949d6bba61fde5753536f)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:05.087254 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: WARNING py.warnings [None req-45320dcc-8c98-4376-9a04-f677c784cd69 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 20:53:05.087254 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: warnings.warn(msg) Oct 28 20:53:05.087254 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: Oct 28 20:53:05.089944 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45320dcc-8c98-4376-9a04-f677c784cd69 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:05.158136 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0469f40-b029-4a9e-adeb-ed7395e7bd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:05.160855 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0469f40-b029-4a9e-adeb-ed7395e7bd71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:05.161678 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0469f40-b029-4a9e-adeb-ed7395e7bd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:05.162436 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0469f40-b029-4a9e-adeb-ed7395e7bd71 admin admin] PATH_INFO: `/v3/projects/634dffc393384b14abedbd8c3e05a238` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:05.165491 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0469f40-b029-4a9e-adeb-ed7395e7bd71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=634dffc393384b14abedbd8c3e05a238)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:05.169982 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0469f40-b029-4a9e-adeb-ed7395e7bd71 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:05.266501 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-45320dcc-8c98-4376-9a04-f677c784cd69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce28cbe8493949d6bba61fde5753536f', 'request_id': 'req-45320dcc-8c98-4376-9a04-f677c784cd69'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:05.291141 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-45320dcc-8c98-4376-9a04-f677c784cd69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce28cbe8493949d6bba61fde5753536f', 'request_id': 'req-45320dcc-8c98-4376-9a04-f677c784cd69'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:05.309225 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-d0469f40-b029-4a9e-adeb-ed7395e7bd71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '634dffc393384b14abedbd8c3e05a238', 'request_id': 'req-d0469f40-b029-4a9e-adeb-ed7395e7bd71'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:05.325190 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-d0469f40-b029-4a9e-adeb-ed7395e7bd71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '634dffc393384b14abedbd8c3e05a238', 'request_id': 'req-d0469f40-b029-4a9e-adeb-ed7395e7bd71'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:05.338197 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-45320dcc-8c98-4376-9a04-f677c784cd69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce28cbe8493949d6bba61fde5753536f', 'request_id': 'req-45320dcc-8c98-4376-9a04-f677c784cd69'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:05.344467 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-d0469f40-b029-4a9e-adeb-ed7395e7bd71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '634dffc393384b14abedbd8c3e05a238', 'request_id': 'req-d0469f40-b029-4a9e-adeb-ed7395e7bd71'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:05.402078 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-45320dcc-8c98-4376-9a04-f677c784cd69 admin admin] The token cache is being invalidate because project ce28cbe8493949d6bba61fde5753536f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:53:05.404419 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-45320dcc-8c98-4376-9a04-f677c784cd69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:05.407814 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-d0469f40-b029-4a9e-adeb-ed7395e7bd71 admin admin] The token cache is being invalidate because project 634dffc393384b14abedbd8c3e05a238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:53:05.411353 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-d0469f40-b029-4a9e-adeb-ed7395e7bd71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:05.416586 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-45320dcc-8c98-4376-9a04-f677c784cd69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:05.424009 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 822/1650] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:53:04 2022] DELETE /identity/v3/projects/ce28cbe8493949d6bba61fde5753536f => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:53:05.424302 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-d0469f40-b029-4a9e-adeb-ed7395e7bd71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:05.427352 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45320dcc-8c98-4376-9a04-f677c784cd69 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:05.429308 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 829/1651] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:53:04 2022] DELETE /identity/v3/projects/634dffc393384b14abedbd8c3e05a238 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:53:05.430717 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-45320dcc-8c98-4376-9a04-f677c784cd69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:05.433929 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0469f40-b029-4a9e-adeb-ed7395e7bd71 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:05.439450 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-d0469f40-b029-4a9e-adeb-ed7395e7bd71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:05.718653 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0469f40-b029-4a9e-adeb-ed7395e7bd71 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:05.727760 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45320dcc-8c98-4376-9a04-f677c784cd69 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:05.736743 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827da1f-ea40-4a5e-b011-c7bd815270bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:05.738220 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827da1f-ea40-4a5e-b011-c7bd815270bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:05.738698 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827da1f-ea40-4a5e-b011-c7bd815270bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:05.739307 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827da1f-ea40-4a5e-b011-c7bd815270bf admin admin] PATH_INFO: `/v3/users/f4ad9f165af548cb931be3a7fa088052` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:05.743455 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827da1f-ea40-4a5e-b011-c7bd815270bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4ad9f165af548cb931be3a7fa088052)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:05.744718 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64dd4c-2a0b-40da-9b8e-af89f7f22cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:05.747617 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64dd4c-2a0b-40da-9b8e-af89f7f22cff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:05.748127 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827da1f-ea40-4a5e-b011-c7bd815270bf admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:05.750808 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64dd4c-2a0b-40da-9b8e-af89f7f22cff admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:05.752809 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64dd4c-2a0b-40da-9b8e-af89f7f22cff admin admin] PATH_INFO: `/v3/users/9add5462c3d4490592b37855b24bb646` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:05.761288 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64dd4c-2a0b-40da-9b8e-af89f7f22cff admin admin] RBAC: Authorizing `identity:delete_user(user_id=9add5462c3d4490592b37855b24bb646)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:05.768486 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: WARNING py.warnings [None req-ec64dd4c-2a0b-40da-9b8e-af89f7f22cff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 20:53:05.768486 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: warnings.warn(msg) Oct 28 20:53:05.768486 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: Oct 28 20:53:05.774511 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64dd4c-2a0b-40da-9b8e-af89f7f22cff admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:05.865661 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-9827da1f-ea40-4a5e-b011-c7bd815270bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4ad9f165af548cb931be3a7fa088052'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:05.875792 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-9827da1f-ea40-4a5e-b011-c7bd815270bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4ad9f165af548cb931be3a7fa088052'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:05.876945 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-9827da1f-ea40-4a5e-b011-c7bd815270bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4ad9f165af548cb931be3a7fa088052'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:05.902246 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-9827da1f-ea40-4a5e-b011-c7bd815270bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4ad9f165af548cb931be3a7fa088052'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:05.905800 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-9827da1f-ea40-4a5e-b011-c7bd815270bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4ad9f165af548cb931be3a7fa088052'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:05.938126 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 823/1652] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:53:05 2022] DELETE /identity/v3/users/f4ad9f165af548cb931be3a7fa088052 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:06.009187 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ec64dd4c-2a0b-40da-9b8e-af89f7f22cff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9add5462c3d4490592b37855b24bb646'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:06.074342 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ec64dd4c-2a0b-40da-9b8e-af89f7f22cff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9add5462c3d4490592b37855b24bb646'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:06.105890 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ec64dd4c-2a0b-40da-9b8e-af89f7f22cff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9add5462c3d4490592b37855b24bb646'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:06.109246 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ec64dd4c-2a0b-40da-9b8e-af89f7f22cff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9add5462c3d4490592b37855b24bb646'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:06.207391 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ec64dd4c-2a0b-40da-9b8e-af89f7f22cff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9add5462c3d4490592b37855b24bb646'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:06.227136 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 830/1653] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:53:05 2022] DELETE /identity/v3/users/9add5462c3d4490592b37855b24bb646 => generated 0 bytes in 794 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:53:08.575867 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827da1f-ea40-4a5e-b011-c7bd815270bf admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:08.577749 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-9827da1f-ea40-4a5e-b011-c7bd815270bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:08.770334 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827da1f-ea40-4a5e-b011-c7bd815270bf admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:08.880493 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64dd4c-2a0b-40da-9b8e-af89f7f22cff admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:08.882969 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-ec64dd4c-2a0b-40da-9b8e-af89f7f22cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:08.945525 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19779095-076a-400e-8aca-1378f8bb0505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:08.946449 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19779095-076a-400e-8aca-1378f8bb0505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:08.946760 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19779095-076a-400e-8aca-1378f8bb0505 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:08.947024 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19779095-076a-400e-8aca-1378f8bb0505 admin admin] PATH_INFO: `/v3/projects/bde1b7c11cbb488bb284f071f6410cc9` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:08.953615 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19779095-076a-400e-8aca-1378f8bb0505 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bde1b7c11cbb488bb284f071f6410cc9)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:08.955630 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19779095-076a-400e-8aca-1378f8bb0505 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:09.143544 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-19779095-076a-400e-8aca-1378f8bb0505 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bde1b7c11cbb488bb284f071f6410cc9', 'request_id': 'req-19779095-076a-400e-8aca-1378f8bb0505'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:09.170088 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-19779095-076a-400e-8aca-1378f8bb0505 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bde1b7c11cbb488bb284f071f6410cc9', 'request_id': 'req-19779095-076a-400e-8aca-1378f8bb0505'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:09.170555 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64dd4c-2a0b-40da-9b8e-af89f7f22cff admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:09.180634 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-19779095-076a-400e-8aca-1378f8bb0505 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bde1b7c11cbb488bb284f071f6410cc9', 'request_id': 'req-19779095-076a-400e-8aca-1378f8bb0505'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:09.208804 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-19779095-076a-400e-8aca-1378f8bb0505 admin admin] The token cache is being invalidate because project bde1b7c11cbb488bb284f071f6410cc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:53:09.213397 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-19779095-076a-400e-8aca-1378f8bb0505 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:09.214575 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-19779095-076a-400e-8aca-1378f8bb0505 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:09.217748 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 824/1654] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:53:08 2022] DELETE /identity/v3/projects/bde1b7c11cbb488bb284f071f6410cc9 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:09.223577 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d611d3-e560-492b-ac4c-0e5cbf899997 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:09.228141 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d611d3-e560-492b-ac4c-0e5cbf899997 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:09.228810 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d611d3-e560-492b-ac4c-0e5cbf899997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:09.304648 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-80d611d3-e560-492b-ac4c-0e5cbf899997 None None] MFA Rules not processed for user `f2475ef9c236483bb4470199ff24f82a`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:09.306250 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-80d611d3-e560-492b-ac4c-0e5cbf899997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:09.335908 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855430f-de0b-400e-8204-afbd1e5176ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:09.337920 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855430f-de0b-400e-8204-afbd1e5176ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:09.338837 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855430f-de0b-400e-8204-afbd1e5176ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:09.339293 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855430f-de0b-400e-8204-afbd1e5176ad admin admin] PATH_INFO: `/v3/projects/59c096c5dbef4988b4a065c6d7fafaf0` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:09.341394 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855430f-de0b-400e-8204-afbd1e5176ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=59c096c5dbef4988b4a065c6d7fafaf0)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:09.344302 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855430f-de0b-400e-8204-afbd1e5176ad admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:09.483910 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-6855430f-de0b-400e-8204-afbd1e5176ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59c096c5dbef4988b4a065c6d7fafaf0', 'request_id': 'req-6855430f-de0b-400e-8204-afbd1e5176ad'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:09.498712 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 825/1655] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:09 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:09.509204 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f48a1-96bb-4f29-9e94-23a577084c31 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:09.509594 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f48a1-96bb-4f29-9e94-23a577084c31 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:09.509845 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f48a1-96bb-4f29-9e94-23a577084c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:09.517592 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-6855430f-de0b-400e-8204-afbd1e5176ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59c096c5dbef4988b4a065c6d7fafaf0', 'request_id': 'req-6855430f-de0b-400e-8204-afbd1e5176ad'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:09.553437 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-6855430f-de0b-400e-8204-afbd1e5176ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59c096c5dbef4988b4a065c6d7fafaf0', 'request_id': 'req-6855430f-de0b-400e-8204-afbd1e5176ad'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:09.562228 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-a74f48a1-96bb-4f29-9e94-23a577084c31 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:09.563693 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-a74f48a1-96bb-4f29-9e94-23a577084c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:09.626103 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-6855430f-de0b-400e-8204-afbd1e5176ad admin admin] The token cache is being invalidate because project 59c096c5dbef4988b4a065c6d7fafaf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:53:09.626590 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-6855430f-de0b-400e-8204-afbd1e5176ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:09.631834 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-6855430f-de0b-400e-8204-afbd1e5176ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:09.645164 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 831/1656] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:53:08 2022] DELETE /identity/v3/projects/59c096c5dbef4988b4a065c6d7fafaf0 => generated 0 bytes in 765 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:09.653925 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd594f2-eb3a-4dbe-9c51-822ec0e48d16 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:09.655495 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd594f2-eb3a-4dbe-9c51-822ec0e48d16 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:09.656123 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd594f2-eb3a-4dbe-9c51-822ec0e48d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:09.721373 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-3fd594f2-eb3a-4dbe-9c51-822ec0e48d16 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:09.723237 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-3fd594f2-eb3a-4dbe-9c51-822ec0e48d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:09.763946 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 826/1657] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:09.777238 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540e335-e976-4441-9d2b-3bdb02314d52 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:09.777662 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540e335-e976-4441-9d2b-3bdb02314d52 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:09.777946 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540e335-e976-4441-9d2b-3bdb02314d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:09.841221 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-e540e335-e976-4441-9d2b-3bdb02314d52 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:09.847112 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-e540e335-e976-4441-9d2b-3bdb02314d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:09.890637 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 827/1658] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:09.893264 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540e335-e976-4441-9d2b-3bdb02314d52 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:09.959263 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540e335-e976-4441-9d2b-3bdb02314d52 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:09.968569 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17bc957-ecb5-451e-b8b4-8ad041a9d487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:09.979358 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17bc957-ecb5-451e-b8b4-8ad041a9d487 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:09.981009 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17bc957-ecb5-451e-b8b4-8ad041a9d487 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:09.981383 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17bc957-ecb5-451e-b8b4-8ad041a9d487 admin admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:09.983148 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17bc957-ecb5-451e-b8b4-8ad041a9d487 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:53:09.984258 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17bc957-ecb5-451e-b8b4-8ad041a9d487 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:09.988596 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17bc957-ecb5-451e-b8b4-8ad041a9d487 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:09.995300 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 832/1659] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:10.006125 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbcb5a-4c26-496a-8999-e575e678e76e None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:10.006461 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbcb5a-4c26-496a-8999-e575e678e76e None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:10.006780 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbcb5a-4c26-496a-8999-e575e678e76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:10.032552 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 828/1660] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:53:10.035274 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17bc957-ecb5-451e-b8b4-8ad041a9d487 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:10.062256 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-6cfbcb5a-4c26-496a-8999-e575e678e76e None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:10.063436 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17bc957-ecb5-451e-b8b4-8ad041a9d487 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:10.067897 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-6cfbcb5a-4c26-496a-8999-e575e678e76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:10.078802 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad0334-fae4-40fe-b4f8-f33e27f2ed79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:10.079497 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad0334-fae4-40fe-b4f8-f33e27f2ed79 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:10.080601 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad0334-fae4-40fe-b4f8-f33e27f2ed79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:10.080914 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad0334-fae4-40fe-b4f8-f33e27f2ed79 admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:10.085040 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ad0334-fae4-40fe-b4f8-f33e27f2ed79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:10.095072 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ad0334-fae4-40fe-b4f8-f33e27f2ed79 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:10.106787 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 833/1661] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:10.111132 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfbcb5a-4c26-496a-8999-e575e678e76e None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:10.137546 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfbcb5a-4c26-496a-8999-e575e678e76e None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:10.154422 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dada30d-0c87-49ba-a16c-1656d4b9dbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:10.155366 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dada30d-0c87-49ba-a16c-1656d4b9dbec admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:10.155810 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dada30d-0c87-49ba-a16c-1656d4b9dbec admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:10.156196 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dada30d-0c87-49ba-a16c-1656d4b9dbec admin admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:10.158715 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dada30d-0c87-49ba-a16c-1656d4b9dbec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:53:10.158715 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dada30d-0c87-49ba-a16c-1656d4b9dbec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:10.168186 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dada30d-0c87-49ba-a16c-1656d4b9dbec admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:10.181575 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 829/1662] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:53:10 2022] POST /identity/v3/projects => generated 387 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:53:10.187189 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad0334-fae4-40fe-b4f8-f33e27f2ed79 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:10.195901 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 834/1663] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:53:10.204126 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dada30d-0c87-49ba-a16c-1656d4b9dbec admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:10.240714 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dada30d-0c87-49ba-a16c-1656d4b9dbec admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:10.369160 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad0334-fae4-40fe-b4f8-f33e27f2ed79 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:10.378743 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051e82d-9106-4661-95f9-4548cc6f602a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:10.380036 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051e82d-9106-4661-95f9-4548cc6f602a admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:10.380476 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051e82d-9106-4661-95f9-4548cc6f602a admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:10.380890 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051e82d-9106-4661-95f9-4548cc6f602a admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:10.381932 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051e82d-9106-4661-95f9-4548cc6f602a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:10.384826 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051e82d-9106-4661-95f9-4548cc6f602a admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:10.428087 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 830/1664] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:53:10 2022] POST /identity/v3/users => generated 294 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:53:10.434926 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051e82d-9106-4661-95f9-4548cc6f602a admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:10.459883 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051e82d-9106-4661-95f9-4548cc6f602a admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:10.471000 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b8d8c-f638-4d9f-b501-694551328a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:10.472636 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b8d8c-f638-4d9f-b501-694551328a9f admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:10.473104 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b8d8c-f638-4d9f-b501-694551328a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:10.474067 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b8d8c-f638-4d9f-b501-694551328a9f admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:10.475206 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad593c-62b3-4c1c-a742-be52833da7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:10.476352 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052b8d8c-f638-4d9f-b501-694551328a9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:10.477995 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad593c-62b3-4c1c-a742-be52833da7cf admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:10.478921 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad593c-62b3-4c1c-a742-be52833da7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:10.479465 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad593c-62b3-4c1c-a742-be52833da7cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:10.482270 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052b8d8c-f638-4d9f-b501-694551328a9f admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:10.482547 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad593c-62b3-4c1c-a742-be52833da7cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:10.489919 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad593c-62b3-4c1c-a742-be52833da7cf admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:10.527523 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 831/1665] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:53:10.533437 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad593c-62b3-4c1c-a742-be52833da7cf admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:10.588773 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 835/1666] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:53:10 2022] POST /identity/v3/projects => generated 367 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:53:10.592258 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad593c-62b3-4c1c-a742-be52833da7cf admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:10.594828 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b8d8c-f638-4d9f-b501-694551328a9f admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:10.765269 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0adeed6-863e-41fa-acf8-ef527a4558ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:10.766248 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adeed6-863e-41fa-acf8-ef527a4558ac admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:10.766844 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adeed6-863e-41fa-acf8-ef527a4558ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:10.768232 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adeed6-863e-41fa-acf8-ef527a4558ac admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:10.770013 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0adeed6-863e-41fa-acf8-ef527a4558ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:10.773744 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b8d8c-f638-4d9f-b501-694551328a9f admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:10.776401 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0adeed6-863e-41fa-acf8-ef527a4558ac admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:10.789320 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536ca87-f1e8-4a40-84d4-73465df52806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:10.790216 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536ca87-f1e8-4a40-84d4-73465df52806 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:10.790609 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536ca87-f1e8-4a40-84d4-73465df52806 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:10.790992 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536ca87-f1e8-4a40-84d4-73465df52806 admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:10.791848 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536ca87-f1e8-4a40-84d4-73465df52806 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:10.802188 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536ca87-f1e8-4a40-84d4-73465df52806 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:10.810480 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 832/1667] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:53:10.814568 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0adeed6-863e-41fa-acf8-ef527a4558ac admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:10.833100 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0adeed6-863e-41fa-acf8-ef527a4558ac admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:10.847721 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5681624-74a0-48ab-8a1a-19095f2a820a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:10.848567 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5681624-74a0-48ab-8a1a-19095f2a820a admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:10.848821 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5681624-74a0-48ab-8a1a-19095f2a820a admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:10.849099 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5681624-74a0-48ab-8a1a-19095f2a820a admin admin] PATH_INFO: `/v3/projects/3ac6d4b78e0e4cdcb6ffb03a92d4c6bd/users/ef5e921de88e476aa4f4ba57354efaa6/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:10.853080 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 836/1668] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:53:10 2022] POST /identity/v3/users => generated 284 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:53:10.860756 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536ca87-f1e8-4a40-84d4-73465df52806 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:10.882636 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536ca87-f1e8-4a40-84d4-73465df52806 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:10.892920 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5681624-74a0-48ab-8a1a-19095f2a820a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ac6d4b78e0e4cdcb6ffb03a92d4c6bd, user_id=ef5e921de88e476aa4f4ba57354efaa6, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:10.896205 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5681624-74a0-48ab-8a1a-19095f2a820a admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:10.904015 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1117b86-9b53-47db-a7e5-a5314726edfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:10.906178 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1117b86-9b53-47db-a7e5-a5314726edfc admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:10.907216 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1117b86-9b53-47db-a7e5-a5314726edfc admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:10.910368 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1117b86-9b53-47db-a7e5-a5314726edfc admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:10.912713 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1117b86-9b53-47db-a7e5-a5314726edfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:10.917663 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1117b86-9b53-47db-a7e5-a5314726edfc admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:10.919687 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 833/1669] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:53:10 2022] PUT /identity/v3/projects/3ac6d4b78e0e4cdcb6ffb03a92d4c6bd/users/ef5e921de88e476aa4f4ba57354efaa6/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:53:10.945131 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db1fff-8b5a-4986-b2c6-1430654c9579 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:10.945524 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db1fff-8b5a-4986-b2c6-1430654c9579 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:10.945743 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db1fff-8b5a-4986-b2c6-1430654c9579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:10.950018 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 837/1670] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:53:10.956652 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1117b86-9b53-47db-a7e5-a5314726edfc admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:10.984061 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1117b86-9b53-47db-a7e5-a5314726edfc admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:11.000176 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-f2db1fff-8b5a-4986-b2c6-1430654c9579 None None] MFA Rules not processed for user `ef5e921de88e476aa4f4ba57354efaa6`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:11.009967 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-f2db1fff-8b5a-4986-b2c6-1430654c9579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:11.129511 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fc78b-5720-4385-b70f-29c6a34f351f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:11.130334 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fc78b-5720-4385-b70f-29c6a34f351f admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:11.130872 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fc78b-5720-4385-b70f-29c6a34f351f admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:11.130872 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fc78b-5720-4385-b70f-29c6a34f351f admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:11.131534 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788fc78b-5720-4385-b70f-29c6a34f351f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:11.133287 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788fc78b-5720-4385-b70f-29c6a34f351f admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:11.159037 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 838/1671] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:53:11.165233 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 834/1672] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:53:11.165621 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fc78b-5720-4385-b70f-29c6a34f351f admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:11.171314 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db1fff-8b5a-4986-b2c6-1430654c9579 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:11.186627 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fc78b-5720-4385-b70f-29c6a34f351f admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:11.192488 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db1fff-8b5a-4986-b2c6-1430654c9579 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:11.201404 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6c7ca-6c03-4202-99e2-81d8f3fb9875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:11.202325 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6c7ca-6c03-4202-99e2-81d8f3fb9875 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:11.202606 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6c7ca-6c03-4202-99e2-81d8f3fb9875 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:11.202879 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6c7ca-6c03-4202-99e2-81d8f3fb9875 admin admin] PATH_INFO: `/v3/projects/0bf07957f7a241aa8f5c93a242b4e346/users/7e44e227db3a4659933417df4e135c7f/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:11.209974 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c405d-5454-4787-9593-5cb752a36410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:11.210668 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c405d-5454-4787-9593-5cb752a36410 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:11.211730 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c405d-5454-4787-9593-5cb752a36410 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:11.212074 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c405d-5454-4787-9593-5cb752a36410 admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:11.213618 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c405d-5454-4787-9593-5cb752a36410 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:11.214843 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c405d-5454-4787-9593-5cb752a36410 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:11.240166 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6c7ca-6c03-4202-99e2-81d8f3fb9875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bf07957f7a241aa8f5c93a242b4e346, user_id=7e44e227db3a4659933417df4e135c7f, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:11.242676 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6c7ca-6c03-4202-99e2-81d8f3fb9875 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:11.279032 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 835/1673] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:53:11 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:53:11.280480 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 839/1674] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:53:11 2022] PUT /identity/v3/projects/0bf07957f7a241aa8f5c93a242b4e346/users/7e44e227db3a4659933417df4e135c7f/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:11.306223 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c405d-5454-4787-9593-5cb752a36410 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:11.317608 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1709cc5-d054-4b81-8d6d-0abafaeac26a None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:11.318131 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1709cc5-d054-4b81-8d6d-0abafaeac26a None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:11.318775 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1709cc5-d054-4b81-8d6d-0abafaeac26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:11.396938 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-a1709cc5-d054-4b81-8d6d-0abafaeac26a None None] MFA Rules not processed for user `7e44e227db3a4659933417df4e135c7f`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:11.399616 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-a1709cc5-d054-4b81-8d6d-0abafaeac26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:11.482532 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c405d-5454-4787-9593-5cb752a36410 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:11.489998 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd31d4-5ed7-49fc-a5b7-702ae8b55fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:11.489998 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd31d4-5ed7-49fc-a5b7-702ae8b55fb8 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:11.495097 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd31d4-5ed7-49fc-a5b7-702ae8b55fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:11.495424 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd31d4-5ed7-49fc-a5b7-702ae8b55fb8 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:11.496236 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd31d4-5ed7-49fc-a5b7-702ae8b55fb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:11.502581 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd31d4-5ed7-49fc-a5b7-702ae8b55fb8 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:11.552162 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 836/1675] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:53:11 2022] POST /identity/v3/users => generated 300 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:53:11.554264 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd31d4-5ed7-49fc-a5b7-702ae8b55fb8 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:11.579994 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 840/1676] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:11 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:11.588127 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1709cc5-d054-4b81-8d6d-0abafaeac26a None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:11.589885 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd31d4-5ed7-49fc-a5b7-702ae8b55fb8 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:11.604480 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1709cc5-d054-4b81-8d6d-0abafaeac26a None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:11.610078 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0488d-695f-40ec-8d63-1e2fbb93ed86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:11.611009 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0488d-695f-40ec-8d63-1e2fbb93ed86 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:11.611467 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0488d-695f-40ec-8d63-1e2fbb93ed86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:11.611927 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156cbbfc-ffa6-493b-a8fa-5acb47ea6201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:11.612195 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0488d-695f-40ec-8d63-1e2fbb93ed86 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:11.613317 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cbbfc-ffa6-493b-a8fa-5acb47ea6201 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:11.613825 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c0488d-695f-40ec-8d63-1e2fbb93ed86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:11.616586 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cbbfc-ffa6-493b-a8fa-5acb47ea6201 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:11.616949 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cbbfc-ffa6-493b-a8fa-5acb47ea6201 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:11.619341 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c0488d-695f-40ec-8d63-1e2fbb93ed86 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:11.621193 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156cbbfc-ffa6-493b-a8fa-5acb47ea6201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:11.622940 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156cbbfc-ffa6-493b-a8fa-5acb47ea6201 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:11.661627 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 837/1677] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:53:11.670028 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156cbbfc-ffa6-493b-a8fa-5acb47ea6201 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:11.703355 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 841/1678] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:53:11 2022] POST /identity/v3/projects => generated 369 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:53:11.705840 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156cbbfc-ffa6-493b-a8fa-5acb47ea6201 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:11.709562 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0488d-695f-40ec-8d63-1e2fbb93ed86 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:11.867010 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5fc35-0481-4d17-b124-ddef6f5dc6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:11.868069 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5fc35-0481-4d17-b124-ddef6f5dc6ce admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:11.868348 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5fc35-0481-4d17-b124-ddef6f5dc6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:11.868627 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5fc35-0481-4d17-b124-ddef6f5dc6ce admin admin] PATH_INFO: `/v3/projects/dd3f2cae34694e32b130ae9412880313/users/0f2c975cc743474aa3ff60d19c1aed79/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:11.898344 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0488d-695f-40ec-8d63-1e2fbb93ed86 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:11.925732 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81eba07-d57a-4af2-99b5-f2d87a7d0fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:11.926661 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81eba07-d57a-4af2-99b5-f2d87a7d0fdd admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:11.928418 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81eba07-d57a-4af2-99b5-f2d87a7d0fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:11.929694 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81eba07-d57a-4af2-99b5-f2d87a7d0fdd admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:11.933333 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81eba07-d57a-4af2-99b5-f2d87a7d0fdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:11.937590 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f5fc35-0481-4d17-b124-ddef6f5dc6ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd3f2cae34694e32b130ae9412880313, user_id=0f2c975cc743474aa3ff60d19c1aed79, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:11.944534 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f5fc35-0481-4d17-b124-ddef6f5dc6ce admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:11.949328 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81eba07-d57a-4af2-99b5-f2d87a7d0fdd admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:11.996413 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 838/1679] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:53:11 2022] PUT /identity/v3/projects/dd3f2cae34694e32b130ae9412880313/users/0f2c975cc743474aa3ff60d19c1aed79/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:12.031435 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 842/1680] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:53:11 2022] POST /identity/v3/users => generated 291 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:53:12.037102 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5fc35-0481-4d17-b124-ddef6f5dc6ce admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:12.037656 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81eba07-d57a-4af2-99b5-f2d87a7d0fdd admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:12.073318 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81eba07-d57a-4af2-99b5-f2d87a7d0fdd admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:12.326248 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5fc35-0481-4d17-b124-ddef6f5dc6ce admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:12.345871 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514c6c7-136e-4ba0-af1a-75854c69ac32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:12.349377 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514c6c7-136e-4ba0-af1a-75854c69ac32 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:12.349771 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514c6c7-136e-4ba0-af1a-75854c69ac32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:12.350017 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514c6c7-136e-4ba0-af1a-75854c69ac32 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:12.359819 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8514c6c7-136e-4ba0-af1a-75854c69ac32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:12.367365 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8514c6c7-136e-4ba0-af1a-75854c69ac32 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:12.399925 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 839/1681] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:53:12.403147 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514c6c7-136e-4ba0-af1a-75854c69ac32 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:12.429555 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb5f8d-09c0-4f83-a20b-ea846ef25fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:12.436555 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb5f8d-09c0-4f83-a20b-ea846ef25fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:12.437257 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb5f8d-09c0-4f83-a20b-ea846ef25fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:12.438178 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb5f8d-09c0-4f83-a20b-ea846ef25fd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:12.438445 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514c6c7-136e-4ba0-af1a-75854c69ac32 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:12.440078 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb5f8d-09c0-4f83-a20b-ea846ef25fd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:12.450819 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb5f8d-09c0-4f83-a20b-ea846ef25fd3 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:12.466311 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a9470-7468-4c11-93fb-46644d598826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:12.466311 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a9470-7468-4c11-93fb-46644d598826 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:12.466311 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a9470-7468-4c11-93fb-46644d598826 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:12.466311 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a9470-7468-4c11-93fb-46644d598826 admin admin] PATH_INFO: `/v3/projects/dd3f2cae34694e32b130ae9412880313/users/0f2c975cc743474aa3ff60d19c1aed79/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:12.470973 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a9470-7468-4c11-93fb-46644d598826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd3f2cae34694e32b130ae9412880313, user_id=0f2c975cc743474aa3ff60d19c1aed79, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:12.486108 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a9470-7468-4c11-93fb-46644d598826 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:12.528251 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 840/1682] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:53:12 2022] PUT /identity/v3/projects/dd3f2cae34694e32b130ae9412880313/users/0f2c975cc743474aa3ff60d19c1aed79/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:12.540831 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a9470-7468-4c11-93fb-46644d598826 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:12.541074 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 843/1683] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 504 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:53:12.548673 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53dbe33-d503-45e6-96d2-6051fd5b5050 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:12.549576 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53dbe33-d503-45e6-96d2-6051fd5b5050 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:12.550515 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53dbe33-d503-45e6-96d2-6051fd5b5050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:12.674849 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-d53dbe33-d503-45e6-96d2-6051fd5b5050 None None] MFA Rules not processed for user `0f2c975cc743474aa3ff60d19c1aed79`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:12.681948 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-d53dbe33-d503-45e6-96d2-6051fd5b5050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:12.755926 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a9470-7468-4c11-93fb-46644d598826 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:12.776233 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f39f05-46fc-4115-9501-1a4f023759f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:12.777201 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f39f05-46fc-4115-9501-1a4f023759f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:12.777489 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f39f05-46fc-4115-9501-1a4f023759f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:12.777764 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f39f05-46fc-4115-9501-1a4f023759f8 admin admin] PATH_INFO: `/v3/projects/c1835ccbff914cbb81b9ecd24f19f74c/users/ea9539b80dd44bf3bee9badbc3f64210/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:12.833209 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f39f05-46fc-4115-9501-1a4f023759f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1835ccbff914cbb81b9ecd24f19f74c, user_id=ea9539b80dd44bf3bee9badbc3f64210, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:12.836597 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f39f05-46fc-4115-9501-1a4f023759f8 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:12.875874 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 841/1684] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:53:12 2022] PUT /identity/v3/projects/c1835ccbff914cbb81b9ecd24f19f74c/users/ea9539b80dd44bf3bee9badbc3f64210/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:12.877689 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf99440-0537-4532-b882-2fa509dea76c None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:12.878060 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf99440-0537-4532-b882-2fa509dea76c None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:12.878358 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf99440-0537-4532-b882-2fa509dea76c None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:12.885547 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 842/1685] 10.222.0.49 () {54 vars in 921 bytes} [Fri Oct 28 20:53:12 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:53:12.886759 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf99440-0537-4532-b882-2fa509dea76c None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:13.005400 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 844/1686] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:12 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:13.006808 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bf186-0749-4ed3-9fee-b9aa3c355c66 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:13.007098 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bf186-0749-4ed3-9fee-b9aa3c355c66 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:13.007376 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bf186-0749-4ed3-9fee-b9aa3c355c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:13.064755 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-766bf186-0749-4ed3-9fee-b9aa3c355c66 None None] MFA Rules not processed for user `938634e835b94a75af698aef6941958f`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:13.066871 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-766bf186-0749-4ed3-9fee-b9aa3c355c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:13.078781 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf99440-0537-4532-b882-2fa509dea76c None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:13.086383 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1acbe-2dde-4f8c-9baa-0496b21b16a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:13.087362 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1acbe-2dde-4f8c-9baa-0496b21b16a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:13.087907 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1acbe-2dde-4f8c-9baa-0496b21b16a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:13.088374 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1acbe-2dde-4f8c-9baa-0496b21b16a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:13.089380 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d1acbe-2dde-4f8c-9baa-0496b21b16a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:13.093417 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d1acbe-2dde-4f8c-9baa-0496b21b16a1 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:13.109066 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 843/1687] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:53:13.110281 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1acbe-2dde-4f8c-9baa-0496b21b16a1 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:13.113944 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-84d1acbe-2dde-4f8c-9baa-0496b21b16a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:13.243282 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 845/1688] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Oct 28 20:53:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:13.247658 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bf186-0749-4ed3-9fee-b9aa3c355c66 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:13.266155 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1acbe-2dde-4f8c-9baa-0496b21b16a1 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:13.274814 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bf186-0749-4ed3-9fee-b9aa3c355c66 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:13.281322 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebfaa1-12b8-43a8-98a9-434cd531225c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:13.282560 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebfaa1-12b8-43a8-98a9-434cd531225c service cinder] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:13.283059 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebfaa1-12b8-43a8-98a9-434cd531225c service cinder] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:13.283541 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebfaa1-12b8-43a8-98a9-434cd531225c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:13.293391 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb782afd-18b1-49ea-9272-4279f16d3bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:13.296628 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb782afd-18b1-49ea-9272-4279f16d3bd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:13.298532 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb782afd-18b1-49ea-9272-4279f16d3bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:13.301502 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb782afd-18b1-49ea-9272-4279f16d3bd0 admin admin] PATH_INFO: `/v3/projects/c1835ccbff914cbb81b9ecd24f19f74c/users/ea9539b80dd44bf3bee9badbc3f64210/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:13.306103 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb782afd-18b1-49ea-9272-4279f16d3bd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1835ccbff914cbb81b9ecd24f19f74c, user_id=ea9539b80dd44bf3bee9badbc3f64210, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:13.315212 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb782afd-18b1-49ea-9272-4279f16d3bd0 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:13.345612 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 846/1689] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:53:13 2022] PUT /identity/v3/projects/c1835ccbff914cbb81b9ecd24f19f74c/users/ea9539b80dd44bf3bee9badbc3f64210/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:13.355207 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202f6b5-3274-4668-99c7-1682a2b417ec None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:13.355207 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202f6b5-3274-4668-99c7-1682a2b417ec None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:13.355207 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202f6b5-3274-4668-99c7-1682a2b417ec None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:13.359560 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 847/1690] 10.222.0.49 () {54 vars in 960 bytes} [Fri Oct 28 20:53:13 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:53:13.365596 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934ef56-e959-4029-9af5-3b9c29d87ec7 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:13.367621 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934ef56-e959-4029-9af5-3b9c29d87ec7 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:13.368078 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934ef56-e959-4029-9af5-3b9c29d87ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:13.442239 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-7934ef56-e959-4029-9af5-3b9c29d87ec7 None None] MFA Rules not processed for user `ea9539b80dd44bf3bee9badbc3f64210`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:13.446730 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-7934ef56-e959-4029-9af5-3b9c29d87ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:13.468869 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ebfaa1-12b8-43a8-98a9-434cd531225c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:13.475448 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ebfaa1-12b8-43a8-98a9-434cd531225c service cinder] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:13.503622 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 844/1691] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:53:13 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:53:13.506700 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bb675-748a-4d39-8ab0-b94e2fdb6639 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:13.507035 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bb675-748a-4d39-8ab0-b94e2fdb6639 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:13.507263 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bb675-748a-4d39-8ab0-b94e2fdb6639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:13.560859 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-d05bb675-748a-4d39-8ab0-b94e2fdb6639 None None] MFA Rules not processed for user `938634e835b94a75af698aef6941958f`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:13.564442 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-d05bb675-748a-4d39-8ab0-b94e2fdb6639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:13.651088 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 848/1692] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:13 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:13.652633 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934ef56-e959-4029-9af5-3b9c29d87ec7 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:13.764720 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 845/1693] 10.222.0.49 () {58 vars in 1057 bytes} [Fri Oct 28 20:53:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:13.767355 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05bb675-748a-4d39-8ab0-b94e2fdb6639 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:13.841729 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934ef56-e959-4029-9af5-3b9c29d87ec7 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:13.857954 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7000d0e-a9db-4fc5-913e-62059935c95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:13.859461 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7000d0e-a9db-4fc5-913e-62059935c95e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:13.860374 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7000d0e-a9db-4fc5-913e-62059935c95e admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:13.860668 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7000d0e-a9db-4fc5-913e-62059935c95e admin admin] PATH_INFO: `/v3/users/ef5e921de88e476aa4f4ba57354efaa6` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:13.866011 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7000d0e-a9db-4fc5-913e-62059935c95e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef5e921de88e476aa4f4ba57354efaa6)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:13.869711 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7000d0e-a9db-4fc5-913e-62059935c95e admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:13.937049 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05bb675-748a-4d39-8ab0-b94e2fdb6639 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:13.947139 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7dd7ca-5ba4-41bd-8005-4221b935f945 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:13.955968 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dd7ca-5ba4-41bd-8005-4221b935f945 service cinder] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:13.956729 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dd7ca-5ba4-41bd-8005-4221b935f945 service cinder] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:13.957015 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dd7ca-5ba4-41bd-8005-4221b935f945 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:13.989965 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7dd7ca-5ba4-41bd-8005-4221b935f945 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:13.995153 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7dd7ca-5ba4-41bd-8005-4221b935f945 service cinder] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:14.006352 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-d7000d0e-a9db-4fc5-913e-62059935c95e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef5e921de88e476aa4f4ba57354efaa6'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:14.017173 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-d7000d0e-a9db-4fc5-913e-62059935c95e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef5e921de88e476aa4f4ba57354efaa6'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:14.028954 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 846/1694] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:53:13 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:53:14.030573 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7dd7ca-5ba4-41bd-8005-4221b935f945 service cinder] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:14.033540 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-d7000d0e-a9db-4fc5-913e-62059935c95e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef5e921de88e476aa4f4ba57354efaa6'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:14.034317 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-d7000d0e-a9db-4fc5-913e-62059935c95e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef5e921de88e476aa4f4ba57354efaa6'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:14.053684 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7dd7ca-5ba4-41bd-8005-4221b935f945 service cinder] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:14.057114 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-d7000d0e-a9db-4fc5-913e-62059935c95e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef5e921de88e476aa4f4ba57354efaa6'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:14.065312 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48cc4f-64b7-4947-bdab-328f2bd5245c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '938634e835b94a75af698aef6941958f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:14.067233 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48cc4f-64b7-4947-bdab-328f2bd5245c service placement] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:14.068394 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48cc4f-64b7-4947-bdab-328f2bd5245c service placement] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:14.069051 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48cc4f-64b7-4947-bdab-328f2bd5245c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:14.072559 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-6e48cc4f-64b7-4947-bdab-328f2bd5245c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:14.074951 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 849/1695] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:53:13 2022] DELETE /identity/v3/users/ef5e921de88e476aa4f4ba57354efaa6 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:14.080758 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa553df-0b72-4fe9-b192-033f6297822b None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:14.081102 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa553df-0b72-4fe9-b192-033f6297822b None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:14.081505 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa553df-0b72-4fe9-b192-033f6297822b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:14.101405 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e48cc4f-64b7-4947-bdab-328f2bd5245c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:14.110202 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e48cc4f-64b7-4947-bdab-328f2bd5245c service placement] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:14.130961 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-4aa553df-0b72-4fe9-b192-033f6297822b None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:14.133157 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-4aa553df-0b72-4fe9-b192-033f6297822b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:14.155123 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 847/1696] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:53:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:53:14.171765 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48cc4f-64b7-4947-bdab-328f2bd5245c service placement] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:14.179097 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-6e48cc4f-64b7-4947-bdab-328f2bd5245c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:14.233982 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48cc4f-64b7-4947-bdab-328f2bd5245c service placement] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:14.361097 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 850/1697] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:14.441078 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d37716-3ca9-4b3c-98c1-fdf5360388a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:14.442596 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d37716-3ca9-4b3c-98c1-fdf5360388a7 service cinder] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:14.444255 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d37716-3ca9-4b3c-98c1-fdf5360388a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:14.444765 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d37716-3ca9-4b3c-98c1-fdf5360388a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:14.451447 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-40d37716-3ca9-4b3c-98c1-fdf5360388a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:14.536103 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa553df-0b72-4fe9-b192-033f6297822b None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:14.538510 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-4aa553df-0b72-4fe9-b192-033f6297822b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:14.708058 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d37716-3ca9-4b3c-98c1-fdf5360388a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:14.710238 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d37716-3ca9-4b3c-98c1-fdf5360388a7 service cinder] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:14.736436 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa553df-0b72-4fe9-b192-033f6297822b None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:14.743122 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 848/1698] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:53:14 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:53:14.766466 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209ba55-7a97-4949-ad13-02bbdf9ac2ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:14.767621 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209ba55-7a97-4949-ad13-02bbdf9ac2ba service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:14.774746 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209ba55-7a97-4949-ad13-02bbdf9ac2ba service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:14.775589 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209ba55-7a97-4949-ad13-02bbdf9ac2ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:14.832879 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209ba55-7a97-4949-ad13-02bbdf9ac2ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:14.838318 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209ba55-7a97-4949-ad13-02bbdf9ac2ba service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:14.862242 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 851/1699] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:53:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:53:16.013604 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d37716-3ca9-4b3c-98c1-fdf5360388a7 service cinder] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:16.015675 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-40d37716-3ca9-4b3c-98c1-fdf5360388a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:16.047028 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d37716-3ca9-4b3c-98c1-fdf5360388a7 service cinder] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:16.060774 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735dc4ea-1cd7-4a1e-83a4-bc9bc2c4eca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:16.061689 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735dc4ea-1cd7-4a1e-83a4-bc9bc2c4eca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:16.061994 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735dc4ea-1cd7-4a1e-83a4-bc9bc2c4eca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:16.062249 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735dc4ea-1cd7-4a1e-83a4-bc9bc2c4eca5 admin admin] PATH_INFO: `/v3/users/d20d4d82516c4cdaad51140a4abf88f2` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:16.063878 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735dc4ea-1cd7-4a1e-83a4-bc9bc2c4eca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d20d4d82516c4cdaad51140a4abf88f2)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:16.067385 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735dc4ea-1cd7-4a1e-83a4-bc9bc2c4eca5 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:16.185375 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-735dc4ea-1cd7-4a1e-83a4-bc9bc2c4eca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd20d4d82516c4cdaad51140a4abf88f2'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:16.232817 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-735dc4ea-1cd7-4a1e-83a4-bc9bc2c4eca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd20d4d82516c4cdaad51140a4abf88f2'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:16.234638 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-735dc4ea-1cd7-4a1e-83a4-bc9bc2c4eca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd20d4d82516c4cdaad51140a4abf88f2'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:16.282223 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-735dc4ea-1cd7-4a1e-83a4-bc9bc2c4eca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd20d4d82516c4cdaad51140a4abf88f2'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:16.283893 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-735dc4ea-1cd7-4a1e-83a4-bc9bc2c4eca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd20d4d82516c4cdaad51140a4abf88f2'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:16.340377 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 849/1700] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:53:16 2022] DELETE /identity/v3/users/d20d4d82516c4cdaad51140a4abf88f2 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:53:18.023860 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209ba55-7a97-4949-ad13-02bbdf9ac2ba service neutron] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:18.030552 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-b209ba55-7a97-4949-ad13-02bbdf9ac2ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:18.131921 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209ba55-7a97-4949-ad13-02bbdf9ac2ba service neutron] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:18.360357 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a834b-8702-471a-9af7-c0ecf1283e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:18.361657 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a834b-8702-471a-9af7-c0ecf1283e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:18.362668 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a834b-8702-471a-9af7-c0ecf1283e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:18.363156 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a834b-8702-471a-9af7-c0ecf1283e79 admin admin] PATH_INFO: `/v3/projects/3ac6d4b78e0e4cdcb6ffb03a92d4c6bd` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:18.365261 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a834b-8702-471a-9af7-c0ecf1283e79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ac6d4b78e0e4cdcb6ffb03a92d4c6bd)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:18.367591 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a834b-8702-471a-9af7-c0ecf1283e79 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:18.578343 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ad8a834b-8702-471a-9af7-c0ecf1283e79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ac6d4b78e0e4cdcb6ffb03a92d4c6bd', 'request_id': 'req-ad8a834b-8702-471a-9af7-c0ecf1283e79'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:18.591441 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ad8a834b-8702-471a-9af7-c0ecf1283e79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ac6d4b78e0e4cdcb6ffb03a92d4c6bd', 'request_id': 'req-ad8a834b-8702-471a-9af7-c0ecf1283e79'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:18.622709 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ad8a834b-8702-471a-9af7-c0ecf1283e79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ac6d4b78e0e4cdcb6ffb03a92d4c6bd', 'request_id': 'req-ad8a834b-8702-471a-9af7-c0ecf1283e79'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:18.648725 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ad8a834b-8702-471a-9af7-c0ecf1283e79 admin admin] The token cache is being invalidate because project 3ac6d4b78e0e4cdcb6ffb03a92d4c6bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:53:18.649216 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ad8a834b-8702-471a-9af7-c0ecf1283e79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:18.650637 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ad8a834b-8702-471a-9af7-c0ecf1283e79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:18.672212 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 852/1701] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:53:18 2022] DELETE /identity/v3/projects/3ac6d4b78e0e4cdcb6ffb03a92d4c6bd => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:18.677019 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735dc4ea-1cd7-4a1e-83a4-bc9bc2c4eca5 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:18.678509 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-735dc4ea-1cd7-4a1e-83a4-bc9bc2c4eca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:18.700692 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735dc4ea-1cd7-4a1e-83a4-bc9bc2c4eca5 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:18.712452 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a834b-8702-471a-9af7-c0ecf1283e79 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:18.714455 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-ad8a834b-8702-471a-9af7-c0ecf1283e79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:18.877631 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a834b-8702-471a-9af7-c0ecf1283e79 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:18.882121 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b0442-3d45-4248-a0e1-ccdb07e244a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:18.883733 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b0442-3d45-4248-a0e1-ccdb07e244a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:18.884306 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b0442-3d45-4248-a0e1-ccdb07e244a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:18.884908 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b0442-3d45-4248-a0e1-ccdb07e244a7 admin admin] PATH_INFO: `/v3/users/0f2c975cc743474aa3ff60d19c1aed79` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:18.885205 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea1f84-7105-46a2-ae46-11fc1e10e549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:18.886318 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea1f84-7105-46a2-ae46-11fc1e10e549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:18.886602 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea1f84-7105-46a2-ae46-11fc1e10e549 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:18.886923 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea1f84-7105-46a2-ae46-11fc1e10e549 admin admin] PATH_INFO: `/v3/projects/852949f745ee4e23959a221981897741` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:18.890103 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea1f84-7105-46a2-ae46-11fc1e10e549 admin admin] RBAC: Authorizing `identity:delete_project(project_id=852949f745ee4e23959a221981897741)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:18.897306 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b0442-3d45-4248-a0e1-ccdb07e244a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f2c975cc743474aa3ff60d19c1aed79)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:18.900619 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea1f84-7105-46a2-ae46-11fc1e10e549 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:18.901705 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b0442-3d45-4248-a0e1-ccdb07e244a7 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:19.049386 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-076b0442-3d45-4248-a0e1-ccdb07e244a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f2c975cc743474aa3ff60d19c1aed79'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:19.058558 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-13ea1f84-7105-46a2-ae46-11fc1e10e549 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '852949f745ee4e23959a221981897741', 'request_id': 'req-13ea1f84-7105-46a2-ae46-11fc1e10e549'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:19.060137 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-076b0442-3d45-4248-a0e1-ccdb07e244a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f2c975cc743474aa3ff60d19c1aed79'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:19.061234 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-076b0442-3d45-4248-a0e1-ccdb07e244a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f2c975cc743474aa3ff60d19c1aed79'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:19.077580 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-13ea1f84-7105-46a2-ae46-11fc1e10e549 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '852949f745ee4e23959a221981897741', 'request_id': 'req-13ea1f84-7105-46a2-ae46-11fc1e10e549'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:19.088798 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-076b0442-3d45-4248-a0e1-ccdb07e244a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f2c975cc743474aa3ff60d19c1aed79'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:19.090403 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-076b0442-3d45-4248-a0e1-ccdb07e244a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f2c975cc743474aa3ff60d19c1aed79'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:19.099522 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-13ea1f84-7105-46a2-ae46-11fc1e10e549 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '852949f745ee4e23959a221981897741', 'request_id': 'req-13ea1f84-7105-46a2-ae46-11fc1e10e549'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:19.126741 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 850/1702] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:53:18 2022] DELETE /identity/v3/users/0f2c975cc743474aa3ff60d19c1aed79 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:19.131212 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-13ea1f84-7105-46a2-ae46-11fc1e10e549 admin admin] The token cache is being invalidate because project 852949f745ee4e23959a221981897741 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:53:19.131483 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-13ea1f84-7105-46a2-ae46-11fc1e10e549 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:19.132600 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-13ea1f84-7105-46a2-ae46-11fc1e10e549 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:19.134630 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 853/1703] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:53:18 2022] DELETE /identity/v3/projects/852949f745ee4e23959a221981897741 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:53:19.139816 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b0442-3d45-4248-a0e1-ccdb07e244a7 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:19.141024 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-076b0442-3d45-4248-a0e1-ccdb07e244a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:19.259285 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b0442-3d45-4248-a0e1-ccdb07e244a7 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:19.266587 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29859bdc-bebb-4814-b6fe-aef483cc6964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:19.270647 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29859bdc-bebb-4814-b6fe-aef483cc6964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:19.271447 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29859bdc-bebb-4814-b6fe-aef483cc6964 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:19.271726 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29859bdc-bebb-4814-b6fe-aef483cc6964 admin admin] PATH_INFO: `/v3/users/f2475ef9c236483bb4470199ff24f82a` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:19.273477 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29859bdc-bebb-4814-b6fe-aef483cc6964 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2475ef9c236483bb4470199ff24f82a)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:19.276488 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29859bdc-bebb-4814-b6fe-aef483cc6964 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:19.401924 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-29859bdc-bebb-4814-b6fe-aef483cc6964 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2475ef9c236483bb4470199ff24f82a'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:19.416752 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-29859bdc-bebb-4814-b6fe-aef483cc6964 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2475ef9c236483bb4470199ff24f82a'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:19.418320 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-29859bdc-bebb-4814-b6fe-aef483cc6964 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2475ef9c236483bb4470199ff24f82a'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:19.444263 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-29859bdc-bebb-4814-b6fe-aef483cc6964 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2475ef9c236483bb4470199ff24f82a'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:19.445117 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-29859bdc-bebb-4814-b6fe-aef483cc6964 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2475ef9c236483bb4470199ff24f82a'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:19.491571 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 851/1704] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:53:19 2022] DELETE /identity/v3/users/f2475ef9c236483bb4470199ff24f82a => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:20.230379 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f38660-2277-4175-8bcb-cb803a0ee1f6 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:20.231225 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f38660-2277-4175-8bcb-cb803a0ee1f6 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:20.231690 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f38660-2277-4175-8bcb-cb803a0ee1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:20.314057 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-59f38660-2277-4175-8bcb-cb803a0ee1f6 None None] MFA Rules not processed for user `7781cf44c6cb47a8adac1e187e9a8dac`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:20.327735 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-59f38660-2277-4175-8bcb-cb803a0ee1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:20.618661 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 854/1705] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:20.665225 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899fd1a-44d8-47a6-b441-c721fff3789a None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:20.671530 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899fd1a-44d8-47a6-b441-c721fff3789a None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:20.676415 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899fd1a-44d8-47a6-b441-c721fff3789a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:20.725885 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a5ea8-262d-4872-989e-4c8a13f60c6d None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:20.726515 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a5ea8-262d-4872-989e-4c8a13f60c6d None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:20.726999 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a5ea8-262d-4872-989e-4c8a13f60c6d None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:20.731292 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 855/1706] 10.222.0.49 () {54 vars in 959 bytes} [Fri Oct 28 20:53:20 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:53:20.760773 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfbf62-fbbc-46c7-8e14-f5ca16b387bb None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:20.761488 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfbf62-fbbc-46c7-8e14-f5ca16b387bb None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:20.762288 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfbf62-fbbc-46c7-8e14-f5ca16b387bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:20.806979 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-0899fd1a-44d8-47a6-b441-c721fff3789a None None] MFA Rules not processed for user `59e07e89a62b42a4974f3b226cc2b8a0`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:20.809753 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-0899fd1a-44d8-47a6-b441-c721fff3789a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:20.869831 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-5bcfbf62-fbbc-46c7-8e14-f5ca16b387bb None None] MFA Rules not processed for user `04bc6ee009e34a5f82e2807db51523d3`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:20.871173 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-5bcfbf62-fbbc-46c7-8e14-f5ca16b387bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:21.037394 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 852/1707] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:21.038425 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899fd1a-44d8-47a6-b441-c721fff3789a None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:21.048403 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-0899fd1a-44d8-47a6-b441-c721fff3789a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:21.190257 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899fd1a-44d8-47a6-b441-c721fff3789a None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:21.202359 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 856/1708] 10.222.0.49 () {58 vars in 1056 bytes} [Fri Oct 28 20:53:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:21.204238 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcfbf62-fbbc-46c7-8e14-f5ca16b387bb None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:21.208591 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c6a9f-7a8a-474b-96e1-6e54b7d2136d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:21.209496 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c6a9f-7a8a-474b-96e1-6e54b7d2136d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:21.209660 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-5bcfbf62-fbbc-46c7-8e14-f5ca16b387bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:21.209916 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c6a9f-7a8a-474b-96e1-6e54b7d2136d admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:21.210205 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c6a9f-7a8a-474b-96e1-6e54b7d2136d admin admin] PATH_INFO: `/v3/projects/dd3f2cae34694e32b130ae9412880313` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:21.211958 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c6a9f-7a8a-474b-96e1-6e54b7d2136d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd3f2cae34694e32b130ae9412880313)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:21.214254 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c6a9f-7a8a-474b-96e1-6e54b7d2136d admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:21.248605 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcfbf62-fbbc-46c7-8e14-f5ca16b387bb None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:21.279520 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e78c42-586b-437a-ac60-c1b45d6f1cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:21.280481 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e78c42-586b-437a-ac60-c1b45d6f1cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:21.280757 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e78c42-586b-437a-ac60-c1b45d6f1cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:21.281024 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e78c42-586b-437a-ac60-c1b45d6f1cd9 admin admin] PATH_INFO: `/v3/projects/06a40991fcad4e018c09a7d43406d71e` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:21.285197 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e78c42-586b-437a-ac60-c1b45d6f1cd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06a40991fcad4e018c09a7d43406d71e)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:21.296164 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e78c42-586b-437a-ac60-c1b45d6f1cd9 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:21.357244 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-c79c6a9f-7a8a-474b-96e1-6e54b7d2136d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd3f2cae34694e32b130ae9412880313', 'request_id': 'req-c79c6a9f-7a8a-474b-96e1-6e54b7d2136d'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:21.369565 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-c79c6a9f-7a8a-474b-96e1-6e54b7d2136d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd3f2cae34694e32b130ae9412880313', 'request_id': 'req-c79c6a9f-7a8a-474b-96e1-6e54b7d2136d'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:21.390794 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-c79c6a9f-7a8a-474b-96e1-6e54b7d2136d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd3f2cae34694e32b130ae9412880313', 'request_id': 'req-c79c6a9f-7a8a-474b-96e1-6e54b7d2136d'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:21.426621 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-c79c6a9f-7a8a-474b-96e1-6e54b7d2136d admin admin] The token cache is being invalidate because project dd3f2cae34694e32b130ae9412880313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:53:21.426891 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-c79c6a9f-7a8a-474b-96e1-6e54b7d2136d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:21.429131 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-c79c6a9f-7a8a-474b-96e1-6e54b7d2136d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:21.436307 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 853/1709] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:53:21 2022] DELETE /identity/v3/projects/dd3f2cae34694e32b130ae9412880313 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:21.436307 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edba9d-ab50-428c-99f1-29e21fab5df6 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:21.436307 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edba9d-ab50-428c-99f1-29e21fab5df6 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:21.436307 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edba9d-ab50-428c-99f1-29e21fab5df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:21.438774 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-51e78c42-586b-437a-ac60-c1b45d6f1cd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06a40991fcad4e018c09a7d43406d71e', 'request_id': 'req-51e78c42-586b-437a-ac60-c1b45d6f1cd9'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:21.452291 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-51e78c42-586b-437a-ac60-c1b45d6f1cd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06a40991fcad4e018c09a7d43406d71e', 'request_id': 'req-51e78c42-586b-437a-ac60-c1b45d6f1cd9'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:21.469388 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-51e78c42-586b-437a-ac60-c1b45d6f1cd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06a40991fcad4e018c09a7d43406d71e', 'request_id': 'req-51e78c42-586b-437a-ac60-c1b45d6f1cd9'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:21.486459 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-51e78c42-586b-437a-ac60-c1b45d6f1cd9 admin admin] The token cache is being invalidate because project 06a40991fcad4e018c09a7d43406d71e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:53:21.486754 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-51e78c42-586b-437a-ac60-c1b45d6f1cd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:21.488482 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-51e78c42-586b-437a-ac60-c1b45d6f1cd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:21.490021 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 857/1710] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:53:21 2022] DELETE /identity/v3/projects/06a40991fcad4e018c09a7d43406d71e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:21.490948 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e78c42-586b-437a-ac60-c1b45d6f1cd9 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:21.493543 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-51e78c42-586b-437a-ac60-c1b45d6f1cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:21.513101 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-e8edba9d-ab50-428c-99f1-29e21fab5df6 None None] MFA Rules not processed for user `59e07e89a62b42a4974f3b226cc2b8a0`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:21.517774 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-e8edba9d-ab50-428c-99f1-29e21fab5df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:21.707308 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e78c42-586b-437a-ac60-c1b45d6f1cd9 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:21.735480 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeeec4e-8ba0-4893-a442-5a761dae62a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:21.736724 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeeec4e-8ba0-4893-a442-5a761dae62a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:21.737673 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeeec4e-8ba0-4893-a442-5a761dae62a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:21.738082 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeeec4e-8ba0-4893-a442-5a761dae62a8 admin admin] PATH_INFO: `/v3/users/7e44e227db3a4659933417df4e135c7f` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:21.740982 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeeec4e-8ba0-4893-a442-5a761dae62a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e44e227db3a4659933417df4e135c7f)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:21.742826 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 854/1711] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:21.744428 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edba9d-ab50-428c-99f1-29e21fab5df6 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:21.759330 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-e8edba9d-ab50-428c-99f1-29e21fab5df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:21.762160 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeeec4e-8ba0-4893-a442-5a761dae62a8 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:21.916959 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-9eeeec4e-8ba0-4893-a442-5a761dae62a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e44e227db3a4659933417df4e135c7f'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:21.928544 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-9eeeec4e-8ba0-4893-a442-5a761dae62a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e44e227db3a4659933417df4e135c7f'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:21.945777 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-9eeeec4e-8ba0-4893-a442-5a761dae62a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e44e227db3a4659933417df4e135c7f'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:21.946705 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-9eeeec4e-8ba0-4893-a442-5a761dae62a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e44e227db3a4659933417df4e135c7f'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:21.968612 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-9eeeec4e-8ba0-4893-a442-5a761dae62a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e44e227db3a4659933417df4e135c7f'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:21.984447 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 858/1712] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:53:21 2022] DELETE /identity/v3/users/7e44e227db3a4659933417df4e135c7f => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:21.985093 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edba9d-ab50-428c-99f1-29e21fab5df6 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:22.001226 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec21a7c-bdbc-47cd-a6a1-cddc44538160 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:22.001516 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec21a7c-bdbc-47cd-a6a1-cddc44538160 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:22.004381 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec21a7c-bdbc-47cd-a6a1-cddc44538160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:22.051538 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-eec21a7c-bdbc-47cd-a6a1-cddc44538160 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:22.055203 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-eec21a7c-bdbc-47cd-a6a1-cddc44538160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:22.145804 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40681066-fbbe-459c-81f1-a79b40a69c84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:22.146884 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40681066-fbbe-459c-81f1-a79b40a69c84 service nova] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:22.147169 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40681066-fbbe-459c-81f1-a79b40a69c84 service nova] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:22.147447 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40681066-fbbe-459c-81f1-a79b40a69c84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:22.150118 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-40681066-fbbe-459c-81f1-a79b40a69c84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:22.261827 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 859/1713] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:22.263332 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2f9f4-bdfe-4c0c-b5f9-373c89543048 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:22.263629 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2f9f4-bdfe-4c0c-b5f9-373c89543048 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:22.263955 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2f9f4-bdfe-4c0c-b5f9-373c89543048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:22.322805 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-11f2f9f4-bdfe-4c0c-b5f9-373c89543048 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:22.326991 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-11f2f9f4-bdfe-4c0c-b5f9-373c89543048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:22.340964 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40681066-fbbe-459c-81f1-a79b40a69c84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:22.343445 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40681066-fbbe-459c-81f1-a79b40a69c84 service nova] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:22.346185 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 860/1714] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:22.353502 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a06967-66e0-44ef-a8e2-31c628700e27 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:22.353792 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a06967-66e0-44ef-a8e2-31c628700e27 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:22.354071 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a06967-66e0-44ef-a8e2-31c628700e27 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:22.361039 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 861/1715] 10.222.0.49 () {54 vars in 959 bytes} [Fri Oct 28 20:53:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:53:22.363051 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39723ad-84ce-4d76-957c-128705bdb0a3 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:22.363336 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39723ad-84ce-4d76-957c-128705bdb0a3 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:22.363610 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39723ad-84ce-4d76-957c-128705bdb0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:22.369432 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 855/1716] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:53:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:53:22.371806 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a7e13-42e6-48e5-92c7-9f8d4a0be9cc None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:22.372643 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a7e13-42e6-48e5-92c7-9f8d4a0be9cc None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:22.373192 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a7e13-42e6-48e5-92c7-9f8d4a0be9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:22.445000 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-d39723ad-84ce-4d76-957c-128705bdb0a3 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:22.446302 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-d39723ad-84ce-4d76-957c-128705bdb0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:22.460778 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 862/1717] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:22.461998 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b7333-22b9-4148-afe8-f3894c95935a None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:22.462309 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b7333-22b9-4148-afe8-f3894c95935a None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:22.462587 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b7333-22b9-4148-afe8-f3894c95935a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:22.497430 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-5a1a7e13-42e6-48e5-92c7-9f8d4a0be9cc None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:22.512720 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-5a1a7e13-42e6-48e5-92c7-9f8d4a0be9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:22.521785 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-574b7333-22b9-4148-afe8-f3894c95935a None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:22.523082 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-574b7333-22b9-4148-afe8-f3894c95935a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:22.527859 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 856/1718] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:22.529254 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ccbb5-06c4-416c-8645-4c2be260215d None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:22.529542 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ccbb5-06c4-416c-8645-4c2be260215d None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:22.531543 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ccbb5-06c4-416c-8645-4c2be260215d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:22.553087 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 863/1719] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:22.554141 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b7333-22b9-4148-afe8-f3894c95935a None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:22.555914 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-574b7333-22b9-4148-afe8-f3894c95935a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:22.575179 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-133ccbb5-06c4-416c-8645-4c2be260215d None None] MFA Rules not processed for user `04bc6ee009e34a5f82e2807db51523d3`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:22.585887 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-133ccbb5-06c4-416c-8645-4c2be260215d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:22.625088 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 857/1720] 10.222.0.49 () {58 vars in 1056 bytes} [Fri Oct 28 20:53:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:22.626152 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ccbb5-06c4-416c-8645-4c2be260215d None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:22.684231 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ccbb5-06c4-416c-8645-4c2be260215d None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:22.708391 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8c731-eec8-4f42-b5ed-a2dad0521794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:22.709197 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8c731-eec8-4f42-b5ed-a2dad0521794 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:22.710563 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8c731-eec8-4f42-b5ed-a2dad0521794 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:22.710563 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8c731-eec8-4f42-b5ed-a2dad0521794 admin admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:22.713223 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8c731-eec8-4f42-b5ed-a2dad0521794 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:53:22.714597 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8c731-eec8-4f42-b5ed-a2dad0521794 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:22.720742 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8c731-eec8-4f42-b5ed-a2dad0521794 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:22.723222 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b7333-22b9-4148-afe8-f3894c95935a None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:22.728330 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f67a9e-15a8-4d41-bc53-1e0529a32b51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:22.729014 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f67a9e-15a8-4d41-bc53-1e0529a32b51 service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:22.729297 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f67a9e-15a8-4d41-bc53-1e0529a32b51 service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:22.729573 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f67a9e-15a8-4d41-bc53-1e0529a32b51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:22.777227 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 858/1721] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:53:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:53:22.779565 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8c731-eec8-4f42-b5ed-a2dad0521794 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:22.780533 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f67a9e-15a8-4d41-bc53-1e0529a32b51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:22.782062 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f67a9e-15a8-4d41-bc53-1e0529a32b51 service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:22.804656 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8c731-eec8-4f42-b5ed-a2dad0521794 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:22.806272 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 864/1722] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:53:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:53:22.810626 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a678a-3ad3-4b9f-b9f6-589debcf2990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:22.811536 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a678a-3ad3-4b9f-b9f6-589debcf2990 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:22.811976 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a678a-3ad3-4b9f-b9f6-589debcf2990 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:22.812358 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a678a-3ad3-4b9f-b9f6-589debcf2990 admin admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:22.813252 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9a678a-3ad3-4b9f-b9f6-589debcf2990 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:53:22.813830 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9a678a-3ad3-4b9f-b9f6-589debcf2990 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:22.814433 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f67a9e-15a8-4d41-bc53-1e0529a32b51 service neutron] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:22.817173 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9a678a-3ad3-4b9f-b9f6-589debcf2990 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:22.849497 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 859/1723] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:53:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:53:22.849497 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a678a-3ad3-4b9f-b9f6-589debcf2990 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:22.861841 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a678a-3ad3-4b9f-b9f6-589debcf2990 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:22.867593 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f67a9e-15a8-4d41-bc53-1e0529a32b51 service neutron] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:22.883308 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6773d02e-5122-48be-9846-db785c1af07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:22.884725 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773d02e-5122-48be-9846-db785c1af07a admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:22.884977 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773d02e-5122-48be-9846-db785c1af07a admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:22.886979 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773d02e-5122-48be-9846-db785c1af07a admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:22.888691 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6773d02e-5122-48be-9846-db785c1af07a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:22.889224 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c9420-6ed6-4884-8353-23add1faf84a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:22.889962 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c9420-6ed6-4884-8353-23add1faf84a service nova] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:22.890399 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c9420-6ed6-4884-8353-23add1faf84a service nova] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:22.892361 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6773d02e-5122-48be-9846-db785c1af07a admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:22.893140 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c9420-6ed6-4884-8353-23add1faf84a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:22.899622 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-ec5c9420-6ed6-4884-8353-23add1faf84a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:23.012621 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 860/1724] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:53:22 2022] POST /identity/v3/projects => generated 381 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:53:23.027038 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6773d02e-5122-48be-9846-db785c1af07a admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:23.163090 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c9420-6ed6-4884-8353-23add1faf84a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:23.166949 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c9420-6ed6-4884-8353-23add1faf84a service nova] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:23.213027 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 865/1725] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:53:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:53:23.216381 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c9420-6ed6-4884-8353-23add1faf84a service nova] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:23.255659 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6773d02e-5122-48be-9846-db785c1af07a admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:23.286974 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb711d-ca63-47db-9dae-845f6f3d27c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:23.287699 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb711d-ca63-47db-9dae-845f6f3d27c6 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:23.288017 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb711d-ca63-47db-9dae-845f6f3d27c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:23.288291 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb711d-ca63-47db-9dae-845f6f3d27c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:23.289029 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb711d-ca63-47db-9dae-845f6f3d27c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:23.289184 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c9420-6ed6-4884-8353-23add1faf84a service nova] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:23.298917 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb711d-ca63-47db-9dae-845f6f3d27c6 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:23.325147 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea5d15-5fa7-4393-9888-be863f9204e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:23.328150 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea5d15-5fa7-4393-9888-be863f9204e4 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:23.332287 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea5d15-5fa7-4393-9888-be863f9204e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:23.332287 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea5d15-5fa7-4393-9888-be863f9204e4 admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:23.344430 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea5d15-5fa7-4393-9888-be863f9204e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:23.349529 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea5d15-5fa7-4393-9888-be863f9204e4 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:23.391853 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 861/1726] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:53:23 2022] POST /identity/v3/projects => generated 357 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:53:23.393937 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb711d-ca63-47db-9dae-845f6f3d27c6 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:23.419279 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 866/1727] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:53:23 2022] POST /identity/v3/users => generated 291 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:53:23.420586 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea5d15-5fa7-4393-9888-be863f9204e4 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:23.445762 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea5d15-5fa7-4393-9888-be863f9204e4 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:23.571074 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf52ed-9a49-4fd4-bd95-c48e2cb78e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:23.571933 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf52ed-9a49-4fd4-bd95-c48e2cb78e33 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:23.573029 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf52ed-9a49-4fd4-bd95-c48e2cb78e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:23.573029 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf52ed-9a49-4fd4-bd95-c48e2cb78e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:23.573419 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf52ed-9a49-4fd4-bd95-c48e2cb78e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:23.575720 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf52ed-9a49-4fd4-bd95-c48e2cb78e33 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:23.579923 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb711d-ca63-47db-9dae-845f6f3d27c6 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:23.589697 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 867/1728] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:53:23.593973 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf52ed-9a49-4fd4-bd95-c48e2cb78e33 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:23.597369 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f1ad7-8bd7-4db6-9fb3-8b53288f8ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:23.598147 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f1ad7-8bd7-4db6-9fb3-8b53288f8ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:23.598508 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f1ad7-8bd7-4db6-9fb3-8b53288f8ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:23.598863 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f1ad7-8bd7-4db6-9fb3-8b53288f8ce5 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:23.599709 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f1ad7-8bd7-4db6-9fb3-8b53288f8ce5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:23.606571 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f1ad7-8bd7-4db6-9fb3-8b53288f8ce5 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:23.611901 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf52ed-9a49-4fd4-bd95-c48e2cb78e33 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:23.619823 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b716d48-13aa-4dc2-9354-2df83f06d88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:23.620752 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b716d48-13aa-4dc2-9354-2df83f06d88b admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:23.621178 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b716d48-13aa-4dc2-9354-2df83f06d88b admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:23.621595 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b716d48-13aa-4dc2-9354-2df83f06d88b admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:23.622546 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b716d48-13aa-4dc2-9354-2df83f06d88b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:23.624726 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b716d48-13aa-4dc2-9354-2df83f06d88b admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:23.639014 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 868/1729] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:53:23.644607 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b716d48-13aa-4dc2-9354-2df83f06d88b admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:23.658186 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b716d48-13aa-4dc2-9354-2df83f06d88b admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:23.660571 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 862/1730] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:53:23 2022] POST /identity/v3/users => generated 279 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:53:23.666276 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f1ad7-8bd7-4db6-9fb3-8b53288f8ce5 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:23.681610 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61888381-e630-4ea0-85ec-114af1e1e9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:23.682893 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61888381-e630-4ea0-85ec-114af1e1e9b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:23.685841 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61888381-e630-4ea0-85ec-114af1e1e9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:23.688088 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61888381-e630-4ea0-85ec-114af1e1e9b6 admin admin] PATH_INFO: `/v3/projects/95660b6a07174c2e89cb291e8bb002cd/users/0549dd6e9ea84266af8ebc546838a425/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:23.691516 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f1ad7-8bd7-4db6-9fb3-8b53288f8ce5 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:23.712318 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed6a40-0795-4720-bb56-23209415f7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:23.715403 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed6a40-0795-4720-bb56-23209415f7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:23.720495 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed6a40-0795-4720-bb56-23209415f7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:23.724196 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed6a40-0795-4720-bb56-23209415f7b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:23.727087 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed6a40-0795-4720-bb56-23209415f7b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:23.732227 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed6a40-0795-4720-bb56-23209415f7b2 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:23.752699 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61888381-e630-4ea0-85ec-114af1e1e9b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95660b6a07174c2e89cb291e8bb002cd, user_id=0549dd6e9ea84266af8ebc546838a425, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:23.762068 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61888381-e630-4ea0-85ec-114af1e1e9b6 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:23.769826 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 863/1731] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:53:23.776807 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed6a40-0795-4720-bb56-23209415f7b2 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:23.796749 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 869/1732] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:53:23 2022] PUT /identity/v3/projects/95660b6a07174c2e89cb291e8bb002cd/users/0549dd6e9ea84266af8ebc546838a425/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:23.812498 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61888381-e630-4ea0-85ec-114af1e1e9b6 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:23.814523 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed6a40-0795-4720-bb56-23209415f7b2 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:23.816718 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-61888381-e630-4ea0-85ec-114af1e1e9b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:24.042956 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589d1f4-d170-456c-a469-278cb4d60fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:24.043705 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589d1f4-d170-456c-a469-278cb4d60fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:24.044020 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589d1f4-d170-456c-a469-278cb4d60fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:24.044353 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589d1f4-d170-456c-a469-278cb4d60fb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:24.045118 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589d1f4-d170-456c-a469-278cb4d60fb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:24.051037 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589d1f4-d170-456c-a469-278cb4d60fb6 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:24.063587 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61888381-e630-4ea0-85ec-114af1e1e9b6 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:24.073313 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 864/1733] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:53:24.074735 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841196a7-48d1-4753-a4ae-dfdea15b00bd None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:24.075473 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841196a7-48d1-4753-a4ae-dfdea15b00bd None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:24.075795 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841196a7-48d1-4753-a4ae-dfdea15b00bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:24.081637 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd1715-d6fe-4ad9-8463-daf9ec19c094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:24.082546 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd1715-d6fe-4ad9-8463-daf9ec19c094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:24.082828 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd1715-d6fe-4ad9-8463-daf9ec19c094 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:24.083102 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd1715-d6fe-4ad9-8463-daf9ec19c094 admin admin] PATH_INFO: `/v3/projects/0bf07957f7a241aa8f5c93a242b4e346` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:24.084640 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd1715-d6fe-4ad9-8463-daf9ec19c094 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bf07957f7a241aa8f5c93a242b4e346)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:24.087151 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd1715-d6fe-4ad9-8463-daf9ec19c094 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:24.161695 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-841196a7-48d1-4753-a4ae-dfdea15b00bd None None] MFA Rules not processed for user `0549dd6e9ea84266af8ebc546838a425`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:24.162997 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-841196a7-48d1-4753-a4ae-dfdea15b00bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:24.224601 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ecbd1715-d6fe-4ad9-8463-daf9ec19c094 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bf07957f7a241aa8f5c93a242b4e346', 'request_id': 'req-ecbd1715-d6fe-4ad9-8463-daf9ec19c094'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:24.238576 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ecbd1715-d6fe-4ad9-8463-daf9ec19c094 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bf07957f7a241aa8f5c93a242b4e346', 'request_id': 'req-ecbd1715-d6fe-4ad9-8463-daf9ec19c094'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:24.261448 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ecbd1715-d6fe-4ad9-8463-daf9ec19c094 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bf07957f7a241aa8f5c93a242b4e346', 'request_id': 'req-ecbd1715-d6fe-4ad9-8463-daf9ec19c094'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:24.281533 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ecbd1715-d6fe-4ad9-8463-daf9ec19c094 admin admin] The token cache is being invalidate because project 0bf07957f7a241aa8f5c93a242b4e346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:53:24.281824 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ecbd1715-d6fe-4ad9-8463-daf9ec19c094 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:24.285249 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ecbd1715-d6fe-4ad9-8463-daf9ec19c094 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:24.294981 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 870/1734] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:53:23 2022] DELETE /identity/v3/projects/0bf07957f7a241aa8f5c93a242b4e346 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:24.294981 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd1715-d6fe-4ad9-8463-daf9ec19c094 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:24.296088 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-ecbd1715-d6fe-4ad9-8463-daf9ec19c094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:24.350821 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 865/1735] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:24.354051 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0c0c4-cf82-44f4-8d67-34f72493bc2f None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:24.355128 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0c0c4-cf82-44f4-8d67-34f72493bc2f None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:24.355840 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0c0c4-cf82-44f4-8d67-34f72493bc2f None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:24.359773 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 866/1736] 10.222.0.49 () {54 vars in 912 bytes} [Fri Oct 28 20:53:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:53:24.370959 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0c0c4-cf82-44f4-8d67-34f72493bc2f None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:24.375027 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-a0d0c0c4-cf82-44f4-8d67-34f72493bc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:24.470577 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd1715-d6fe-4ad9-8463-daf9ec19c094 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:24.484286 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6314b-96c2-4577-b91c-e1f1daf9c037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:24.485233 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6314b-96c2-4577-b91c-e1f1daf9c037 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:24.485516 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6314b-96c2-4577-b91c-e1f1daf9c037 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:24.485792 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6314b-96c2-4577-b91c-e1f1daf9c037 admin admin] PATH_INFO: `/v3/projects/6e4ee9e7879e4408948b7186c2d8cecd/users/0b957a43ca2b419484079dbe6cfb0ff7/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:24.520688 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6314b-96c2-4577-b91c-e1f1daf9c037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e4ee9e7879e4408948b7186c2d8cecd, user_id=0b957a43ca2b419484079dbe6cfb0ff7, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:24.525928 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6314b-96c2-4577-b91c-e1f1daf9c037 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:24.547243 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0c0c4-cf82-44f4-8d67-34f72493bc2f None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:24.585356 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 871/1737] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:53:24 2022] PUT /identity/v3/projects/6e4ee9e7879e4408948b7186c2d8cecd/users/0b957a43ca2b419484079dbe6cfb0ff7/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:24.593470 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6314b-96c2-4577-b91c-e1f1daf9c037 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:24.598704 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-10c6314b-96c2-4577-b91c-e1f1daf9c037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:24.829477 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162eda5d-975d-4272-977b-0eaf1c687252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:24.833499 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162eda5d-975d-4272-977b-0eaf1c687252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:24.837493 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162eda5d-975d-4272-977b-0eaf1c687252 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:24.838287 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162eda5d-975d-4272-977b-0eaf1c687252 admin admin] PATH_INFO: `/v3/users/ea9539b80dd44bf3bee9badbc3f64210` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:24.844288 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162eda5d-975d-4272-977b-0eaf1c687252 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea9539b80dd44bf3bee9badbc3f64210)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:24.857983 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162eda5d-975d-4272-977b-0eaf1c687252 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:24.890396 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6314b-96c2-4577-b91c-e1f1daf9c037 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:24.906174 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274a1d7-0475-435e-93cd-6fe11eca3f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:24.907071 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274a1d7-0475-435e-93cd-6fe11eca3f6f admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:24.907457 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274a1d7-0475-435e-93cd-6fe11eca3f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:24.907874 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274a1d7-0475-435e-93cd-6fe11eca3f6f admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:24.908703 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274a1d7-0475-435e-93cd-6fe11eca3f6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:24.914600 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274a1d7-0475-435e-93cd-6fe11eca3f6f admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:24.987919 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 872/1738] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:53:24 2022] POST /identity/v3/projects => generated 381 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:53:25.000959 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844ba36-16a0-4486-9bc6-9009b9de4c7e None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:25.001417 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844ba36-16a0-4486-9bc6-9009b9de4c7e None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:25.001794 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844ba36-16a0-4486-9bc6-9009b9de4c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:25.007893 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-162eda5d-975d-4272-977b-0eaf1c687252 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea9539b80dd44bf3bee9badbc3f64210'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:25.029505 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-162eda5d-975d-4272-977b-0eaf1c687252 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea9539b80dd44bf3bee9badbc3f64210'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:25.031030 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-162eda5d-975d-4272-977b-0eaf1c687252 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea9539b80dd44bf3bee9badbc3f64210'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:25.044745 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-9844ba36-16a0-4486-9bc6-9009b9de4c7e None None] MFA Rules not processed for user `04bc6ee009e34a5f82e2807db51523d3`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:25.046714 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-9844ba36-16a0-4486-9bc6-9009b9de4c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:25.069819 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-162eda5d-975d-4272-977b-0eaf1c687252 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea9539b80dd44bf3bee9badbc3f64210'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:25.072064 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-162eda5d-975d-4272-977b-0eaf1c687252 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea9539b80dd44bf3bee9badbc3f64210'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:25.106653 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 867/1739] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:53:24 2022] DELETE /identity/v3/users/ea9539b80dd44bf3bee9badbc3f64210 => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:25.110294 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb0188-cd69-4cfa-b6a8-95bb39bd7cfc None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:25.114031 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb0188-cd69-4cfa-b6a8-95bb39bd7cfc None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:25.115936 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb0188-cd69-4cfa-b6a8-95bb39bd7cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:25.185157 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-beeb0188-cd69-4cfa-b6a8-95bb39bd7cfc None None] MFA Rules not processed for user `5dec57310b724afa966fd56650707e54`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:25.190455 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-beeb0188-cd69-4cfa-b6a8-95bb39bd7cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:25.319838 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 873/1740] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Oct 28 20:53:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:25.323667 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f94156-2dac-4ac4-a302-2917726efac0 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:25.324255 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f94156-2dac-4ac4-a302-2917726efac0 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:25.324721 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f94156-2dac-4ac4-a302-2917726efac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:25.443392 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-c3f94156-2dac-4ac4-a302-2917726efac0 None None] MFA Rules not processed for user `0b957a43ca2b419484079dbe6cfb0ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:25.454437 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-c3f94156-2dac-4ac4-a302-2917726efac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:25.505265 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 868/1741] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:25.506421 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb0188-cd69-4cfa-b6a8-95bb39bd7cfc None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:25.508828 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-beeb0188-cd69-4cfa-b6a8-95bb39bd7cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:25.755227 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 874/1742] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:25 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:25.757199 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f94156-2dac-4ac4-a302-2917726efac0 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:25.767656 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-c3f94156-2dac-4ac4-a302-2917726efac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:25.774297 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb0188-cd69-4cfa-b6a8-95bb39bd7cfc None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:25.797510 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0aac23-905f-43cb-bf88-b006c97bc3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:25.798993 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0aac23-905f-43cb-bf88-b006c97bc3da admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:25.799526 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0aac23-905f-43cb-bf88-b006c97bc3da admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:25.800120 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0aac23-905f-43cb-bf88-b006c97bc3da admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:25.801408 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0aac23-905f-43cb-bf88-b006c97bc3da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:25.805752 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0aac23-905f-43cb-bf88-b006c97bc3da admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:25.892584 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 869/1743] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:53:25 2022] POST /identity/v3/users => generated 297 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:53:25.897040 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0aac23-905f-43cb-bf88-b006c97bc3da admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:25.903220 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-af0aac23-905f-43cb-bf88-b006c97bc3da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:26.085442 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f94156-2dac-4ac4-a302-2917726efac0 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:26.096895 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17ce24-948a-4d10-aa7c-f402d78d5ec0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05029a41bd2b42febfd5ce91a3f28c24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:26.099795 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17ce24-948a-4d10-aa7c-f402d78d5ec0 service glance] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:26.099795 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17ce24-948a-4d10-aa7c-f402d78d5ec0 service glance] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:26.102482 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17ce24-948a-4d10-aa7c-f402d78d5ec0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:26.297088 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0aac23-905f-43cb-bf88-b006c97bc3da admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:26.325331 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d2141-19cc-4a2f-9dd5-e92466cf52ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:26.327786 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d2141-19cc-4a2f-9dd5-e92466cf52ba service nova] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:26.327786 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d2141-19cc-4a2f-9dd5-e92466cf52ba service nova] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:26.327786 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d2141-19cc-4a2f-9dd5-e92466cf52ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:26.342754 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17ce24-948a-4d10-aa7c-f402d78d5ec0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:26.353863 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17ce24-948a-4d10-aa7c-f402d78d5ec0 service glance] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:26.370072 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d2141-19cc-4a2f-9dd5-e92466cf52ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:26.381073 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d2141-19cc-4a2f-9dd5-e92466cf52ba service nova] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:26.411497 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 870/1744] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:53:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:53:26.413472 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d2141-19cc-4a2f-9dd5-e92466cf52ba service nova] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:26.415477 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-328d2141-19cc-4a2f-9dd5-e92466cf52ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:26.480249 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d2141-19cc-4a2f-9dd5-e92466cf52ba service nova] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:26.515219 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 875/1745] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:53:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 763 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:53:26.525187 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414f03c-0463-485d-b6b0-a3ec12c52771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:26.526072 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17ce24-948a-4d10-aa7c-f402d78d5ec0 service glance] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:26.528469 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414f03c-0463-485d-b6b0-a3ec12c52771 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:26.533576 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414f03c-0463-485d-b6b0-a3ec12c52771 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:26.539858 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414f03c-0463-485d-b6b0-a3ec12c52771 admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:26.543295 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5414f03c-0463-485d-b6b0-a3ec12c52771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:26.591724 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5414f03c-0463-485d-b6b0-a3ec12c52771 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:26.594268 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17ce24-948a-4d10-aa7c-f402d78d5ec0 service glance] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:26.625641 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e77564-a5a9-4b01-9dba-852c8d9d656d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:26.634072 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e77564-a5a9-4b01-9dba-852c8d9d656d admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:26.634945 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e77564-a5a9-4b01-9dba-852c8d9d656d admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:26.635621 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e77564-a5a9-4b01-9dba-852c8d9d656d admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:26.639069 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e77564-a5a9-4b01-9dba-852c8d9d656d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:26.652571 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e77564-a5a9-4b01-9dba-852c8d9d656d admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:26.786999 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 876/1746] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:53:26.788293 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e77564-a5a9-4b01-9dba-852c8d9d656d admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:26.844763 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e77564-a5a9-4b01-9dba-852c8d9d656d admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:26.854587 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 871/1747] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:53:26 2022] POST /identity/v3/projects => generated 355 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:53:26.861225 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414f03c-0463-485d-b6b0-a3ec12c52771 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:26.980570 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944c5d2-b051-4e49-b68e-36f382936816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:26.981722 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944c5d2-b051-4e49-b68e-36f382936816 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:26.982103 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944c5d2-b051-4e49-b68e-36f382936816 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:26.982530 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944c5d2-b051-4e49-b68e-36f382936816 admin admin] PATH_INFO: `/v3/projects/e20a0f95d1d6475c949113bfe3efda85/users/c5fb80df435848a2bb30de9492e6f90a/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:27.046687 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944c5d2-b051-4e49-b68e-36f382936816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e20a0f95d1d6475c949113bfe3efda85, user_id=c5fb80df435848a2bb30de9492e6f90a, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:27.053971 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944c5d2-b051-4e49-b68e-36f382936816 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:27.090533 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 877/1748] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:53:26 2022] PUT /identity/v3/projects/e20a0f95d1d6475c949113bfe3efda85/users/c5fb80df435848a2bb30de9492e6f90a/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:27.101901 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944c5d2-b051-4e49-b68e-36f382936816 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:27.120341 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414f03c-0463-485d-b6b0-a3ec12c52771 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:27.323320 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944c5d2-b051-4e49-b68e-36f382936816 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:27.326719 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b417a-09f6-43cd-86cb-638539ced97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:27.327775 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b417a-09f6-43cd-86cb-638539ced97a admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:27.328811 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b417a-09f6-43cd-86cb-638539ced97a admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:27.328811 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b417a-09f6-43cd-86cb-638539ced97a admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:27.330588 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b417a-09f6-43cd-86cb-638539ced97a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:27.336072 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b417a-09f6-43cd-86cb-638539ced97a admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:27.338274 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea59dd-dd19-4dbb-a6f8-26dc2afd9fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:27.339072 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea59dd-dd19-4dbb-a6f8-26dc2afd9fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:27.339357 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea59dd-dd19-4dbb-a6f8-26dc2afd9fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:27.339630 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea59dd-dd19-4dbb-a6f8-26dc2afd9fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:27.340508 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea59dd-dd19-4dbb-a6f8-26dc2afd9fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:27.345851 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea59dd-dd19-4dbb-a6f8-26dc2afd9fc2 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:27.371324 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 878/1749] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:53:27.377367 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875ae7d-b20e-45e5-ab4d-fd1a4ea08c70 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:27.378500 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875ae7d-b20e-45e5-ab4d-fd1a4ea08c70 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:27.381819 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875ae7d-b20e-45e5-ab4d-fd1a4ea08c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:27.396374 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 872/1750] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:53:26 2022] POST /identity/v3/users => generated 284 bytes in 536 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:53:27.398103 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b417a-09f6-43cd-86cb-638539ced97a admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:27.444379 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b417a-09f6-43cd-86cb-638539ced97a admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:27.463361 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691319c-99ae-44c3-be28-1cefd340b652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:27.468422 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691319c-99ae-44c3-be28-1cefd340b652 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:27.469983 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691319c-99ae-44c3-be28-1cefd340b652 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:27.470988 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691319c-99ae-44c3-be28-1cefd340b652 admin admin] PATH_INFO: `/v3/projects/e20a0f95d1d6475c949113bfe3efda85/users/c5fb80df435848a2bb30de9492e6f90a/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:27.488037 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691319c-99ae-44c3-be28-1cefd340b652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e20a0f95d1d6475c949113bfe3efda85, user_id=c5fb80df435848a2bb30de9492e6f90a, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:27.510945 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691319c-99ae-44c3-be28-1cefd340b652 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:27.516908 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-3875ae7d-b20e-45e5-ab4d-fd1a4ea08c70 None None] MFA Rules not processed for user `a9a00ca081c24dde98c89e398267133f`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:27.519715 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-3875ae7d-b20e-45e5-ab4d-fd1a4ea08c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:27.557575 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 873/1751] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:53:27 2022] PUT /identity/v3/projects/e20a0f95d1d6475c949113bfe3efda85/users/c5fb80df435848a2bb30de9492e6f90a/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:27.564318 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691319c-99ae-44c3-be28-1cefd340b652 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:27.791387 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 879/1752] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:27.793683 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f037b-1410-4113-b092-7cee55a08cf4 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:27.794180 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f037b-1410-4113-b092-7cee55a08cf4 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:27.794679 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f037b-1410-4113-b092-7cee55a08cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:27.812063 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691319c-99ae-44c3-be28-1cefd340b652 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:27.821697 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca0f35-0a4e-4295-8b82-6fea42692a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:27.822888 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca0f35-0a4e-4295-8b82-6fea42692a75 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:27.823423 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca0f35-0a4e-4295-8b82-6fea42692a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:27.823997 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca0f35-0a4e-4295-8b82-6fea42692a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:27.825491 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca0f35-0a4e-4295-8b82-6fea42692a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:27.829194 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca0f35-0a4e-4295-8b82-6fea42692a75 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:27.851679 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 874/1753] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:53:27.853429 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca0f35-0a4e-4295-8b82-6fea42692a75 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:27.901685 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-170f037b-1410-4113-b092-7cee55a08cf4 None None] MFA Rules not processed for user `c5fb80df435848a2bb30de9492e6f90a`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:27.904092 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-170f037b-1410-4113-b092-7cee55a08cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:28.116619 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca0f35-0a4e-4295-8b82-6fea42692a75 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:28.150838 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf4425-aa64-4980-a8f0-dea79128daae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:28.153856 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf4425-aa64-4980-a8f0-dea79128daae service nova] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:28.158205 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf4425-aa64-4980-a8f0-dea79128daae service nova] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:28.158778 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf4425-aa64-4980-a8f0-dea79128daae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:28.174062 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 880/1754] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:28.176765 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f037b-1410-4113-b092-7cee55a08cf4 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:28.227397 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f037b-1410-4113-b092-7cee55a08cf4 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:28.248024 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cae2a0-bfc0-4c62-9c61-0bc260b41328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:28.249628 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cae2a0-bfc0-4c62-9c61-0bc260b41328 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:28.250115 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cae2a0-bfc0-4c62-9c61-0bc260b41328 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:28.250927 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cae2a0-bfc0-4c62-9c61-0bc260b41328 admin admin] PATH_INFO: `/v3/projects/2f6b24bbfd184676aa76213dc4eadd6a/users/3f9e5b75038343e89d1f2c093a174587/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:28.350423 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cae2a0-bfc0-4c62-9c61-0bc260b41328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f6b24bbfd184676aa76213dc4eadd6a, user_id=3f9e5b75038343e89d1f2c093a174587, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:28.365911 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cae2a0-bfc0-4c62-9c61-0bc260b41328 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:28.396393 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf4425-aa64-4980-a8f0-dea79128daae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:28.401420 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf4425-aa64-4980-a8f0-dea79128daae service nova] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:28.404046 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 881/1755] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:53:28 2022] PUT /identity/v3/projects/2f6b24bbfd184676aa76213dc4eadd6a/users/3f9e5b75038343e89d1f2c093a174587/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:28.405016 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cae2a0-bfc0-4c62-9c61-0bc260b41328 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:28.410777 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-18cae2a0-bfc0-4c62-9c61-0bc260b41328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:28.436131 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 875/1756] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:53:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:53:28.440242 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf4425-aa64-4980-a8f0-dea79128daae service nova] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:28.482020 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf4425-aa64-4980-a8f0-dea79128daae service nova] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:28.512318 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cae2a0-bfc0-4c62-9c61-0bc260b41328 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:28.547411 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0dee9-3b3d-4fad-9b8f-9d4d6f345073 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:28.548856 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0dee9-3b3d-4fad-9b8f-9d4d6f345073 service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:28.551692 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0dee9-3b3d-4fad-9b8f-9d4d6f345073 service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:28.552231 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0dee9-3b3d-4fad-9b8f-9d4d6f345073 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:28.723712 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e583ce5-535f-4b3d-95fe-9933d4725ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:28.724469 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e583ce5-535f-4b3d-95fe-9933d4725ece admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:28.724829 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e583ce5-535f-4b3d-95fe-9933d4725ece admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:28.725181 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e583ce5-535f-4b3d-95fe-9933d4725ece admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:28.726683 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e583ce5-535f-4b3d-95fe-9933d4725ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:28.730608 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e583ce5-535f-4b3d-95fe-9933d4725ece admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:28.761546 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 876/1757] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:53:28.761546 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917377a2-d1ef-4abf-980e-5d7a1c59389c None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:28.762066 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917377a2-d1ef-4abf-980e-5d7a1c59389c None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:28.762371 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917377a2-d1ef-4abf-980e-5d7a1c59389c None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:28.767547 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 877/1758] 10.222.0.49 () {54 vars in 912 bytes} [Fri Oct 28 20:53:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:53:28.770121 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db46a42-7123-4eb0-bd7d-e849f8ee8167 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:28.774359 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db46a42-7123-4eb0-bd7d-e849f8ee8167 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:28.775103 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db46a42-7123-4eb0-bd7d-e849f8ee8167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:28.849559 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0dee9-3b3d-4fad-9b8f-9d4d6f345073 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:28.850498 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-8db46a42-7123-4eb0-bd7d-e849f8ee8167 None None] MFA Rules not processed for user `48c87597846e44f186da0c969a2579bf`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:28.851835 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-8db46a42-7123-4eb0-bd7d-e849f8ee8167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:28.852493 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0dee9-3b3d-4fad-9b8f-9d4d6f345073 service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:28.892121 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 882/1759] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:53:28 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:53:28.896967 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0dee9-3b3d-4fad-9b8f-9d4d6f345073 service cinder] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:28.952562 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0dee9-3b3d-4fad-9b8f-9d4d6f345073 service cinder] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:28.988941 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c67c0-c922-4c03-bd99-761ca97f57e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:28.990460 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c67c0-c922-4c03-bd99-761ca97f57e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:28.990955 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c67c0-c922-4c03-bd99-761ca97f57e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:28.991443 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c67c0-c922-4c03-bd99-761ca97f57e9 admin admin] PATH_INFO: `/v3/projects/2f6b24bbfd184676aa76213dc4eadd6a/users/3f9e5b75038343e89d1f2c093a174587/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:29.009681 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c67c0-c922-4c03-bd99-761ca97f57e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f6b24bbfd184676aa76213dc4eadd6a, user_id=3f9e5b75038343e89d1f2c093a174587, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:29.015269 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c67c0-c922-4c03-bd99-761ca97f57e9 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:29.083734 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 883/1760] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:53:28 2022] PUT /identity/v3/projects/2f6b24bbfd184676aa76213dc4eadd6a/users/3f9e5b75038343e89d1f2c093a174587/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:29.086729 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11011429-da95-4423-ae32-96b5ef3bb0aa None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:29.090575 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11011429-da95-4423-ae32-96b5ef3bb0aa None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:29.091348 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11011429-da95-4423-ae32-96b5ef3bb0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:29.125636 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 878/1761] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:29.125636 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db46a42-7123-4eb0-bd7d-e849f8ee8167 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:29.131545 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-8db46a42-7123-4eb0-bd7d-e849f8ee8167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:29.197253 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db46a42-7123-4eb0-bd7d-e849f8ee8167 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:29.273547 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-11011429-da95-4423-ae32-96b5ef3bb0aa None None] MFA Rules not processed for user `691a2da563a84da48ca8fd75a0bfe787`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:29.280044 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-11011429-da95-4423-ae32-96b5ef3bb0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:29.390500 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce10e22-5e15-44af-8cf4-84c91c9b0a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:29.392327 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce10e22-5e15-44af-8cf4-84c91c9b0a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:29.392616 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce10e22-5e15-44af-8cf4-84c91c9b0a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:29.393564 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce10e22-5e15-44af-8cf4-84c91c9b0a03 admin admin] PATH_INFO: `/v3/projects/c1835ccbff914cbb81b9ecd24f19f74c` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:29.395546 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce10e22-5e15-44af-8cf4-84c91c9b0a03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1835ccbff914cbb81b9ecd24f19f74c)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:29.400307 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce10e22-5e15-44af-8cf4-84c91c9b0a03 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:29.408073 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 884/1762] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Oct 28 20:53:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:29.410243 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a88fc1-a070-4b7c-a88c-7731c4e97e8d None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:29.410693 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a88fc1-a070-4b7c-a88c-7731c4e97e8d None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:29.411577 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a88fc1-a070-4b7c-a88c-7731c4e97e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:29.476338 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-24a88fc1-a070-4b7c-a88c-7731c4e97e8d None None] MFA Rules not processed for user `3f9e5b75038343e89d1f2c093a174587`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:29.478420 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-24a88fc1-a070-4b7c-a88c-7731c4e97e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:29.497410 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-7ce10e22-5e15-44af-8cf4-84c91c9b0a03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1835ccbff914cbb81b9ecd24f19f74c', 'request_id': 'req-7ce10e22-5e15-44af-8cf4-84c91c9b0a03'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:29.511899 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-7ce10e22-5e15-44af-8cf4-84c91c9b0a03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1835ccbff914cbb81b9ecd24f19f74c', 'request_id': 'req-7ce10e22-5e15-44af-8cf4-84c91c9b0a03'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:29.526984 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-7ce10e22-5e15-44af-8cf4-84c91c9b0a03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1835ccbff914cbb81b9ecd24f19f74c', 'request_id': 'req-7ce10e22-5e15-44af-8cf4-84c91c9b0a03'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:29.569030 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-7ce10e22-5e15-44af-8cf4-84c91c9b0a03 admin admin] The token cache is being invalidate because project c1835ccbff914cbb81b9ecd24f19f74c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:53:29.569294 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-7ce10e22-5e15-44af-8cf4-84c91c9b0a03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:29.572556 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-7ce10e22-5e15-44af-8cf4-84c91c9b0a03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:29.575621 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 879/1763] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:53:29 2022] DELETE /identity/v3/projects/c1835ccbff914cbb81b9ecd24f19f74c => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:29.580011 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a0384-7687-4d54-a935-05c6ad3041bd None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:29.580302 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a0384-7687-4d54-a935-05c6ad3041bd None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:29.590980 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a0384-7687-4d54-a935-05c6ad3041bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:29.648839 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-976a0384-7687-4d54-a935-05c6ad3041bd None None] MFA Rules not processed for user `48c87597846e44f186da0c969a2579bf`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:29.650426 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-976a0384-7687-4d54-a935-05c6ad3041bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:29.760075 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 885/1764] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:29 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:29.762668 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a88fc1-a070-4b7c-a88c-7731c4e97e8d None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:29.773596 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-24a88fc1-a070-4b7c-a88c-7731c4e97e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:29.896976 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 880/1765] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:29.907633 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a0384-7687-4d54-a935-05c6ad3041bd None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:29.914388 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-976a0384-7687-4d54-a935-05c6ad3041bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:30.058957 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a88fc1-a070-4b7c-a88c-7731c4e97e8d None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:30.085426 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01047d61-633f-4669-bbf5-f3afde86fbdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:30.088856 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01047d61-633f-4669-bbf5-f3afde86fbdd service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:30.104433 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01047d61-633f-4669-bbf5-f3afde86fbdd service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:30.104777 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01047d61-633f-4669-bbf5-f3afde86fbdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:30.125678 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-01047d61-633f-4669-bbf5-f3afde86fbdd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:30.165803 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a0384-7687-4d54-a935-05c6ad3041bd None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:30.179461 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d9f93-fe2b-4b5b-9a1b-742bf7533411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:30.181084 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d9f93-fe2b-4b5b-9a1b-742bf7533411 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:30.181986 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d9f93-fe2b-4b5b-9a1b-742bf7533411 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:30.182778 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d9f93-fe2b-4b5b-9a1b-742bf7533411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:30.186939 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-374d9f93-fe2b-4b5b-9a1b-742bf7533411 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:30.212632 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d9f93-fe2b-4b5b-9a1b-742bf7533411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:30.220416 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d9f93-fe2b-4b5b-9a1b-742bf7533411 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:30.241215 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 881/1766] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:53:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:53:30.244092 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe2e76-9892-4793-8e66-07419b406dbb None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:30.244963 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe2e76-9892-4793-8e66-07419b406dbb None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:30.245713 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe2e76-9892-4793-8e66-07419b406dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:30.302070 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01047d61-633f-4669-bbf5-f3afde86fbdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:30.306636 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01047d61-633f-4669-bbf5-f3afde86fbdd service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:30.333470 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 886/1767] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:53:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:53:30.334869 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60ab0d-4e56-43f0-9375-f3caa09aa63b None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:30.335158 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60ab0d-4e56-43f0-9375-f3caa09aa63b None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:30.335438 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60ab0d-4e56-43f0-9375-f3caa09aa63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:30.359781 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-a7fe2e76-9892-4793-8e66-07419b406dbb None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:30.365093 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-a7fe2e76-9892-4793-8e66-07419b406dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:30.390598 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-4d60ab0d-4e56-43f0-9375-f3caa09aa63b None None] MFA Rules not processed for user `7781cf44c6cb47a8adac1e187e9a8dac`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:30.391911 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-4d60ab0d-4e56-43f0-9375-f3caa09aa63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:30.637047 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 887/1768] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:30.637047 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60ab0d-4e56-43f0-9375-f3caa09aa63b None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:30.640517 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-4d60ab0d-4e56-43f0-9375-f3caa09aa63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:30.645333 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 882/1769] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:30.645333 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe2e76-9892-4793-8e66-07419b406dbb None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:30.663862 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-a7fe2e76-9892-4793-8e66-07419b406dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:30.712618 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60ab0d-4e56-43f0-9375-f3caa09aa63b None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:30.735382 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d5815-63e0-4dd2-9279-ba24950ecfd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:30.736789 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d5815-63e0-4dd2-9279-ba24950ecfd6 service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:30.738074 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d5815-63e0-4dd2-9279-ba24950ecfd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:30.738561 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d5815-63e0-4dd2-9279-ba24950ecfd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:30.775311 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d5815-63e0-4dd2-9279-ba24950ecfd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:30.796390 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d5815-63e0-4dd2-9279-ba24950ecfd6 service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:30.847866 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 888/1770] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:53:30 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:53:30.854589 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa7b27-86a0-4b99-b0e6-e6a9d49468b8 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:30.855111 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa7b27-86a0-4b99-b0e6-e6a9d49468b8 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:30.859872 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa7b27-86a0-4b99-b0e6-e6a9d49468b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:30.931876 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe2e76-9892-4793-8e66-07419b406dbb None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:30.957444 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae56b9-2301-4495-bdbd-e3965f0328a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:30.966080 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae56b9-2301-4495-bdbd-e3965f0328a1 service nova] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:30.966538 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae56b9-2301-4495-bdbd-e3965f0328a1 service nova] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:30.967011 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae56b9-2301-4495-bdbd-e3965f0328a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:30.968426 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-09aa7b27-86a0-4b99-b0e6-e6a9d49468b8 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:30.970490 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-09aa7b27-86a0-4b99-b0e6-e6a9d49468b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:30.973098 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-c2ae56b9-2301-4495-bdbd-e3965f0328a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:31.034377 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae56b9-2301-4495-bdbd-e3965f0328a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:31.039712 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae56b9-2301-4495-bdbd-e3965f0328a1 service nova] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:31.044057 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 889/1771] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:31.050005 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa7b27-86a0-4b99-b0e6-e6a9d49468b8 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:31.093203 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 883/1772] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:53:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:53:31.115077 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa7b27-86a0-4b99-b0e6-e6a9d49468b8 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:31.144574 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51114b5b-1652-434b-8a2e-d02e202f66b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:31.146147 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51114b5b-1652-434b-8a2e-d02e202f66b1 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:31.146970 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51114b5b-1652-434b-8a2e-d02e202f66b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:31.148063 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51114b5b-1652-434b-8a2e-d02e202f66b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:31.149970 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51114b5b-1652-434b-8a2e-d02e202f66b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:53:31.150773 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51114b5b-1652-434b-8a2e-d02e202f66b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:31.154530 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51114b5b-1652-434b-8a2e-d02e202f66b1 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:31.200538 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 890/1773] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:53:31.207482 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae56b9-2301-4495-bdbd-e3965f0328a1 service nova] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:31.230274 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51114b5b-1652-434b-8a2e-d02e202f66b1 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:31.241631 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae56b9-2301-4495-bdbd-e3965f0328a1 service nova] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:31.261139 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58608b12-fac1-43e6-a744-e47649e79d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:31.261734 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58608b12-fac1-43e6-a744-e47649e79d7b admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:31.262180 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58608b12-fac1-43e6-a744-e47649e79d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:31.262350 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58608b12-fac1-43e6-a744-e47649e79d7b admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:31.270942 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58608b12-fac1-43e6-a744-e47649e79d7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:31.272521 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51114b5b-1652-434b-8a2e-d02e202f66b1 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:31.274514 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58608b12-fac1-43e6-a744-e47649e79d7b admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:31.304708 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87654793-8dae-400c-bcdf-ce9043e2d53a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:31.306556 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87654793-8dae-400c-bcdf-ce9043e2d53a service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:31.307079 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87654793-8dae-400c-bcdf-ce9043e2d53a service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:31.307575 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87654793-8dae-400c-bcdf-ce9043e2d53a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:31.332459 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-87654793-8dae-400c-bcdf-ce9043e2d53a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:31.349906 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 884/1774] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:53:31 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:53:31.350850 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7b899-03e1-4773-8a29-d60cfee2b42c None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:31.361186 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7b899-03e1-4773-8a29-d60cfee2b42c None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:31.361476 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7b899-03e1-4773-8a29-d60cfee2b42c None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:31.375109 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 885/1775] 10.222.0.49 () {54 vars in 912 bytes} [Fri Oct 28 20:53:31 2022] GET /identity => generated 270 bytes in 28 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:53:31.380425 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7b899-03e1-4773-8a29-d60cfee2b42c None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:31.625212 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87654793-8dae-400c-bcdf-ce9043e2d53a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:31.626315 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7b899-03e1-4773-8a29-d60cfee2b42c None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:31.630279 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87654793-8dae-400c-bcdf-ce9043e2d53a service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:31.659584 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9dccb7-d77d-4c8c-baad-bf2fa64aabd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:31.660490 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9dccb7-d77d-4c8c-baad-bf2fa64aabd6 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:31.660837 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9dccb7-d77d-4c8c-baad-bf2fa64aabd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:31.661200 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9dccb7-d77d-4c8c-baad-bf2fa64aabd6 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:31.662045 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9dccb7-d77d-4c8c-baad-bf2fa64aabd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:31.664328 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9dccb7-d77d-4c8c-baad-bf2fa64aabd6 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:31.706835 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 886/1776] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:53:31 2022] POST /identity/v3/users => generated 293 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:53:31.710331 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11a91d-cbb1-4b4d-8b02-fd8a672c00d7 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:31.710929 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11a91d-cbb1-4b4d-8b02-fd8a672c00d7 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:31.711304 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11a91d-cbb1-4b4d-8b02-fd8a672c00d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:31.714643 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 891/1777] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:53:31 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:53:31.721924 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87654793-8dae-400c-bcdf-ce9043e2d53a service cinder] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:31.795536 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-dd11a91d-cbb1-4b4d-8b02-fd8a672c00d7 None None] MFA Rules not processed for user `04bc6ee009e34a5f82e2807db51523d3`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:31.801725 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-dd11a91d-cbb1-4b4d-8b02-fd8a672c00d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:31.807575 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87654793-8dae-400c-bcdf-ce9043e2d53a service cinder] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:31.861706 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f9dc0-e5a6-49de-ad82-d1a325e6f1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:31.866071 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f9dc0-e5a6-49de-ad82-d1a325e6f1b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:31.871643 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f9dc0-e5a6-49de-ad82-d1a325e6f1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:31.874368 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f9dc0-e5a6-49de-ad82-d1a325e6f1b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:31.883089 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f9dc0-e5a6-49de-ad82-d1a325e6f1b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:31.891925 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f9dc0-e5a6-49de-ad82-d1a325e6f1b3 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:31.993629 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 892/1778] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:53:32.006014 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f9dc0-e5a6-49de-ad82-d1a325e6f1b3 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:32.062239 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 887/1779] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Oct 28 20:53:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:32.064911 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11a91d-cbb1-4b4d-8b02-fd8a672c00d7 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:32.069664 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-dd11a91d-cbb1-4b4d-8b02-fd8a672c00d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:32.084046 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f9dc0-e5a6-49de-ad82-d1a325e6f1b3 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:32.106100 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8969d3-0aaa-46f6-a94c-293999496306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:32.107079 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8969d3-0aaa-46f6-a94c-293999496306 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:32.107398 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8969d3-0aaa-46f6-a94c-293999496306 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:32.107825 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8969d3-0aaa-46f6-a94c-293999496306 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:32.109409 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8969d3-0aaa-46f6-a94c-293999496306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:32.115144 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8969d3-0aaa-46f6-a94c-293999496306 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:32.163121 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 893/1780] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:53:32.169341 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8969d3-0aaa-46f6-a94c-293999496306 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:32.206630 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8969d3-0aaa-46f6-a94c-293999496306 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:32.239599 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a07511-bf7e-41ae-a6d8-8d13239a8042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:32.242774 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a07511-bf7e-41ae-a6d8-8d13239a8042 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:32.245939 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a07511-bf7e-41ae-a6d8-8d13239a8042 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:32.246754 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a07511-bf7e-41ae-a6d8-8d13239a8042 admin admin] PATH_INFO: `/v3/projects/2086d5f3412640b4b64aa1b2f61380b2/users/366d6e0cde3a45aa9a0d8a38ea35367b/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:32.312851 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11a91d-cbb1-4b4d-8b02-fd8a672c00d7 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:32.324175 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a07511-bf7e-41ae-a6d8-8d13239a8042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2086d5f3412640b4b64aa1b2f61380b2, user_id=366d6e0cde3a45aa9a0d8a38ea35367b, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:32.331776 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7740e-835d-4822-835a-507d101ce7a7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05029a41bd2b42febfd5ce91a3f28c24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:32.332872 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7740e-835d-4822-835a-507d101ce7a7 service glance] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:32.333556 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7740e-835d-4822-835a-507d101ce7a7 service glance] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:32.334240 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7740e-835d-4822-835a-507d101ce7a7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:32.339482 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a07511-bf7e-41ae-a6d8-8d13239a8042 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:32.398429 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7740e-835d-4822-835a-507d101ce7a7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:32.421056 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7740e-835d-4822-835a-507d101ce7a7 service glance] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:32.425787 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 894/1781] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:53:32 2022] PUT /identity/v3/projects/2086d5f3412640b4b64aa1b2f61380b2/users/366d6e0cde3a45aa9a0d8a38ea35367b/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:53:32.458777 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668645a8-4ddc-4b2e-a1ca-6b272fd89d36 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:32.460931 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668645a8-4ddc-4b2e-a1ca-6b272fd89d36 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:32.462496 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668645a8-4ddc-4b2e-a1ca-6b272fd89d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:32.515684 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 888/1782] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:53:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:53:32.572677 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-668645a8-4ddc-4b2e-a1ca-6b272fd89d36 None None] MFA Rules not processed for user `366d6e0cde3a45aa9a0d8a38ea35367b`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:32.576381 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-668645a8-4ddc-4b2e-a1ca-6b272fd89d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:32.882345 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7740e-835d-4822-835a-507d101ce7a7 service glance] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:32.884109 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-12c7740e-835d-4822-835a-507d101ce7a7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:33.021910 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 895/1783] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 574 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:33.028265 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668645a8-4ddc-4b2e-a1ca-6b272fd89d36 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:33.089297 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7740e-835d-4822-835a-507d101ce7a7 service glance] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:33.425579 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668645a8-4ddc-4b2e-a1ca-6b272fd89d36 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:33.458420 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade299e7-37f2-4e98-8451-c55164fd4807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:33.459801 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade299e7-37f2-4e98-8451-c55164fd4807 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:33.460299 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade299e7-37f2-4e98-8451-c55164fd4807 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:33.461532 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade299e7-37f2-4e98-8451-c55164fd4807 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:33.462572 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade299e7-37f2-4e98-8451-c55164fd4807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:33.466998 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade299e7-37f2-4e98-8451-c55164fd4807 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:33.504619 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994b84d-01e7-482a-8aef-736f48750983 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '938634e835b94a75af698aef6941958f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:33.506188 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994b84d-01e7-482a-8aef-736f48750983 service placement] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:33.506188 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994b84d-01e7-482a-8aef-736f48750983 service placement] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:33.506929 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994b84d-01e7-482a-8aef-736f48750983 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:33.509253 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-e994b84d-01e7-482a-8aef-736f48750983 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:33.548796 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e994b84d-01e7-482a-8aef-736f48750983 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:33.551165 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e994b84d-01e7-482a-8aef-736f48750983 service placement] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:33.595139 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 896/1784] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:53:33 2022] POST /identity/v3/projects => generated 387 bytes in 563 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:53:33.599057 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade299e7-37f2-4e98-8451-c55164fd4807 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:33.609137 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 889/1785] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:53:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 728 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:53:33.899345 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01848b0e-2aa0-409e-84c1-ffd05af2ce04 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:33.900617 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01848b0e-2aa0-409e-84c1-ffd05af2ce04 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:33.901045 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01848b0e-2aa0-409e-84c1-ffd05af2ce04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:33.903823 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade299e7-37f2-4e98-8451-c55164fd4807 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:33.917962 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83f0ba-861e-45ad-ad1a-8ac27eeddc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:33.919060 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83f0ba-861e-45ad-ad1a-8ac27eeddc76 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:33.920876 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83f0ba-861e-45ad-ad1a-8ac27eeddc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:33.923886 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83f0ba-861e-45ad-ad1a-8ac27eeddc76 admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:33.928674 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83f0ba-861e-45ad-ad1a-8ac27eeddc76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:33.933167 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83f0ba-861e-45ad-ad1a-8ac27eeddc76 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:33.945895 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-01848b0e-2aa0-409e-84c1-ffd05af2ce04 None None] MFA Rules not processed for user `a9a00ca081c24dde98c89e398267133f`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:33.947405 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-01848b0e-2aa0-409e-84c1-ffd05af2ce04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:34.000424 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 897/1786] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:53:33 2022] POST /identity/v3/users => generated 300 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:53:34.001413 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83f0ba-861e-45ad-ad1a-8ac27eeddc76 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:34.020766 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83f0ba-861e-45ad-ad1a-8ac27eeddc76 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:34.034469 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206e6fa-cd95-42ff-b048-447583fbcf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:34.035782 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206e6fa-cd95-42ff-b048-447583fbcf53 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:34.036123 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206e6fa-cd95-42ff-b048-447583fbcf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:34.036855 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206e6fa-cd95-42ff-b048-447583fbcf53 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:34.037626 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206e6fa-cd95-42ff-b048-447583fbcf53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:34.043185 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206e6fa-cd95-42ff-b048-447583fbcf53 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:34.075786 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 898/1787] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:53:34.076944 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206e6fa-cd95-42ff-b048-447583fbcf53 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:34.115613 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206e6fa-cd95-42ff-b048-447583fbcf53 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:34.142347 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f2bf7-7921-424b-80ac-93899b377cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:34.143982 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f2bf7-7921-424b-80ac-93899b377cf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:34.144274 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f2bf7-7921-424b-80ac-93899b377cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:34.144738 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f2bf7-7921-424b-80ac-93899b377cf5 admin admin] PATH_INFO: `/v3/projects/481889457b1f4e85b7f57dbec2da4ba2/users/d1ae88b1ea844f4fbf849ca4c19d27c4/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:34.180811 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 890/1788] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:53:34.186311 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f2bf7-7921-424b-80ac-93899b377cf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=481889457b1f4e85b7f57dbec2da4ba2, user_id=d1ae88b1ea844f4fbf849ca4c19d27c4, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:34.189342 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f2bf7-7921-424b-80ac-93899b377cf5 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:34.227621 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 899/1789] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:53:34 2022] PUT /identity/v3/projects/481889457b1f4e85b7f57dbec2da4ba2/users/d1ae88b1ea844f4fbf849ca4c19d27c4/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:34.232162 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01848b0e-2aa0-409e-84c1-ffd05af2ce04 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:34.261378 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01848b0e-2aa0-409e-84c1-ffd05af2ce04 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:34.511197 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc43117-3b78-49f7-9785-f5f127664ea2 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:34.511583 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc43117-3b78-49f7-9785-f5f127664ea2 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:34.511959 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc43117-3b78-49f7-9785-f5f127664ea2 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:34.513985 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 900/1790] 10.222.0.49 () {54 vars in 912 bytes} [Fri Oct 28 20:53:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:53:34.530708 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb33f53-d3c8-433b-8858-506c4825895b None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:34.531066 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb33f53-d3c8-433b-8858-506c4825895b None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:34.531395 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb33f53-d3c8-433b-8858-506c4825895b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:34.580099 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-6bb33f53-d3c8-433b-8858-506c4825895b None None] MFA Rules not processed for user `691a2da563a84da48ca8fd75a0bfe787`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:34.581922 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6c5e5-47c9-474b-8f1e-8d866640392c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:34.582642 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-6bb33f53-d3c8-433b-8858-506c4825895b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:34.582774 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6c5e5-47c9-474b-8f1e-8d866640392c admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:34.583006 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6c5e5-47c9-474b-8f1e-8d866640392c admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:34.584851 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6c5e5-47c9-474b-8f1e-8d866640392c admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:34.589278 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6c5e5-47c9-474b-8f1e-8d866640392c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:34.593001 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6c5e5-47c9-474b-8f1e-8d866640392c admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:34.619066 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 891/1791] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:53:34.623234 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6c5e5-47c9-474b-8f1e-8d866640392c admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:34.649311 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6c5e5-47c9-474b-8f1e-8d866640392c admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:34.662289 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6fe0b-3ca9-4f50-8c6d-749dc6fa7337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:34.663210 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6fe0b-3ca9-4f50-8c6d-749dc6fa7337 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:34.664704 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6fe0b-3ca9-4f50-8c6d-749dc6fa7337 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:34.665005 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6fe0b-3ca9-4f50-8c6d-749dc6fa7337 admin admin] PATH_INFO: `/v3/projects/481889457b1f4e85b7f57dbec2da4ba2/users/d1ae88b1ea844f4fbf849ca4c19d27c4/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:34.676090 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6fe0b-3ca9-4f50-8c6d-749dc6fa7337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=481889457b1f4e85b7f57dbec2da4ba2, user_id=d1ae88b1ea844f4fbf849ca4c19d27c4, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:34.678548 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6fe0b-3ca9-4f50-8c6d-749dc6fa7337 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:34.743545 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 892/1792] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:53:34 2022] PUT /identity/v3/projects/481889457b1f4e85b7f57dbec2da4ba2/users/d1ae88b1ea844f4fbf849ca4c19d27c4/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:34.775328 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183f3da-9b67-4a26-bff9-fcb8b75cf79f None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:34.775615 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183f3da-9b67-4a26-bff9-fcb8b75cf79f None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:34.775914 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183f3da-9b67-4a26-bff9-fcb8b75cf79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:34.855998 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-0183f3da-9b67-4a26-bff9-fcb8b75cf79f None None] MFA Rules not processed for user `d1ae88b1ea844f4fbf849ca4c19d27c4`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:34.866240 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-0183f3da-9b67-4a26-bff9-fcb8b75cf79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:34.876319 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 901/1793] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Oct 28 20:53:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:34.965589 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb33f53-d3c8-433b-8858-506c4825895b None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:34.979155 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb33f53-d3c8-433b-8858-506c4825895b None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:35.131891 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0a075-e7c0-4158-82c4-466de6bd9db6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:35.133098 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0a075-e7c0-4158-82c4-466de6bd9db6 service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:35.133563 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0a075-e7c0-4158-82c4-466de6bd9db6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:35.134177 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0a075-e7c0-4158-82c4-466de6bd9db6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:35.151802 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0a075-e7c0-4158-82c4-466de6bd9db6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:35.154851 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0a075-e7c0-4158-82c4-466de6bd9db6 service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:35.175710 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 902/1794] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:53:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:53:35.211992 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 893/1795] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:34 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:35.243714 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0a075-e7c0-4158-82c4-466de6bd9db6 service neutron] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:35.421605 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0a075-e7c0-4158-82c4-466de6bd9db6 service neutron] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:35.428637 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d178a16-e74f-47ad-ab8d-8d76b0da0758 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:35.429579 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d178a16-e74f-47ad-ab8d-8d76b0da0758 service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:35.430059 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d178a16-e74f-47ad-ab8d-8d76b0da0758 service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:35.430526 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d178a16-e74f-47ad-ab8d-8d76b0da0758 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:35.449869 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d178a16-e74f-47ad-ab8d-8d76b0da0758 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:35.454883 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d178a16-e74f-47ad-ab8d-8d76b0da0758 service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:35.492168 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 903/1796] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:53:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:53:36.070926 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183f3da-9b67-4a26-bff9-fcb8b75cf79f None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:36.072690 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-0183f3da-9b67-4a26-bff9-fcb8b75cf79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:36.143267 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaae673-bdf0-471c-a2e6-0e2914003b83 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:36.144051 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaae673-bdf0-471c-a2e6-0e2914003b83 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:36.144416 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaae673-bdf0-471c-a2e6-0e2914003b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:36.167306 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-5eaae673-bdf0-471c-a2e6-0e2914003b83 None None] MFA Rules not processed for user `5dec57310b724afa966fd56650707e54`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:36.168323 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-5eaae673-bdf0-471c-a2e6-0e2914003b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:36.267612 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 904/1797] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:36.332057 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183f3da-9b67-4a26-bff9-fcb8b75cf79f None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:36.355398 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff5907-818c-4ff2-84b0-65099c04b95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:36.357829 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff5907-818c-4ff2-84b0-65099c04b95b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:36.358535 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff5907-818c-4ff2-84b0-65099c04b95b admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:36.359587 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff5907-818c-4ff2-84b0-65099c04b95b admin admin] PATH_INFO: `/v3/users/0549dd6e9ea84266af8ebc546838a425` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:36.364770 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff5907-818c-4ff2-84b0-65099c04b95b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0549dd6e9ea84266af8ebc546838a425)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:36.376282 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff5907-818c-4ff2-84b0-65099c04b95b admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:36.575288 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-b5ff5907-818c-4ff2-84b0-65099c04b95b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0549dd6e9ea84266af8ebc546838a425'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:36.611381 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-b5ff5907-818c-4ff2-84b0-65099c04b95b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0549dd6e9ea84266af8ebc546838a425'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:36.617435 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-b5ff5907-818c-4ff2-84b0-65099c04b95b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0549dd6e9ea84266af8ebc546838a425'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:36.649491 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-b5ff5907-818c-4ff2-84b0-65099c04b95b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0549dd6e9ea84266af8ebc546838a425'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:36.651518 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-b5ff5907-818c-4ff2-84b0-65099c04b95b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0549dd6e9ea84266af8ebc546838a425'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:36.711953 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 894/1798] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:53:36 2022] DELETE /identity/v3/users/0549dd6e9ea84266af8ebc546838a425 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:36.720507 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf737950-2aee-40af-8d10-4696fb7d6de5 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:36.721723 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf737950-2aee-40af-8d10-4696fb7d6de5 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:36.722400 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf737950-2aee-40af-8d10-4696fb7d6de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:36.821902 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-cf737950-2aee-40af-8d10-4696fb7d6de5 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:36.823285 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-cf737950-2aee-40af-8d10-4696fb7d6de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:37.078115 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 905/1799] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:37.093882 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff5907-818c-4ff2-84b0-65099c04b95b admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:37.099030 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-b5ff5907-818c-4ff2-84b0-65099c04b95b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:37.405605 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff5907-818c-4ff2-84b0-65099c04b95b admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:37.432387 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46660b76-7ba7-448f-b582-0d21b95d5aa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:37.433365 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46660b76-7ba7-448f-b582-0d21b95d5aa8 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:37.436209 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46660b76-7ba7-448f-b582-0d21b95d5aa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:37.436498 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46660b76-7ba7-448f-b582-0d21b95d5aa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:37.490659 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46660b76-7ba7-448f-b582-0d21b95d5aa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:37.492590 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46660b76-7ba7-448f-b582-0d21b95d5aa8 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:37.526880 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 895/1800] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:53:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:53:37.701032 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf737950-2aee-40af-8d10-4696fb7d6de5 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:37.710701 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-cf737950-2aee-40af-8d10-4696fb7d6de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:37.860560 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf737950-2aee-40af-8d10-4696fb7d6de5 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:37.887532 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d5218-5107-4657-a322-d21171634e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:37.893210 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d5218-5107-4657-a322-d21171634e50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:37.896554 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d5218-5107-4657-a322-d21171634e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:37.898312 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d5218-5107-4657-a322-d21171634e50 admin admin] PATH_INFO: `/v3/users/366d6e0cde3a45aa9a0d8a38ea35367b` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:37.905603 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d5218-5107-4657-a322-d21171634e50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=366d6e0cde3a45aa9a0d8a38ea35367b)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:37.914150 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d5218-5107-4657-a322-d21171634e50 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:38.140395 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-358d5218-5107-4657-a322-d21171634e50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '366d6e0cde3a45aa9a0d8a38ea35367b'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:38.167931 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-358d5218-5107-4657-a322-d21171634e50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '366d6e0cde3a45aa9a0d8a38ea35367b'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:38.188642 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-358d5218-5107-4657-a322-d21171634e50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '366d6e0cde3a45aa9a0d8a38ea35367b'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:38.191282 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-358d5218-5107-4657-a322-d21171634e50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '366d6e0cde3a45aa9a0d8a38ea35367b'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:38.242155 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-358d5218-5107-4657-a322-d21171634e50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '366d6e0cde3a45aa9a0d8a38ea35367b'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:38.272754 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 906/1801] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:53:37 2022] DELETE /identity/v3/users/366d6e0cde3a45aa9a0d8a38ea35367b => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:38.278994 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7289c-b765-460e-82b5-8df12cf66a5c None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:38.280606 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7289c-b765-460e-82b5-8df12cf66a5c None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:38.281261 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7289c-b765-460e-82b5-8df12cf66a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:38.352140 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-dae7289c-b765-460e-82b5-8df12cf66a5c None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:38.354728 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-dae7289c-b765-460e-82b5-8df12cf66a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:38.548894 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 896/1802] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:53:38.623966 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d5218-5107-4657-a322-d21171634e50 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:38.625032 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53858355-b9c6-4f9f-83b9-292709c4e8e1 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:38.625604 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53858355-b9c6-4f9f-83b9-292709c4e8e1 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:38.627125 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53858355-b9c6-4f9f-83b9-292709c4e8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:38.631484 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-358d5218-5107-4657-a322-d21171634e50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:38.742874 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-53858355-b9c6-4f9f-83b9-292709c4e8e1 None None] MFA Rules not processed for user `78cde480dd8b4a85ac30895026bfc406`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:38.756325 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-53858355-b9c6-4f9f-83b9-292709c4e8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:39.005493 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d5218-5107-4657-a322-d21171634e50 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:39.032427 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4e4f9-3274-41a0-9565-844f6ca9e710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:39.033239 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4e4f9-3274-41a0-9565-844f6ca9e710 service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:39.036375 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4e4f9-3274-41a0-9565-844f6ca9e710 service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:39.036713 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4e4f9-3274-41a0-9565-844f6ca9e710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:39.069839 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4e4f9-3274-41a0-9565-844f6ca9e710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:39.074528 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4e4f9-3274-41a0-9565-844f6ca9e710 service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:39.101624 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 907/1803] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:53:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:53:39.135552 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 897/1804] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Oct 28 20:53:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 515 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:39.570879 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4e4f9-3274-41a0-9565-844f6ca9e710 service neutron] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:39.574773 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-26a4e4f9-3274-41a0-9565-844f6ca9e710 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:39.921783 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4e4f9-3274-41a0-9565-844f6ca9e710 service neutron] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:39.943079 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8398072-34ff-40f3-b7e7-771ffcdde47d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d70db11d2d4923943bc6479bc49206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:39.943808 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8398072-34ff-40f3-b7e7-771ffcdde47d service swift] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:39.944423 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8398072-34ff-40f3-b7e7-771ffcdde47d service swift] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:39.944714 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8398072-34ff-40f3-b7e7-771ffcdde47d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:39.970114 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8398072-34ff-40f3-b7e7-771ffcdde47d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:39.972507 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8398072-34ff-40f3-b7e7-771ffcdde47d service swift] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:39.995317 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 908/1805] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Oct 28 20:53:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 20:53:41.151353 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53858355-b9c6-4f9f-83b9-292709c4e8e1 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:41.154408 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-53858355-b9c6-4f9f-83b9-292709c4e8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:41.317495 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53858355-b9c6-4f9f-83b9-292709c4e8e1 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:41.359805 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef0949-4615-4282-a587-e1ffebd1ac5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:41.367782 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef0949-4615-4282-a587-e1ffebd1ac5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:41.369202 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef0949-4615-4282-a587-e1ffebd1ac5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:41.369576 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef0949-4615-4282-a587-e1ffebd1ac5b admin admin] PATH_INFO: `/v3/projects/95660b6a07174c2e89cb291e8bb002cd` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:41.386856 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef0949-4615-4282-a587-e1ffebd1ac5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=95660b6a07174c2e89cb291e8bb002cd)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:41.407717 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef0949-4615-4282-a587-e1ffebd1ac5b admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:41.727211 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-7fef0949-4615-4282-a587-e1ffebd1ac5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95660b6a07174c2e89cb291e8bb002cd', 'request_id': 'req-7fef0949-4615-4282-a587-e1ffebd1ac5b'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:41.755269 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e5d49-da03-4a32-b728-6374decffda5 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:41.756238 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e5d49-da03-4a32-b728-6374decffda5 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:41.756238 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e5d49-da03-4a32-b728-6374decffda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:41.758707 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-7fef0949-4615-4282-a587-e1ffebd1ac5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95660b6a07174c2e89cb291e8bb002cd', 'request_id': 'req-7fef0949-4615-4282-a587-e1ffebd1ac5b'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:41.800825 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-7fef0949-4615-4282-a587-e1ffebd1ac5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95660b6a07174c2e89cb291e8bb002cd', 'request_id': 'req-7fef0949-4615-4282-a587-e1ffebd1ac5b'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:41.852727 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-7d0e5d49-da03-4a32-b728-6374decffda5 None None] MFA Rules not processed for user `691a2da563a84da48ca8fd75a0bfe787`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:41.861056 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-7d0e5d49-da03-4a32-b728-6374decffda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:41.927405 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-7fef0949-4615-4282-a587-e1ffebd1ac5b admin admin] The token cache is being invalidate because project 95660b6a07174c2e89cb291e8bb002cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:53:41.928367 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-7fef0949-4615-4282-a587-e1ffebd1ac5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:41.942240 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-7fef0949-4615-4282-a587-e1ffebd1ac5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:41.955490 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 898/1806] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:53:41 2022] DELETE /identity/v3/projects/95660b6a07174c2e89cb291e8bb002cd => generated 0 bytes in 806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:41.957990 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef0949-4615-4282-a587-e1ffebd1ac5b admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:41.969214 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-7fef0949-4615-4282-a587-e1ffebd1ac5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:42.166594 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef0949-4615-4282-a587-e1ffebd1ac5b admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:42.172790 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c40ac4-9fc0-48c7-b0a0-46cb2627f41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:42.173417 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c40ac4-9fc0-48c7-b0a0-46cb2627f41f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:42.173707 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c40ac4-9fc0-48c7-b0a0-46cb2627f41f admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:42.174001 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c40ac4-9fc0-48c7-b0a0-46cb2627f41f admin admin] PATH_INFO: `/v3/projects/2086d5f3412640b4b64aa1b2f61380b2` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:42.190087 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c40ac4-9fc0-48c7-b0a0-46cb2627f41f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2086d5f3412640b4b64aa1b2f61380b2)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:42.190441 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 909/1807] 10.222.0.26 () {58 vars in 1015 bytes} [Fri Oct 28 20:53:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:42.193669 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e5d49-da03-4a32-b728-6374decffda5 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:42.198116 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c40ac4-9fc0-48c7-b0a0-46cb2627f41f admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:42.213452 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-7d0e5d49-da03-4a32-b728-6374decffda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:42.281582 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e5d49-da03-4a32-b728-6374decffda5 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:42.289469 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a16d2-ace6-4e7f-b877-e55e0b814550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:42.290908 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a16d2-ace6-4e7f-b877-e55e0b814550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:42.292132 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a16d2-ace6-4e7f-b877-e55e0b814550 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:42.295549 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a16d2-ace6-4e7f-b877-e55e0b814550 admin admin] PATH_INFO: `/v3/users/c5fb80df435848a2bb30de9492e6f90a` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:42.300662 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a16d2-ace6-4e7f-b877-e55e0b814550 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5fb80df435848a2bb30de9492e6f90a)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:42.306016 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a16d2-ace6-4e7f-b877-e55e0b814550 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:42.411594 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-70c40ac4-9fc0-48c7-b0a0-46cb2627f41f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2086d5f3412640b4b64aa1b2f61380b2', 'request_id': 'req-70c40ac4-9fc0-48c7-b0a0-46cb2627f41f'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:42.428350 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-70c40ac4-9fc0-48c7-b0a0-46cb2627f41f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2086d5f3412640b4b64aa1b2f61380b2', 'request_id': 'req-70c40ac4-9fc0-48c7-b0a0-46cb2627f41f'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:42.442200 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-70c40ac4-9fc0-48c7-b0a0-46cb2627f41f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2086d5f3412640b4b64aa1b2f61380b2', 'request_id': 'req-70c40ac4-9fc0-48c7-b0a0-46cb2627f41f'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:42.473678 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-70c40ac4-9fc0-48c7-b0a0-46cb2627f41f admin admin] The token cache is being invalidate because project 2086d5f3412640b4b64aa1b2f61380b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:53:42.474033 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-70c40ac4-9fc0-48c7-b0a0-46cb2627f41f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:42.474831 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-70c40ac4-9fc0-48c7-b0a0-46cb2627f41f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:42.477005 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 899/1808] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:53:41 2022] DELETE /identity/v3/projects/2086d5f3412640b4b64aa1b2f61380b2 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:42.477506 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c40ac4-9fc0-48c7-b0a0-46cb2627f41f admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:42.483210 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-70c40ac4-9fc0-48c7-b0a0-46cb2627f41f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:42.490859 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-954a16d2-ace6-4e7f-b877-e55e0b814550 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5fb80df435848a2bb30de9492e6f90a'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:42.528476 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-954a16d2-ace6-4e7f-b877-e55e0b814550 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5fb80df435848a2bb30de9492e6f90a'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:42.569439 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-954a16d2-ace6-4e7f-b877-e55e0b814550 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5fb80df435848a2bb30de9492e6f90a'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:42.570899 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-954a16d2-ace6-4e7f-b877-e55e0b814550 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5fb80df435848a2bb30de9492e6f90a'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:42.628711 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-954a16d2-ace6-4e7f-b877-e55e0b814550 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5fb80df435848a2bb30de9492e6f90a'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:42.669801 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 910/1809] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:53:42 2022] DELETE /identity/v3/users/c5fb80df435848a2bb30de9492e6f90a => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:42.671829 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a16d2-ace6-4e7f-b877-e55e0b814550 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:42.680895 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-954a16d2-ace6-4e7f-b877-e55e0b814550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:42.771074 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c40ac4-9fc0-48c7-b0a0-46cb2627f41f admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:43.016495 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a16d2-ace6-4e7f-b877-e55e0b814550 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:43.034355 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0877f-8b0a-407f-9a65-1cbc3fef0e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:43.037321 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0877f-8b0a-407f-9a65-1cbc3fef0e23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:43.042788 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0877f-8b0a-407f-9a65-1cbc3fef0e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:43.047304 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0877f-8b0a-407f-9a65-1cbc3fef0e23 admin admin] PATH_INFO: `/v3/users/d1ae88b1ea844f4fbf849ca4c19d27c4` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:43.051038 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae0877f-8b0a-407f-9a65-1cbc3fef0e23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1ae88b1ea844f4fbf849ca4c19d27c4)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:43.060514 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae0877f-8b0a-407f-9a65-1cbc3fef0e23 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:43.060816 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700a4a2-d477-41ef-b139-d260a8e3860d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:43.062821 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700a4a2-d477-41ef-b139-d260a8e3860d service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:43.063118 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700a4a2-d477-41ef-b139-d260a8e3860d service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:43.067188 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700a4a2-d477-41ef-b139-d260a8e3860d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:43.106152 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-7700a4a2-d477-41ef-b139-d260a8e3860d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:43.186948 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700a4a2-d477-41ef-b139-d260a8e3860d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:43.195396 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700a4a2-d477-41ef-b139-d260a8e3860d service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:43.264587 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 900/1810] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:53:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 787 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:53:43.362843 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-bae0877f-8b0a-407f-9a65-1cbc3fef0e23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1ae88b1ea844f4fbf849ca4c19d27c4'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:43.417184 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-bae0877f-8b0a-407f-9a65-1cbc3fef0e23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1ae88b1ea844f4fbf849ca4c19d27c4'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:43.447225 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-bae0877f-8b0a-407f-9a65-1cbc3fef0e23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1ae88b1ea844f4fbf849ca4c19d27c4'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:43.448067 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-bae0877f-8b0a-407f-9a65-1cbc3fef0e23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1ae88b1ea844f4fbf849ca4c19d27c4'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:43.485628 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-bae0877f-8b0a-407f-9a65-1cbc3fef0e23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1ae88b1ea844f4fbf849ca4c19d27c4'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:43.496838 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 911/1811] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:53:42 2022] DELETE /identity/v3/users/d1ae88b1ea844f4fbf849ca4c19d27c4 => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:43.826424 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a75d9-26ee-4008-bc5e-a752116bcc69 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:43.827124 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a75d9-26ee-4008-bc5e-a752116bcc69 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:43.827612 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a75d9-26ee-4008-bc5e-a752116bcc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:43.925053 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-114a75d9-26ee-4008-bc5e-a752116bcc69 None None] MFA Rules not processed for user `48c87597846e44f186da0c969a2579bf`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:43.937471 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-114a75d9-26ee-4008-bc5e-a752116bcc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:44.160637 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 901/1812] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:44.393149 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0877f-8b0a-407f-9a65-1cbc3fef0e23 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:44.401895 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-bae0877f-8b0a-407f-9a65-1cbc3fef0e23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:44.731941 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0877f-8b0a-407f-9a65-1cbc3fef0e23 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:44.748000 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa1e04-7ea0-41f7-b7b1-212272f042b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:44.749349 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa1e04-7ea0-41f7-b7b1-212272f042b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:44.749896 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa1e04-7ea0-41f7-b7b1-212272f042b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:44.750511 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa1e04-7ea0-41f7-b7b1-212272f042b7 admin admin] PATH_INFO: `/v3/projects/e20a0f95d1d6475c949113bfe3efda85` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:44.752869 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa1e04-7ea0-41f7-b7b1-212272f042b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e20a0f95d1d6475c949113bfe3efda85)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:44.755503 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa1e04-7ea0-41f7-b7b1-212272f042b7 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:44.904222 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-74fa1e04-7ea0-41f7-b7b1-212272f042b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e20a0f95d1d6475c949113bfe3efda85', 'request_id': 'req-74fa1e04-7ea0-41f7-b7b1-212272f042b7'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:44.918483 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-74fa1e04-7ea0-41f7-b7b1-212272f042b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e20a0f95d1d6475c949113bfe3efda85', 'request_id': 'req-74fa1e04-7ea0-41f7-b7b1-212272f042b7'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:44.938676 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-74fa1e04-7ea0-41f7-b7b1-212272f042b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e20a0f95d1d6475c949113bfe3efda85', 'request_id': 'req-74fa1e04-7ea0-41f7-b7b1-212272f042b7'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:44.980752 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-74fa1e04-7ea0-41f7-b7b1-212272f042b7 admin admin] The token cache is being invalidate because project e20a0f95d1d6475c949113bfe3efda85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:53:44.981519 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-74fa1e04-7ea0-41f7-b7b1-212272f042b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:44.982701 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-74fa1e04-7ea0-41f7-b7b1-212272f042b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:44.989329 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 912/1813] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:53:44 2022] DELETE /identity/v3/projects/e20a0f95d1d6475c949113bfe3efda85 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:44.993884 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2230c-c239-492e-bbc6-10c12d9c9522 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:44.994960 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2230c-c239-492e-bbc6-10c12d9c9522 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:44.995238 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2230c-c239-492e-bbc6-10c12d9c9522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:45.025181 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-8cd2230c-c239-492e-bbc6-10c12d9c9522 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:45.027131 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-8cd2230c-c239-492e-bbc6-10c12d9c9522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:45.134447 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 902/1814] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:53:45.135909 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd42875-f2d6-408c-8ddd-2682ab119b5b None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:45.136380 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd42875-f2d6-408c-8ddd-2682ab119b5b None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:45.136845 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd42875-f2d6-408c-8ddd-2682ab119b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:45.217537 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-ddd42875-f2d6-408c-8ddd-2682ab119b5b None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:45.224785 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-ddd42875-f2d6-408c-8ddd-2682ab119b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:45.284193 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2230c-c239-492e-bbc6-10c12d9c9522 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:45.296285 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 913/1815] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:53:45.313657 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2230c-c239-492e-bbc6-10c12d9c9522 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:45.328243 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ade928-04bc-4647-a1e8-84c3a69f43c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:45.329194 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ade928-04bc-4647-a1e8-84c3a69f43c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:45.329647 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ade928-04bc-4647-a1e8-84c3a69f43c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:45.331311 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ade928-04bc-4647-a1e8-84c3a69f43c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:45.334286 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ade928-04bc-4647-a1e8-84c3a69f43c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:53:45.334602 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ade928-04bc-4647-a1e8-84c3a69f43c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:45.354295 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ade928-04bc-4647-a1e8-84c3a69f43c9 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:45.418958 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 903/1816] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:53:45.425317 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd42875-f2d6-408c-8ddd-2682ab119b5b None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:45.445149 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd42875-f2d6-408c-8ddd-2682ab119b5b None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:45.480020 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e62b4-137b-4b56-800a-ffe3587b0db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:45.488348 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e62b4-137b-4b56-800a-ffe3587b0db8 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:45.490531 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e62b4-137b-4b56-800a-ffe3587b0db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:45.493745 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e62b4-137b-4b56-800a-ffe3587b0db8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:45.498148 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e62b4-137b-4b56-800a-ffe3587b0db8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:45.517631 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e62b4-137b-4b56-800a-ffe3587b0db8 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:45.619068 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ade928-04bc-4647-a1e8-84c3a69f43c9 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:45.621605 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 914/1817] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:53:45 2022] POST /identity/v3/projects => generated 387 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:53:45.637781 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ade928-04bc-4647-a1e8-84c3a69f43c9 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:45.923340 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60219390-7e5c-4407-a442-6768fa19a4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:45.924874 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60219390-7e5c-4407-a442-6768fa19a4e7 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:45.925313 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60219390-7e5c-4407-a442-6768fa19a4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:45.925669 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60219390-7e5c-4407-a442-6768fa19a4e7 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:45.926563 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60219390-7e5c-4407-a442-6768fa19a4e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:45.929098 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60219390-7e5c-4407-a442-6768fa19a4e7 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:46.013463 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 904/1818] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:53:45 2022] POST /identity/v3/users => generated 294 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:53:46.027395 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e62b4-137b-4b56-800a-ffe3587b0db8 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:46.091115 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e62b4-137b-4b56-800a-ffe3587b0db8 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:46.104156 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe9dfe-9f0e-4379-aafe-25dfa8072eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:46.106275 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe9dfe-9f0e-4379-aafe-25dfa8072eba admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:46.107109 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe9dfe-9f0e-4379-aafe-25dfa8072eba admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:46.108515 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe9dfe-9f0e-4379-aafe-25dfa8072eba admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:46.110408 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe9dfe-9f0e-4379-aafe-25dfa8072eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:46.119167 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe9dfe-9f0e-4379-aafe-25dfa8072eba admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:46.156870 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 915/1819] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:53:46.157758 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60219390-7e5c-4407-a442-6768fa19a4e7 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:46.191782 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60219390-7e5c-4407-a442-6768fa19a4e7 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:46.199355 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788945fb-110f-4974-8c52-e339842525b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:46.199978 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788945fb-110f-4974-8c52-e339842525b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:46.200490 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788945fb-110f-4974-8c52-e339842525b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:46.201099 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788945fb-110f-4974-8c52-e339842525b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:46.202789 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788945fb-110f-4974-8c52-e339842525b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:46.206994 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788945fb-110f-4974-8c52-e339842525b5 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:46.258065 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe9dfe-9f0e-4379-aafe-25dfa8072eba admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:46.258343 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 905/1820] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:53:46.282986 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe9dfe-9f0e-4379-aafe-25dfa8072eba admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:46.305328 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7776d-9134-4932-871f-a70c7e0189be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:46.312365 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7776d-9134-4932-871f-a70c7e0189be admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:46.313275 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7776d-9134-4932-871f-a70c7e0189be admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:46.314021 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7776d-9134-4932-871f-a70c7e0189be admin admin] PATH_INFO: `/v3/projects/b84204f0771e408c8408db1e540916eb/users/b1467e5a28de4b298678b36cb9f484da/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:46.371118 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7776d-9134-4932-871f-a70c7e0189be admin admin] RBAC: Authorizing `identity:create_grant(project_id=b84204f0771e408c8408db1e540916eb, user_id=b1467e5a28de4b298678b36cb9f484da, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:46.374200 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7776d-9134-4932-871f-a70c7e0189be admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:46.405970 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 916/1821] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:53:46 2022] PUT /identity/v3/projects/b84204f0771e408c8408db1e540916eb/users/b1467e5a28de4b298678b36cb9f484da/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:46.430861 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aad39e-8801-439e-8408-216b5a182b87 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:46.431495 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aad39e-8801-439e-8408-216b5a182b87 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:46.432085 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aad39e-8801-439e-8408-216b5a182b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:46.501467 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-66aad39e-8801-439e-8408-216b5a182b87 None None] MFA Rules not processed for user `b1467e5a28de4b298678b36cb9f484da`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:46.509766 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-66aad39e-8801-439e-8408-216b5a182b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:46.792586 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 906/1822] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:46.808889 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7776d-9134-4932-871f-a70c7e0189be admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:46.943358 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12aa95-aa32-4de1-9ca2-2e20d45f099d None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:46.946159 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12aa95-aa32-4de1-9ca2-2e20d45f099d None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:46.946865 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12aa95-aa32-4de1-9ca2-2e20d45f099d None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:46.952068 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 907/1823] 10.222.0.49 () {54 vars in 921 bytes} [Fri Oct 28 20:53:46 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:53:47.224599 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7776d-9134-4932-871f-a70c7e0189be admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:47.241735 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d04c56-5c6b-4724-9869-094c866a4df9 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:47.243390 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d04c56-5c6b-4724-9869-094c866a4df9 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:47.244007 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d04c56-5c6b-4724-9869-094c866a4df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:47.257590 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba5197-ebd2-40d3-8e38-97b0dc9f493e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:47.259467 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba5197-ebd2-40d3-8e38-97b0dc9f493e admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:47.265892 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba5197-ebd2-40d3-8e38-97b0dc9f493e admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:47.266661 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba5197-ebd2-40d3-8e38-97b0dc9f493e admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:47.276019 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba5197-ebd2-40d3-8e38-97b0dc9f493e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:47.285764 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba5197-ebd2-40d3-8e38-97b0dc9f493e admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:47.308827 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-34d04c56-5c6b-4724-9869-094c866a4df9 None None] MFA Rules not processed for user `04bc6ee009e34a5f82e2807db51523d3`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:47.310979 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-34d04c56-5c6b-4724-9869-094c866a4df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:47.357022 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 917/1824] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:53:46 2022] POST /identity/v3/projects => generated 387 bytes in 556 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:53:47.362614 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba5197-ebd2-40d3-8e38-97b0dc9f493e admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:47.512099 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba5197-ebd2-40d3-8e38-97b0dc9f493e admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:47.530176 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2884b6-62ef-4df9-9729-6cc8544839d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:47.531440 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2884b6-62ef-4df9-9729-6cc8544839d6 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:47.531440 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2884b6-62ef-4df9-9729-6cc8544839d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:47.531440 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2884b6-62ef-4df9-9729-6cc8544839d6 admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:47.532171 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2884b6-62ef-4df9-9729-6cc8544839d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:47.535294 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2884b6-62ef-4df9-9729-6cc8544839d6 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:47.581742 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 918/1825] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:53:47 2022] POST /identity/v3/users => generated 300 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:53:47.586889 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2884b6-62ef-4df9-9729-6cc8544839d6 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:47.601384 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2884b6-62ef-4df9-9729-6cc8544839d6 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:47.603389 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 908/1826] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Oct 28 20:53:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:47.622481 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b4c11-a4e2-4ef8-9156-823376e6c748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:47.626453 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b4c11-a4e2-4ef8-9156-823376e6c748 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:47.626929 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b4c11-a4e2-4ef8-9156-823376e6c748 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:47.628281 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b4c11-a4e2-4ef8-9156-823376e6c748 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:47.631011 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b4c11-a4e2-4ef8-9156-823376e6c748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:47.636788 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b4c11-a4e2-4ef8-9156-823376e6c748 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:47.671407 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 919/1827] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:53:47.676553 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d04c56-5c6b-4724-9869-094c866a4df9 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:47.691309 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d04c56-5c6b-4724-9869-094c866a4df9 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:47.724156 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd231305-9a1c-47d8-a15b-22c83517bacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:47.728011 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd231305-9a1c-47d8-a15b-22c83517bacb admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:47.729186 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd231305-9a1c-47d8-a15b-22c83517bacb admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:47.729468 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd231305-9a1c-47d8-a15b-22c83517bacb admin admin] PATH_INFO: `/v3/projects/0e5a9d64b5d844409094e949f6aa40d0/users/de90616f2a7e43e1851d0ab109698c86/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:47.792005 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd231305-9a1c-47d8-a15b-22c83517bacb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e5a9d64b5d844409094e949f6aa40d0, user_id=de90616f2a7e43e1851d0ab109698c86, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:47.795635 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd231305-9a1c-47d8-a15b-22c83517bacb admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:47.873183 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b4c11-a4e2-4ef8-9156-823376e6c748 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:47.878145 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 909/1828] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:53:47 2022] PUT /identity/v3/projects/0e5a9d64b5d844409094e949f6aa40d0/users/de90616f2a7e43e1851d0ab109698c86/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:53:47.908884 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b4c11-a4e2-4ef8-9156-823376e6c748 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:48.328491 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32c22d-97b9-4902-b708-5e4f96eec442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:48.329746 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32c22d-97b9-4902-b708-5e4f96eec442 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:48.330758 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32c22d-97b9-4902-b708-5e4f96eec442 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:48.332692 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32c22d-97b9-4902-b708-5e4f96eec442 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:48.337331 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32c22d-97b9-4902-b708-5e4f96eec442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:48.346331 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32c22d-97b9-4902-b708-5e4f96eec442 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:48.387827 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 920/1829] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 513 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:53:48.390336 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd231305-9a1c-47d8-a15b-22c83517bacb admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:48.426507 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd231305-9a1c-47d8-a15b-22c83517bacb admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:48.461225 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fb641-4e42-4607-a751-c1131fb67b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:48.462233 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fb641-4e42-4607-a751-c1131fb67b8f admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:48.462749 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fb641-4e42-4607-a751-c1131fb67b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:48.463045 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fb641-4e42-4607-a751-c1131fb67b8f admin admin] PATH_INFO: `/v3/projects/0e5a9d64b5d844409094e949f6aa40d0/users/de90616f2a7e43e1851d0ab109698c86/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:48.470406 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fb641-4e42-4607-a751-c1131fb67b8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e5a9d64b5d844409094e949f6aa40d0, user_id=de90616f2a7e43e1851d0ab109698c86, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:48.487497 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fb641-4e42-4607-a751-c1131fb67b8f admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:48.513171 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 910/1830] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:53:48 2022] PUT /identity/v3/projects/0e5a9d64b5d844409094e949f6aa40d0/users/de90616f2a7e43e1851d0ab109698c86/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:48.538574 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb7944-73d0-406b-833e-1178a8461822 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:48.539402 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb7944-73d0-406b-833e-1178a8461822 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:48.540135 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb7944-73d0-406b-833e-1178a8461822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:48.688836 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-19bb7944-73d0-406b-833e-1178a8461822 None None] MFA Rules not processed for user `de90616f2a7e43e1851d0ab109698c86`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:48.694277 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-19bb7944-73d0-406b-833e-1178a8461822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:48.908841 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 921/1831] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:48.941529 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fb641-4e42-4607-a751-c1131fb67b8f admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:48.953507 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-e57fb641-4e42-4607-a751-c1131fb67b8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:49.256740 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fb641-4e42-4607-a751-c1131fb67b8f admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:49.274912 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a88833-3018-44d7-b291-69d25743231a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:49.276354 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a88833-3018-44d7-b291-69d25743231a service cinder] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:49.276752 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a88833-3018-44d7-b291-69d25743231a service cinder] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:49.280205 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a88833-3018-44d7-b291-69d25743231a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:49.321720 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a88833-3018-44d7-b291-69d25743231a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:49.325503 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a88833-3018-44d7-b291-69d25743231a service cinder] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:49.389139 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 911/1832] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:53:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:53:49.837002 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb7944-73d0-406b-833e-1178a8461822 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:50.137766 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb7944-73d0-406b-833e-1178a8461822 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:50.152110 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d44906-fb88-4feb-bd07-f23f21605bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:50.156558 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d44906-fb88-4feb-bd07-f23f21605bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:50.157353 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d44906-fb88-4feb-bd07-f23f21605bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:50.158041 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d44906-fb88-4feb-bd07-f23f21605bc7 admin admin] PATH_INFO: `/v3/users/b1467e5a28de4b298678b36cb9f484da` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:50.162294 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d44906-fb88-4feb-bd07-f23f21605bc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1467e5a28de4b298678b36cb9f484da)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:50.167465 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d44906-fb88-4feb-bd07-f23f21605bc7 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:50.332739 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-36d44906-fb88-4feb-bd07-f23f21605bc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1467e5a28de4b298678b36cb9f484da'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:50.362398 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-36d44906-fb88-4feb-bd07-f23f21605bc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1467e5a28de4b298678b36cb9f484da'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:50.400068 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-36d44906-fb88-4feb-bd07-f23f21605bc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1467e5a28de4b298678b36cb9f484da'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:50.401521 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-36d44906-fb88-4feb-bd07-f23f21605bc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1467e5a28de4b298678b36cb9f484da'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:50.483349 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-36d44906-fb88-4feb-bd07-f23f21605bc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1467e5a28de4b298678b36cb9f484da'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:50.506442 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 922/1833] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:53:49 2022] DELETE /identity/v3/users/b1467e5a28de4b298678b36cb9f484da => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:50.512451 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcf773-8aff-4cb7-a7ce-f1883e2d0219 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:50.513551 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcf773-8aff-4cb7-a7ce-f1883e2d0219 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:50.514314 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcf773-8aff-4cb7-a7ce-f1883e2d0219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:50.608454 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-3cdcf773-8aff-4cb7-a7ce-f1883e2d0219 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:50.610886 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-3cdcf773-8aff-4cb7-a7ce-f1883e2d0219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:50.845658 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 912/1834] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:50.913710 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d44906-fb88-4feb-bd07-f23f21605bc7 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:50.916461 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-36d44906-fb88-4feb-bd07-f23f21605bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:51.110234 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d44906-fb88-4feb-bd07-f23f21605bc7 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:51.123041 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab3bf15-50eb-41a7-b831-9ddb75eea06c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:51.123807 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3bf15-50eb-41a7-b831-9ddb75eea06c service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:51.124161 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3bf15-50eb-41a7-b831-9ddb75eea06c service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:51.124711 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3bf15-50eb-41a7-b831-9ddb75eea06c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:51.161118 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab3bf15-50eb-41a7-b831-9ddb75eea06c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:51.162628 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab3bf15-50eb-41a7-b831-9ddb75eea06c service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:51.227073 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 923/1835] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:53:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:53:51.392649 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcf773-8aff-4cb7-a7ce-f1883e2d0219 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:51.394634 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-3cdcf773-8aff-4cb7-a7ce-f1883e2d0219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:51.418788 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcf773-8aff-4cb7-a7ce-f1883e2d0219 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:51.433931 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261506ee-9942-4f61-af3a-73865b4bfc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:51.434884 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261506ee-9942-4f61-af3a-73865b4bfc46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:51.435097 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261506ee-9942-4f61-af3a-73865b4bfc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:51.435407 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261506ee-9942-4f61-af3a-73865b4bfc46 admin admin] PATH_INFO: `/v3/projects/481889457b1f4e85b7f57dbec2da4ba2` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:51.436955 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261506ee-9942-4f61-af3a-73865b4bfc46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=481889457b1f4e85b7f57dbec2da4ba2)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:51.439099 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261506ee-9942-4f61-af3a-73865b4bfc46 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:51.631643 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-261506ee-9942-4f61-af3a-73865b4bfc46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '481889457b1f4e85b7f57dbec2da4ba2', 'request_id': 'req-261506ee-9942-4f61-af3a-73865b4bfc46'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:51.653025 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-261506ee-9942-4f61-af3a-73865b4bfc46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '481889457b1f4e85b7f57dbec2da4ba2', 'request_id': 'req-261506ee-9942-4f61-af3a-73865b4bfc46'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:51.672812 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-261506ee-9942-4f61-af3a-73865b4bfc46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '481889457b1f4e85b7f57dbec2da4ba2', 'request_id': 'req-261506ee-9942-4f61-af3a-73865b4bfc46'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:51.739485 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-261506ee-9942-4f61-af3a-73865b4bfc46 admin admin] The token cache is being invalidate because project 481889457b1f4e85b7f57dbec2da4ba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:53:51.747226 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-261506ee-9942-4f61-af3a-73865b4bfc46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:51.754074 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-261506ee-9942-4f61-af3a-73865b4bfc46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:51.756375 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 913/1836] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:53:51 2022] DELETE /identity/v3/projects/481889457b1f4e85b7f57dbec2da4ba2 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:51.766198 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c404728-510f-4dd7-bad7-2fc591d994eb None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:51.767249 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c404728-510f-4dd7-bad7-2fc591d994eb None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:51.768365 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c404728-510f-4dd7-bad7-2fc591d994eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:51.824875 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-7c404728-510f-4dd7-bad7-2fc591d994eb None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:51.827101 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-7c404728-510f-4dd7-bad7-2fc591d994eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:52.042073 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 924/1837] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:52.043462 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cc642-277e-49f3-8566-1ed8ac4eaac1 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:52.043797 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cc642-277e-49f3-8566-1ed8ac4eaac1 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:52.044085 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cc642-277e-49f3-8566-1ed8ac4eaac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:52.086873 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-8b1cc642-277e-49f3-8566-1ed8ac4eaac1 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:52.088633 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-8b1cc642-277e-49f3-8566-1ed8ac4eaac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:52.106191 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 914/1838] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:53:52.110423 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c404728-510f-4dd7-bad7-2fc591d994eb None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:52.125240 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c404728-510f-4dd7-bad7-2fc591d994eb None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:52.152149 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46b1e0-3251-4d34-96a3-e2bda402f9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:52.153005 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46b1e0-3251-4d34-96a3-e2bda402f9b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:52.153296 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46b1e0-3251-4d34-96a3-e2bda402f9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:52.153582 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46b1e0-3251-4d34-96a3-e2bda402f9b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:52.154644 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46b1e0-3251-4d34-96a3-e2bda402f9b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:53:52.155298 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46b1e0-3251-4d34-96a3-e2bda402f9b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:52.157269 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46b1e0-3251-4d34-96a3-e2bda402f9b9 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:52.179390 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1cc642-277e-49f3-8566-1ed8ac4eaac1 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:52.199794 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 925/1839] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:53:52.203726 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1cc642-277e-49f3-8566-1ed8ac4eaac1 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:52.217944 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15326932-38ab-4e08-b617-4a34e9815d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:52.220365 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15326932-38ab-4e08-b617-4a34e9815d35 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:52.222144 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15326932-38ab-4e08-b617-4a34e9815d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:52.223260 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15326932-38ab-4e08-b617-4a34e9815d35 admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:52.244188 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15326932-38ab-4e08-b617-4a34e9815d35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:52.255686 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15326932-38ab-4e08-b617-4a34e9815d35 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:52.355965 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 915/1840] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:53:52 2022] POST /identity/v3/projects => generated 375 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:53:52.360340 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46b1e0-3251-4d34-96a3-e2bda402f9b9 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:52.401413 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46b1e0-3251-4d34-96a3-e2bda402f9b9 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:52.542329 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883dcbd-28fd-4f1b-9b03-360ea1170cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:52.542943 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883dcbd-28fd-4f1b-9b03-360ea1170cd3 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:52.543287 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883dcbd-28fd-4f1b-9b03-360ea1170cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:52.543615 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883dcbd-28fd-4f1b-9b03-360ea1170cd3 admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:52.549812 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883dcbd-28fd-4f1b-9b03-360ea1170cd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:52.552509 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883dcbd-28fd-4f1b-9b03-360ea1170cd3 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:52.588474 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 926/1841] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:53:52 2022] POST /identity/v3/users => generated 288 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:53:52.590735 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15326932-38ab-4e08-b617-4a34e9815d35 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:52.628212 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15326932-38ab-4e08-b617-4a34e9815d35 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:52.635714 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883dcbd-28fd-4f1b-9b03-360ea1170cd3 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:52.637740 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-b883dcbd-28fd-4f1b-9b03-360ea1170cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:52.646870 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7a879-c9b7-420a-95ef-889d626003b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:52.651396 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7a879-c9b7-420a-95ef-889d626003b1 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:52.652671 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7a879-c9b7-420a-95ef-889d626003b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:52.653752 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7a879-c9b7-420a-95ef-889d626003b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:52.657752 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7a879-c9b7-420a-95ef-889d626003b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:52.663151 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7a879-c9b7-420a-95ef-889d626003b1 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:52.667207 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883dcbd-28fd-4f1b-9b03-360ea1170cd3 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:52.685767 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db7160-ef60-4a5e-84c3-ffce5ee4630c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:52.690322 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db7160-ef60-4a5e-84c3-ffce5ee4630c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:52.690676 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db7160-ef60-4a5e-84c3-ffce5ee4630c admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:52.691009 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db7160-ef60-4a5e-84c3-ffce5ee4630c admin admin] PATH_INFO: `/v3/projects/b84204f0771e408c8408db1e540916eb` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:52.694111 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db7160-ef60-4a5e-84c3-ffce5ee4630c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b84204f0771e408c8408db1e540916eb)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:52.698331 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db7160-ef60-4a5e-84c3-ffce5ee4630c admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:52.738816 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 916/1842] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:53:52.742008 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7a879-c9b7-420a-95ef-889d626003b1 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:52.801440 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-b2db7160-ef60-4a5e-84c3-ffce5ee4630c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b84204f0771e408c8408db1e540916eb', 'request_id': 'req-b2db7160-ef60-4a5e-84c3-ffce5ee4630c'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:52.807997 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-b2db7160-ef60-4a5e-84c3-ffce5ee4630c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b84204f0771e408c8408db1e540916eb', 'request_id': 'req-b2db7160-ef60-4a5e-84c3-ffce5ee4630c'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:52.821962 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7a879-c9b7-420a-95ef-889d626003b1 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:52.832312 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-b2db7160-ef60-4a5e-84c3-ffce5ee4630c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b84204f0771e408c8408db1e540916eb', 'request_id': 'req-b2db7160-ef60-4a5e-84c3-ffce5ee4630c'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:52.856493 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-b2db7160-ef60-4a5e-84c3-ffce5ee4630c admin admin] The token cache is being invalidate because project b84204f0771e408c8408db1e540916eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:53:52.856934 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-b2db7160-ef60-4a5e-84c3-ffce5ee4630c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:52.857721 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-b2db7160-ef60-4a5e-84c3-ffce5ee4630c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:52.859653 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 927/1843] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:53:52 2022] DELETE /identity/v3/projects/b84204f0771e408c8408db1e540916eb => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:52.865115 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db7160-ef60-4a5e-84c3-ffce5ee4630c admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:52.866881 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-b2db7160-ef60-4a5e-84c3-ffce5ee4630c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:53.029972 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639b54b-4c49-4b73-98f3-9412b4eed232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:53.030721 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639b54b-4c49-4b73-98f3-9412b4eed232 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:53.034760 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639b54b-4c49-4b73-98f3-9412b4eed232 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:53.038894 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639b54b-4c49-4b73-98f3-9412b4eed232 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:53.041977 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639b54b-4c49-4b73-98f3-9412b4eed232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:53.048234 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639b54b-4c49-4b73-98f3-9412b4eed232 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:53.072733 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db7160-ef60-4a5e-84c3-ffce5ee4630c admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:53.075598 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 917/1844] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:53:53.076858 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639b54b-4c49-4b73-98f3-9412b4eed232 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:53.079610 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-7639b54b-4c49-4b73-98f3-9412b4eed232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:53.082667 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d88d4-40a3-4a9e-8a70-4205416943e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:53.083579 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d88d4-40a3-4a9e-8a70-4205416943e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:53.083883 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d88d4-40a3-4a9e-8a70-4205416943e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:53.084161 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d88d4-40a3-4a9e-8a70-4205416943e9 admin admin] PATH_INFO: `/v3/users/de90616f2a7e43e1851d0ab109698c86` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:53.085471 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d88d4-40a3-4a9e-8a70-4205416943e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de90616f2a7e43e1851d0ab109698c86)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:53.087944 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d88d4-40a3-4a9e-8a70-4205416943e9 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:53.125693 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639b54b-4c49-4b73-98f3-9412b4eed232 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:53.137763 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc4f2e-861a-45f5-b564-31d44d1ddc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:53.139161 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc4f2e-861a-45f5-b564-31d44d1ddc1e admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:53.140808 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc4f2e-861a-45f5-b564-31d44d1ddc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:53.141771 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc4f2e-861a-45f5-b564-31d44d1ddc1e admin admin] PATH_INFO: `/v3/projects/0a167a5f4e7547f5aab69e4b7122c7e2/users/08f56cb899a54346997005d84a21a707/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:53.195394 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc4f2e-861a-45f5-b564-31d44d1ddc1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a167a5f4e7547f5aab69e4b7122c7e2, user_id=08f56cb899a54346997005d84a21a707, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:53.204472 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc4f2e-861a-45f5-b564-31d44d1ddc1e admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:53.234086 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-8f1d88d4-40a3-4a9e-8a70-4205416943e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de90616f2a7e43e1851d0ab109698c86'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:53.242063 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 918/1845] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:53:53 2022] PUT /identity/v3/projects/0a167a5f4e7547f5aab69e4b7122c7e2/users/08f56cb899a54346997005d84a21a707/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:53.267219 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43919b71-457e-40d0-a7eb-ec27dc200dfb None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:53.268854 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43919b71-457e-40d0-a7eb-ec27dc200dfb None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:53.270526 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43919b71-457e-40d0-a7eb-ec27dc200dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:53.279251 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-8f1d88d4-40a3-4a9e-8a70-4205416943e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de90616f2a7e43e1851d0ab109698c86'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:53.303368 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-8f1d88d4-40a3-4a9e-8a70-4205416943e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de90616f2a7e43e1851d0ab109698c86'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:53.305315 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-8f1d88d4-40a3-4a9e-8a70-4205416943e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de90616f2a7e43e1851d0ab109698c86'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:53.337935 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-8f1d88d4-40a3-4a9e-8a70-4205416943e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de90616f2a7e43e1851d0ab109698c86'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:53.359800 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 928/1846] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:53:52 2022] DELETE /identity/v3/users/de90616f2a7e43e1851d0ab109698c86 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:53.365415 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-43919b71-457e-40d0-a7eb-ec27dc200dfb None None] MFA Rules not processed for user `08f56cb899a54346997005d84a21a707`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:53.367450 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-43919b71-457e-40d0-a7eb-ec27dc200dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:53.628773 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 919/1847] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:53:53.653299 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d88d4-40a3-4a9e-8a70-4205416943e9 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:53.656711 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-8f1d88d4-40a3-4a9e-8a70-4205416943e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:53.973366 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d88d4-40a3-4a9e-8a70-4205416943e9 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:53.991227 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab49ac-6d00-4deb-a64e-f9fe3276278e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05029a41bd2b42febfd5ce91a3f28c24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:53.992325 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab49ac-6d00-4deb-a64e-f9fe3276278e service glance] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:53.996401 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab49ac-6d00-4deb-a64e-f9fe3276278e service glance] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:53.998025 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab49ac-6d00-4deb-a64e-f9fe3276278e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:54.047781 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab49ac-6d00-4deb-a64e-f9fe3276278e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:54.053946 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab49ac-6d00-4deb-a64e-f9fe3276278e service glance] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:54.090992 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 929/1848] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:53:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:53:54.326485 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43919b71-457e-40d0-a7eb-ec27dc200dfb None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:54.330390 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-43919b71-457e-40d0-a7eb-ec27dc200dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:54.547793 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43919b71-457e-40d0-a7eb-ec27dc200dfb None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:54.555316 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314df345-8a70-489f-a7cc-aac1228dc860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:54.556583 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314df345-8a70-489f-a7cc-aac1228dc860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:54.556583 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314df345-8a70-489f-a7cc-aac1228dc860 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:54.556905 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314df345-8a70-489f-a7cc-aac1228dc860 admin admin] PATH_INFO: `/v3/projects/0e5a9d64b5d844409094e949f6aa40d0` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:54.559436 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314df345-8a70-489f-a7cc-aac1228dc860 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e5a9d64b5d844409094e949f6aa40d0)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:54.562836 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314df345-8a70-489f-a7cc-aac1228dc860 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:54.597425 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab49ac-6d00-4deb-a64e-f9fe3276278e service glance] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:54.599942 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-81ab49ac-6d00-4deb-a64e-f9fe3276278e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:54.721555 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-314df345-8a70-489f-a7cc-aac1228dc860 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e5a9d64b5d844409094e949f6aa40d0', 'request_id': 'req-314df345-8a70-489f-a7cc-aac1228dc860'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:54.731210 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-314df345-8a70-489f-a7cc-aac1228dc860 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e5a9d64b5d844409094e949f6aa40d0', 'request_id': 'req-314df345-8a70-489f-a7cc-aac1228dc860'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:54.749298 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-314df345-8a70-489f-a7cc-aac1228dc860 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e5a9d64b5d844409094e949f6aa40d0', 'request_id': 'req-314df345-8a70-489f-a7cc-aac1228dc860'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:54.775197 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-314df345-8a70-489f-a7cc-aac1228dc860 admin admin] The token cache is being invalidate because project 0e5a9d64b5d844409094e949f6aa40d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:53:54.779692 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-314df345-8a70-489f-a7cc-aac1228dc860 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:54.780858 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-314df345-8a70-489f-a7cc-aac1228dc860 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:54.782691 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 920/1849] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:53:54 2022] DELETE /identity/v3/projects/0e5a9d64b5d844409094e949f6aa40d0 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:54.789507 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c2c84-ba9a-4552-a1df-e59f9e5ade22 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:54.790083 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c2c84-ba9a-4552-a1df-e59f9e5ade22 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:54.790515 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c2c84-ba9a-4552-a1df-e59f9e5ade22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:54.849315 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-713c2c84-ba9a-4552-a1df-e59f9e5ade22 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:54.853690 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-713c2c84-ba9a-4552-a1df-e59f9e5ade22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:54.996368 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab49ac-6d00-4deb-a64e-f9fe3276278e service glance] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:55.212300 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 921/1850] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:55.222220 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363dcba-2cd1-4313-9fb5-889657a0146d None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:55.222779 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363dcba-2cd1-4313-9fb5-889657a0146d None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:55.223559 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363dcba-2cd1-4313-9fb5-889657a0146d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:55.237355 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d543a96-23ef-470f-beed-dcba3d626359 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:55.238268 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d543a96-23ef-470f-beed-dcba3d626359 service nova] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:55.238551 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d543a96-23ef-470f-beed-dcba3d626359 service nova] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:55.243574 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d543a96-23ef-470f-beed-dcba3d626359 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:55.249308 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-4d543a96-23ef-470f-beed-dcba3d626359 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:55.289952 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-5363dcba-2cd1-4313-9fb5-889657a0146d None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:55.291710 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-5363dcba-2cd1-4313-9fb5-889657a0146d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:55.292166 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d543a96-23ef-470f-beed-dcba3d626359 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:55.296780 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d543a96-23ef-470f-beed-dcba3d626359 service nova] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:55.320801 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 922/1851] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:55.324722 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363dcba-2cd1-4313-9fb5-889657a0146d None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:55.336823 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363dcba-2cd1-4313-9fb5-889657a0146d None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:55.342905 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55886d0a-a94b-4b7b-8b11-9886a95c72e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:55.344176 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55886d0a-a94b-4b7b-8b11-9886a95c72e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:55.344578 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55886d0a-a94b-4b7b-8b11-9886a95c72e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:55.344954 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55886d0a-a94b-4b7b-8b11-9886a95c72e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:55.346468 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55886d0a-a94b-4b7b-8b11-9886a95c72e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:53:55.346946 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55886d0a-a94b-4b7b-8b11-9886a95c72e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:55.348424 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 930/1852] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:53:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 752 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:53:55.349499 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55886d0a-a94b-4b7b-8b11-9886a95c72e2 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:55.366690 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 923/1853] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:53:55.371490 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d543a96-23ef-470f-beed-dcba3d626359 service nova] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:55.402664 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d543a96-23ef-470f-beed-dcba3d626359 service nova] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:55.425428 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a957d8a-da6a-4d97-94f3-a8b728e13f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:55.426134 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a957d8a-da6a-4d97-94f3-a8b728e13f18 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:55.426416 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a957d8a-da6a-4d97-94f3-a8b728e13f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:55.426692 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a957d8a-da6a-4d97-94f3-a8b728e13f18 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:55.427412 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a957d8a-da6a-4d97-94f3-a8b728e13f18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:55.429511 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a957d8a-da6a-4d97-94f3-a8b728e13f18 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:55.522803 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 931/1854] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:53:55 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:53:55.528096 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55886d0a-a94b-4b7b-8b11-9886a95c72e2 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:55.554217 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55886d0a-a94b-4b7b-8b11-9886a95c72e2 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:55.796463 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fab85d-f739-425b-8891-f0813661e20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:55.797548 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fab85d-f739-425b-8891-f0813661e20c admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:55.798095 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fab85d-f739-425b-8891-f0813661e20c admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:55.798474 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fab85d-f739-425b-8891-f0813661e20c admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:55.800795 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fab85d-f739-425b-8891-f0813661e20c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:55.807234 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fab85d-f739-425b-8891-f0813661e20c admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:55.855790 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a957d8a-da6a-4d97-94f3-a8b728e13f18 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:55.856453 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 924/1855] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:53:55 2022] POST /identity/v3/users => generated 292 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:53:55.921085 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a957d8a-da6a-4d97-94f3-a8b728e13f18 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:55.942249 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f02b6-2308-4636-b9dd-8a987fd5f719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:55.943041 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f02b6-2308-4636-b9dd-8a987fd5f719 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:55.943247 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f02b6-2308-4636-b9dd-8a987fd5f719 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:55.946203 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f02b6-2308-4636-b9dd-8a987fd5f719 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:55.950949 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f02b6-2308-4636-b9dd-8a987fd5f719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:55.964199 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f02b6-2308-4636-b9dd-8a987fd5f719 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:56.011654 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 932/1856] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:53:56.015950 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fab85d-f739-425b-8891-f0813661e20c admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:56.028725 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fab85d-f739-425b-8891-f0813661e20c admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:56.042284 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b730e-46a5-4dd1-aeab-594cbe1efdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:56.044171 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b730e-46a5-4dd1-aeab-594cbe1efdb3 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:56.044855 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b730e-46a5-4dd1-aeab-594cbe1efdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:56.047266 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b730e-46a5-4dd1-aeab-594cbe1efdb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:56.048251 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b730e-46a5-4dd1-aeab-594cbe1efdb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:56.050878 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b730e-46a5-4dd1-aeab-594cbe1efdb3 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:56.063679 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 925/1857] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:53:56.069980 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f02b6-2308-4636-b9dd-8a987fd5f719 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:56.091057 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f02b6-2308-4636-b9dd-8a987fd5f719 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:56.105956 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399aec4-96c5-4971-9aad-d38beda7f344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:56.107165 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399aec4-96c5-4971-9aad-d38beda7f344 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:56.107676 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399aec4-96c5-4971-9aad-d38beda7f344 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:56.108006 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399aec4-96c5-4971-9aad-d38beda7f344 admin admin] PATH_INFO: `/v3/projects/5bac0b6414af423ca401e3260a94fd69/users/129352f774c54875b49fcc6c3bd05466/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:56.127447 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b730e-46a5-4dd1-aeab-594cbe1efdb3 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:56.133895 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-844b730e-46a5-4dd1-aeab-594cbe1efdb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:56.136001 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399aec4-96c5-4971-9aad-d38beda7f344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bac0b6414af423ca401e3260a94fd69, user_id=129352f774c54875b49fcc6c3bd05466, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:56.139963 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399aec4-96c5-4971-9aad-d38beda7f344 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:56.161058 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b730e-46a5-4dd1-aeab-594cbe1efdb3 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:56.165137 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 933/1858] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:53:56 2022] PUT /identity/v3/projects/5bac0b6414af423ca401e3260a94fd69/users/129352f774c54875b49fcc6c3bd05466/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:56.178548 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd06f99-8ed0-477a-a049-90154d541318 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:56.179128 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd06f99-8ed0-477a-a049-90154d541318 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:56.179598 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd06f99-8ed0-477a-a049-90154d541318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:56.213898 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-0bd06f99-8ed0-477a-a049-90154d541318 None None] MFA Rules not processed for user `129352f774c54875b49fcc6c3bd05466`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:56.215404 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-0bd06f99-8ed0-477a-a049-90154d541318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:56.242565 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243ba03-ab1f-4d84-96eb-5dd48472a07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:56.244014 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243ba03-ab1f-4d84-96eb-5dd48472a07a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:56.244626 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243ba03-ab1f-4d84-96eb-5dd48472a07a admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:56.245313 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243ba03-ab1f-4d84-96eb-5dd48472a07a admin admin] PATH_INFO: `/v3/users/0b957a43ca2b419484079dbe6cfb0ff7` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:56.247462 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3243ba03-ab1f-4d84-96eb-5dd48472a07a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b957a43ca2b419484079dbe6cfb0ff7)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:56.251235 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3243ba03-ab1f-4d84-96eb-5dd48472a07a admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:56.326466 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 934/1859] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:56.328247 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd06f99-8ed0-477a-a049-90154d541318 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:56.336406 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-3243ba03-ab1f-4d84-96eb-5dd48472a07a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b957a43ca2b419484079dbe6cfb0ff7'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:56.345950 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-3243ba03-ab1f-4d84-96eb-5dd48472a07a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b957a43ca2b419484079dbe6cfb0ff7'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:56.352612 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd06f99-8ed0-477a-a049-90154d541318 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:56.357101 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-3243ba03-ab1f-4d84-96eb-5dd48472a07a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b957a43ca2b419484079dbe6cfb0ff7'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:56.364201 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb8d39-b653-460f-9c26-862c54347655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:56.366098 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb8d39-b653-460f-9c26-862c54347655 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:56.366968 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb8d39-b653-460f-9c26-862c54347655 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:56.367511 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb8d39-b653-460f-9c26-862c54347655 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:56.368630 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb8d39-b653-460f-9c26-862c54347655 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:56.375291 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb8d39-b653-460f-9c26-862c54347655 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:56.427393 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-3243ba03-ab1f-4d84-96eb-5dd48472a07a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b957a43ca2b419484079dbe6cfb0ff7'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:56.430467 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-3243ba03-ab1f-4d84-96eb-5dd48472a07a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b957a43ca2b419484079dbe6cfb0ff7'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:56.462305 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 935/1860] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:53:56 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:53:56.465490 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 926/1861] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:53:56 2022] DELETE /identity/v3/users/0b957a43ca2b419484079dbe6cfb0ff7 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:56.469750 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb8d39-b653-460f-9c26-862c54347655 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:56.472857 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-35cb8d39-b653-460f-9c26-862c54347655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:56.475233 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912c489-3ef3-4d7e-9925-fc778a4acaa0 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:56.475836 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912c489-3ef3-4d7e-9925-fc778a4acaa0 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:56.477474 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912c489-3ef3-4d7e-9925-fc778a4acaa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:56.543528 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-e912c489-3ef3-4d7e-9925-fc778a4acaa0 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:56.543528 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-e912c489-3ef3-4d7e-9925-fc778a4acaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:56.673079 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb8d39-b653-460f-9c26-862c54347655 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:56.688035 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878fb8ef-2439-48e1-8fb8-794eca1885e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:56.689398 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fb8ef-2439-48e1-8fb8-794eca1885e4 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:56.689976 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fb8ef-2439-48e1-8fb8-794eca1885e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:56.690733 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fb8ef-2439-48e1-8fb8-794eca1885e4 admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:56.692086 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878fb8ef-2439-48e1-8fb8-794eca1885e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:56.695972 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878fb8ef-2439-48e1-8fb8-794eca1885e4 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:56.745267 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 936/1862] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:53:56 2022] POST /identity/v3/users => generated 297 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:53:56.748356 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846b6d0-8e7e-4507-8eeb-63c3157e3623 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:56.748356 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846b6d0-8e7e-4507-8eeb-63c3157e3623 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:56.748356 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846b6d0-8e7e-4507-8eeb-63c3157e3623 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:56.764081 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 937/1863] 10.222.0.49 () {54 vars in 921 bytes} [Fri Oct 28 20:53:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:53:56.765133 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846b6d0-8e7e-4507-8eeb-63c3157e3623 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:56.795895 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846b6d0-8e7e-4507-8eeb-63c3157e3623 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:56.807235 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb3de1-ab06-4ec4-ae9c-f7bf96b04007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:56.808111 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb3de1-ab06-4ec4-ae9c-f7bf96b04007 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:56.808470 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb3de1-ab06-4ec4-ae9c-f7bf96b04007 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:56.808844 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb3de1-ab06-4ec4-ae9c-f7bf96b04007 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:56.809747 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb3de1-ab06-4ec4-ae9c-f7bf96b04007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:56.810682 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 927/1864] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:56.811716 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb3de1-ab06-4ec4-ae9c-f7bf96b04007 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:56.839509 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 938/1865] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:53:56.840217 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155b3e6-50f3-40db-95eb-97658acb29d2 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:56.841034 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155b3e6-50f3-40db-95eb-97658acb29d2 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:56.841602 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155b3e6-50f3-40db-95eb-97658acb29d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:56.855251 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb3de1-ab06-4ec4-ae9c-f7bf96b04007 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:56.892994 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb3de1-ab06-4ec4-ae9c-f7bf96b04007 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:56.903633 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-b155b3e6-50f3-40db-95eb-97658acb29d2 None None] MFA Rules not processed for user `04bc6ee009e34a5f82e2807db51523d3`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:56.906235 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-b155b3e6-50f3-40db-95eb-97658acb29d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:56.906896 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0cecc1-3895-4fa7-99ce-af470739b034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:56.908814 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cecc1-3895-4fa7-99ce-af470739b034 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:56.909291 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cecc1-3895-4fa7-99ce-af470739b034 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:56.909713 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cecc1-3895-4fa7-99ce-af470739b034 admin admin] PATH_INFO: `/v3/projects/ffe52be945ea4b3b8b64493677bb6b55/users/2cd6d3de8d7146eebaaa465745b9a2f2/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:56.946833 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0cecc1-3895-4fa7-99ce-af470739b034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffe52be945ea4b3b8b64493677bb6b55, user_id=2cd6d3de8d7146eebaaa465745b9a2f2, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:56.960001 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0cecc1-3895-4fa7-99ce-af470739b034 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:56.988336 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 939/1866] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:53:56 2022] PUT /identity/v3/projects/ffe52be945ea4b3b8b64493677bb6b55/users/2cd6d3de8d7146eebaaa465745b9a2f2/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:56.989656 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0cecc1-3895-4fa7-99ce-af470739b034 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:56.993984 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-5e0cecc1-3895-4fa7-99ce-af470739b034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:57.075448 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 928/1867] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Oct 28 20:53:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:57.077079 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155b3e6-50f3-40db-95eb-97658acb29d2 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:57.099162 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0cecc1-3895-4fa7-99ce-af470739b034 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:57.105122 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155b3e6-50f3-40db-95eb-97658acb29d2 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:57.109538 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bbbcb3-c7aa-46d6-8627-8eace8e8ba9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:57.110403 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bbbcb3-c7aa-46d6-8627-8eace8e8ba9a service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:57.111270 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bbbcb3-c7aa-46d6-8627-8eace8e8ba9a service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:57.112047 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bbbcb3-c7aa-46d6-8627-8eace8e8ba9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:57.244576 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bbbcb3-c7aa-46d6-8627-8eace8e8ba9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:57.246972 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bbbcb3-c7aa-46d6-8627-8eace8e8ba9a service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:57.267121 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 940/1868] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:53:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:53:57.346065 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857cae4-69ba-4e61-babc-bebf343ef571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:57.347218 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857cae4-69ba-4e61-babc-bebf343ef571 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:57.347657 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857cae4-69ba-4e61-babc-bebf343ef571 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:57.348121 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857cae4-69ba-4e61-babc-bebf343ef571 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:57.349298 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857cae4-69ba-4e61-babc-bebf343ef571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:57.351137 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857cae4-69ba-4e61-babc-bebf343ef571 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:57.403783 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 929/1869] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:53:57.414858 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bbbcb3-c7aa-46d6-8627-8eace8e8ba9a service neutron] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:57.424151 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bbbcb3-c7aa-46d6-8627-8eace8e8ba9a service neutron] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:57.430286 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d644770-9ac6-4ab7-80a8-8fa31cacf9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:57.432249 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d644770-9ac6-4ab7-80a8-8fa31cacf9b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:57.432533 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d644770-9ac6-4ab7-80a8-8fa31cacf9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:57.433210 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d644770-9ac6-4ab7-80a8-8fa31cacf9b1 admin admin] PATH_INFO: `/v3/projects/ffe52be945ea4b3b8b64493677bb6b55/users/2cd6d3de8d7146eebaaa465745b9a2f2/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:57.443933 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d644770-9ac6-4ab7-80a8-8fa31cacf9b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffe52be945ea4b3b8b64493677bb6b55, user_id=2cd6d3de8d7146eebaaa465745b9a2f2, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:57.443933 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d644770-9ac6-4ab7-80a8-8fa31cacf9b1 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:57.476158 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 941/1870] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:53:57 2022] PUT /identity/v3/projects/ffe52be945ea4b3b8b64493677bb6b55/users/2cd6d3de8d7146eebaaa465745b9a2f2/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:53:57.490118 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bceb6a7-bde2-4516-97ba-d5dd73ff2f94 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:57.490388 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bceb6a7-bde2-4516-97ba-d5dd73ff2f94 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:57.490706 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bceb6a7-bde2-4516-97ba-d5dd73ff2f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:57.541079 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-2bceb6a7-bde2-4516-97ba-d5dd73ff2f94 None None] MFA Rules not processed for user `2cd6d3de8d7146eebaaa465745b9a2f2`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:57.543403 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-2bceb6a7-bde2-4516-97ba-d5dd73ff2f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:57.727989 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 930/1871] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:53:57.743016 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d644770-9ac6-4ab7-80a8-8fa31cacf9b1 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:57.745040 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-1d644770-9ac6-4ab7-80a8-8fa31cacf9b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:57.864869 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d644770-9ac6-4ab7-80a8-8fa31cacf9b1 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:57.873825 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6ca16-3b0d-457c-bd80-5912f061b899 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:57.875276 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6ca16-3b0d-457c-bd80-5912f061b899 service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:57.875793 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6ca16-3b0d-457c-bd80-5912f061b899 service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:57.878138 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6ca16-3b0d-457c-bd80-5912f061b899 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:57.898373 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a6ca16-3b0d-457c-bd80-5912f061b899 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:57.916113 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a6ca16-3b0d-457c-bd80-5912f061b899 service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:57.952976 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 942/1872] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:53:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:53:58.088212 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bceb6a7-bde2-4516-97ba-d5dd73ff2f94 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:58.099119 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bceb6a7-bde2-4516-97ba-d5dd73ff2f94 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:58.103801 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e9604-7d91-45df-a8cb-95b0dcfd812f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:58.104477 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e9604-7d91-45df-a8cb-95b0dcfd812f service cinder] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:58.104750 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e9604-7d91-45df-a8cb-95b0dcfd812f service cinder] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:58.105020 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e9604-7d91-45df-a8cb-95b0dcfd812f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:58.107129 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-464e9604-7d91-45df-a8cb-95b0dcfd812f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:58.199154 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e9604-7d91-45df-a8cb-95b0dcfd812f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:58.203516 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e9604-7d91-45df-a8cb-95b0dcfd812f service cinder] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:58.223878 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 931/1873] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:53:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:53:58.682423 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6ca16-3b0d-457c-bd80-5912f061b899 service cinder] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:58.813435 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e9604-7d91-45df-a8cb-95b0dcfd812f service cinder] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:58.816351 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-464e9604-7d91-45df-a8cb-95b0dcfd812f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:58.851651 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6ca16-3b0d-457c-bd80-5912f061b899 service cinder] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:58.861546 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec204310-1cf0-4ba3-bf74-9367f50c6a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:58.861546 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec204310-1cf0-4ba3-bf74-9367f50c6a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:58.861546 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec204310-1cf0-4ba3-bf74-9367f50c6a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:58.861546 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec204310-1cf0-4ba3-bf74-9367f50c6a88 admin admin] PATH_INFO: `/v3/users/129352f774c54875b49fcc6c3bd05466` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:58.863913 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec204310-1cf0-4ba3-bf74-9367f50c6a88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=129352f774c54875b49fcc6c3bd05466)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:58.866608 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec204310-1cf0-4ba3-bf74-9367f50c6a88 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:58.959827 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ec204310-1cf0-4ba3-bf74-9367f50c6a88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '129352f774c54875b49fcc6c3bd05466'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:58.973062 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ec204310-1cf0-4ba3-bf74-9367f50c6a88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '129352f774c54875b49fcc6c3bd05466'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:58.989668 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ec204310-1cf0-4ba3-bf74-9367f50c6a88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '129352f774c54875b49fcc6c3bd05466'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:58.991186 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ec204310-1cf0-4ba3-bf74-9367f50c6a88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '129352f774c54875b49fcc6c3bd05466'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:59.016903 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ec204310-1cf0-4ba3-bf74-9367f50c6a88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '129352f774c54875b49fcc6c3bd05466'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:59.060271 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 943/1874] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:53:58 2022] DELETE /identity/v3/users/129352f774c54875b49fcc6c3bd05466 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:53:59.069417 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb443d3-4f65-48b3-9e5a-747a42c6711c None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:59.070068 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb443d3-4f65-48b3-9e5a-747a42c6711c None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:59.071713 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb443d3-4f65-48b3-9e5a-747a42c6711c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:59.153099 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-1eb443d3-4f65-48b3-9e5a-747a42c6711c None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:53:59.156493 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-1eb443d3-4f65-48b3-9e5a-747a42c6711c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:59.160410 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e9604-7d91-45df-a8cb-95b0dcfd812f service cinder] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:59.423275 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 944/1875] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:53:59.425153 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb443d3-4f65-48b3-9e5a-747a42c6711c None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:59.429818 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-1eb443d3-4f65-48b3-9e5a-747a42c6711c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:59.452703 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b067ad0-91be-4e72-9921-f41a10f90288 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:59.453788 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b067ad0-91be-4e72-9921-f41a10f90288 service nova] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:59.454311 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b067ad0-91be-4e72-9921-f41a10f90288 service nova] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:59.455418 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b067ad0-91be-4e72-9921-f41a10f90288 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:59.460765 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-0b067ad0-91be-4e72-9921-f41a10f90288 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:59.490032 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb443d3-4f65-48b3-9e5a-747a42c6711c None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:59.497179 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b067ad0-91be-4e72-9921-f41a10f90288 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:59.500381 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b067ad0-91be-4e72-9921-f41a10f90288 service nova] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:59.512628 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53104274-cbbe-415a-bac1-1a4ec505d24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:53:59.514231 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53104274-cbbe-415a-bac1-1a4ec505d24d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:53:59.515094 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53104274-cbbe-415a-bac1-1a4ec505d24d admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:53:59.515567 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53104274-cbbe-415a-bac1-1a4ec505d24d admin admin] PATH_INFO: `/v3/projects/6e4ee9e7879e4408948b7186c2d8cecd` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:53:59.526110 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53104274-cbbe-415a-bac1-1a4ec505d24d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e4ee9e7879e4408948b7186c2d8cecd)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:53:59.530461 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53104274-cbbe-415a-bac1-1a4ec505d24d admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:53:59.561835 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 932/1876] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:53:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 749 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:53:59.563173 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b067ad0-91be-4e72-9921-f41a10f90288 service nova] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:53:59.571957 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-0b067ad0-91be-4e72-9921-f41a10f90288 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:53:59.857858 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-53104274-cbbe-415a-bac1-1a4ec505d24d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e4ee9e7879e4408948b7186c2d8cecd', 'request_id': 'req-53104274-cbbe-415a-bac1-1a4ec505d24d'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:59.866154 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b067ad0-91be-4e72-9921-f41a10f90288 service nova] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:53:59.888632 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-53104274-cbbe-415a-bac1-1a4ec505d24d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e4ee9e7879e4408948b7186c2d8cecd', 'request_id': 'req-53104274-cbbe-415a-bac1-1a4ec505d24d'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:53:59.986014 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-53104274-cbbe-415a-bac1-1a4ec505d24d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e4ee9e7879e4408948b7186c2d8cecd', 'request_id': 'req-53104274-cbbe-415a-bac1-1a4ec505d24d'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:00.004735 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-53104274-cbbe-415a-bac1-1a4ec505d24d admin admin] The token cache is being invalidate because project 6e4ee9e7879e4408948b7186c2d8cecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:54:00.005737 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-53104274-cbbe-415a-bac1-1a4ec505d24d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:00.006790 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-53104274-cbbe-415a-bac1-1a4ec505d24d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:00.012591 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623831df-4420-4ffb-89f9-a64fc1c38f52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:00.014000 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 945/1877] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:53:59 2022] DELETE /identity/v3/projects/6e4ee9e7879e4408948b7186c2d8cecd => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:54:00.014457 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623831df-4420-4ffb-89f9-a64fc1c38f52 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:00.015204 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623831df-4420-4ffb-89f9-a64fc1c38f52 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:00.016038 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623831df-4420-4ffb-89f9-a64fc1c38f52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:00.021013 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-623831df-4420-4ffb-89f9-a64fc1c38f52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:00.021494 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53104274-cbbe-415a-bac1-1a4ec505d24d admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:00.030196 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-53104274-cbbe-415a-bac1-1a4ec505d24d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:00.127545 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53104274-cbbe-415a-bac1-1a4ec505d24d admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:00.135005 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f130763-5f6c-4db8-a598-058e297c40c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:00.136380 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f130763-5f6c-4db8-a598-058e297c40c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:00.136905 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f130763-5f6c-4db8-a598-058e297c40c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:00.137522 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f130763-5f6c-4db8-a598-058e297c40c6 admin admin] PATH_INFO: `/v3/users/3f9e5b75038343e89d1f2c093a174587` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:00.139233 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f130763-5f6c-4db8-a598-058e297c40c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f9e5b75038343e89d1f2c093a174587)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:00.142027 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f130763-5f6c-4db8-a598-058e297c40c6 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:00.230296 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623831df-4420-4ffb-89f9-a64fc1c38f52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:00.237210 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623831df-4420-4ffb-89f9-a64fc1c38f52 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:00.276158 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 933/1878] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:53:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:54:00.289480 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-3f130763-5f6c-4db8-a598-058e297c40c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f9e5b75038343e89d1f2c093a174587'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:00.303062 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-3f130763-5f6c-4db8-a598-058e297c40c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f9e5b75038343e89d1f2c093a174587'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:00.334516 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-3f130763-5f6c-4db8-a598-058e297c40c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f9e5b75038343e89d1f2c093a174587'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:00.336911 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-3f130763-5f6c-4db8-a598-058e297c40c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f9e5b75038343e89d1f2c093a174587'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:00.370861 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-3f130763-5f6c-4db8-a598-058e297c40c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f9e5b75038343e89d1f2c093a174587'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:00.395586 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 946/1879] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:54:00 2022] DELETE /identity/v3/users/3f9e5b75038343e89d1f2c093a174587 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:54:01.540403 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623831df-4420-4ffb-89f9-a64fc1c38f52 service neutron] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:01.551890 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623831df-4420-4ffb-89f9-a64fc1c38f52 service neutron] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:01.652164 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec05bf-29e3-45ae-98a8-bfadeb29a934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:01.652612 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec05bf-29e3-45ae-98a8-bfadeb29a934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:01.652895 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec05bf-29e3-45ae-98a8-bfadeb29a934 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:01.653179 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec05bf-29e3-45ae-98a8-bfadeb29a934 admin admin] PATH_INFO: `/v3/projects/2f6b24bbfd184676aa76213dc4eadd6a` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:01.654690 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec05bf-29e3-45ae-98a8-bfadeb29a934 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f6b24bbfd184676aa76213dc4eadd6a)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:01.656864 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec05bf-29e3-45ae-98a8-bfadeb29a934 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:01.755471 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-e1ec05bf-29e3-45ae-98a8-bfadeb29a934 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f6b24bbfd184676aa76213dc4eadd6a', 'request_id': 'req-e1ec05bf-29e3-45ae-98a8-bfadeb29a934'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:01.763120 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-e1ec05bf-29e3-45ae-98a8-bfadeb29a934 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f6b24bbfd184676aa76213dc4eadd6a', 'request_id': 'req-e1ec05bf-29e3-45ae-98a8-bfadeb29a934'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:01.772481 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-e1ec05bf-29e3-45ae-98a8-bfadeb29a934 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f6b24bbfd184676aa76213dc4eadd6a', 'request_id': 'req-e1ec05bf-29e3-45ae-98a8-bfadeb29a934'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:01.794430 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f130763-5f6c-4db8-a598-058e297c40c6 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:01.797047 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-3f130763-5f6c-4db8-a598-058e297c40c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:01.830237 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-e1ec05bf-29e3-45ae-98a8-bfadeb29a934 admin admin] The token cache is being invalidate because project 2f6b24bbfd184676aa76213dc4eadd6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:54:01.830786 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-e1ec05bf-29e3-45ae-98a8-bfadeb29a934 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:01.832363 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f130763-5f6c-4db8-a598-058e297c40c6 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:01.832568 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-e1ec05bf-29e3-45ae-98a8-bfadeb29a934 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:01.836868 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 934/1880] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:54:01 2022] DELETE /identity/v3/projects/2f6b24bbfd184676aa76213dc4eadd6a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:54:01.842745 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4e7f6-c519-4645-810a-0edb63eef090 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:01.843373 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4e7f6-c519-4645-810a-0edb63eef090 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:01.844533 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4e7f6-c519-4645-810a-0edb63eef090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:01.939667 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-80d4e7f6-c519-4645-810a-0edb63eef090 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:54:01.949159 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-80d4e7f6-c519-4645-810a-0edb63eef090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:02.010702 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eafdb4-cf7b-41b9-adf9-dc6ddd61d3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:02.012791 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eafdb4-cf7b-41b9-adf9-dc6ddd61d3a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:02.013151 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eafdb4-cf7b-41b9-adf9-dc6ddd61d3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:02.013502 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eafdb4-cf7b-41b9-adf9-dc6ddd61d3a2 admin admin] PATH_INFO: `/v3/projects/5bac0b6414af423ca401e3260a94fd69` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:02.016107 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eafdb4-cf7b-41b9-adf9-dc6ddd61d3a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bac0b6414af423ca401e3260a94fd69)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:02.021565 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eafdb4-cf7b-41b9-adf9-dc6ddd61d3a2 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:02.143063 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-48eafdb4-cf7b-41b9-adf9-dc6ddd61d3a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bac0b6414af423ca401e3260a94fd69', 'request_id': 'req-48eafdb4-cf7b-41b9-adf9-dc6ddd61d3a2'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:02.162962 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-48eafdb4-cf7b-41b9-adf9-dc6ddd61d3a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bac0b6414af423ca401e3260a94fd69', 'request_id': 'req-48eafdb4-cf7b-41b9-adf9-dc6ddd61d3a2'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:02.179484 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 935/1881] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:54:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:54:02.182040 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-48eafdb4-cf7b-41b9-adf9-dc6ddd61d3a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bac0b6414af423ca401e3260a94fd69', 'request_id': 'req-48eafdb4-cf7b-41b9-adf9-dc6ddd61d3a2'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:02.195787 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7c0a9-2b55-4aa4-9927-8df7981414ef None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:02.196315 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7c0a9-2b55-4aa4-9927-8df7981414ef None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:02.196731 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7c0a9-2b55-4aa4-9927-8df7981414ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:02.205074 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-48eafdb4-cf7b-41b9-adf9-dc6ddd61d3a2 admin admin] The token cache is being invalidate because project 5bac0b6414af423ca401e3260a94fd69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:54:02.205502 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-48eafdb4-cf7b-41b9-adf9-dc6ddd61d3a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:02.206229 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-48eafdb4-cf7b-41b9-adf9-dc6ddd61d3a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:02.208545 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 947/1882] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:54:01 2022] DELETE /identity/v3/projects/5bac0b6414af423ca401e3260a94fd69 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:54:02.213592 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eafdb4-cf7b-41b9-adf9-dc6ddd61d3a2 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:02.215369 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-48eafdb4-cf7b-41b9-adf9-dc6ddd61d3a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:02.240963 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-a5c7c0a9-2b55-4aa4-9927-8df7981414ef None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:54:02.243781 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-a5c7c0a9-2b55-4aa4-9927-8df7981414ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:02.343457 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 936/1883] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:54:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:54:02.349347 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7c0a9-2b55-4aa4-9927-8df7981414ef None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:02.386626 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7c0a9-2b55-4aa4-9927-8df7981414ef None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:02.394121 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747a227-fe9e-4421-b6de-51434ac095eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:02.395105 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747a227-fe9e-4421-b6de-51434ac095eb admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:02.395394 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747a227-fe9e-4421-b6de-51434ac095eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:02.395700 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747a227-fe9e-4421-b6de-51434ac095eb admin admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:02.396515 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747a227-fe9e-4421-b6de-51434ac095eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:54:02.396824 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747a227-fe9e-4421-b6de-51434ac095eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:02.399135 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747a227-fe9e-4421-b6de-51434ac095eb admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:02.421493 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 937/1884] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:54:02.422286 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747a227-fe9e-4421-b6de-51434ac095eb admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:02.432918 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eafdb4-cf7b-41b9-adf9-dc6ddd61d3a2 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:02.433991 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747a227-fe9e-4421-b6de-51434ac095eb admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:02.441194 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f3071-5bfe-4651-8ccd-dbc3e018d701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:02.442161 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f3071-5bfe-4651-8ccd-dbc3e018d701 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:02.442975 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f3071-5bfe-4651-8ccd-dbc3e018d701 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:02.442975 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f3071-5bfe-4651-8ccd-dbc3e018d701 admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:02.443732 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f3071-5bfe-4651-8ccd-dbc3e018d701 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:02.446223 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f3071-5bfe-4651-8ccd-dbc3e018d701 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:02.447378 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0a13c-627a-4410-a83c-161bee3227f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:02.452148 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0a13c-627a-4410-a83c-161bee3227f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:02.453084 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0a13c-627a-4410-a83c-161bee3227f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:02.453938 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0a13c-627a-4410-a83c-161bee3227f8 admin admin] PATH_INFO: `/v3/users/2cd6d3de8d7146eebaaa465745b9a2f2` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:02.460294 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0a13c-627a-4410-a83c-161bee3227f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cd6d3de8d7146eebaaa465745b9a2f2)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:02.466834 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0a13c-627a-4410-a83c-161bee3227f8 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:02.494796 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 938/1885] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:54:02 2022] POST /identity/v3/projects => generated 363 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:54:02.518821 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f3071-5bfe-4651-8ccd-dbc3e018d701 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:02.617027 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-4ee0a13c-627a-4410-a83c-161bee3227f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cd6d3de8d7146eebaaa465745b9a2f2'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:02.622463 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f3071-5bfe-4651-8ccd-dbc3e018d701 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:02.633716 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-4ee0a13c-627a-4410-a83c-161bee3227f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cd6d3de8d7146eebaaa465745b9a2f2'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:02.635235 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9defd-1c4f-4975-ae00-148701df3109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:02.636610 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9defd-1c4f-4975-ae00-148701df3109 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:02.637100 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9defd-1c4f-4975-ae00-148701df3109 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:02.637606 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9defd-1c4f-4975-ae00-148701df3109 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:02.639143 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9defd-1c4f-4975-ae00-148701df3109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:02.643633 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9defd-1c4f-4975-ae00-148701df3109 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:02.647666 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-4ee0a13c-627a-4410-a83c-161bee3227f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cd6d3de8d7146eebaaa465745b9a2f2'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:02.648463 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-4ee0a13c-627a-4410-a83c-161bee3227f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cd6d3de8d7146eebaaa465745b9a2f2'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:02.697978 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 939/1886] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:54:02 2022] POST /identity/v3/users => generated 282 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:54:02.698305 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9defd-1c4f-4975-ae00-148701df3109 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:02.700944 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-4ee0a13c-627a-4410-a83c-161bee3227f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cd6d3de8d7146eebaaa465745b9a2f2'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:02.702947 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-bcf9defd-1c4f-4975-ae00-148701df3109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:02.717549 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 948/1887] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:54:02 2022] DELETE /identity/v3/users/2cd6d3de8d7146eebaaa465745b9a2f2 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:54:02.736911 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9defd-1c4f-4975-ae00-148701df3109 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:02.942008 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a248c-d0f2-4f60-a346-84c7c7f6d521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:02.942810 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a248c-d0f2-4f60-a346-84c7c7f6d521 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:02.943122 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a248c-d0f2-4f60-a346-84c7c7f6d521 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:02.943677 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a248c-d0f2-4f60-a346-84c7c7f6d521 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:02.944676 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a248c-d0f2-4f60-a346-84c7c7f6d521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:02.951629 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a248c-d0f2-4f60-a346-84c7c7f6d521 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:02.964738 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 940/1888] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:54:02.968637 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0a13c-627a-4410-a83c-161bee3227f8 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:02.982912 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0a13c-627a-4410-a83c-161bee3227f8 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:02.989504 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a725d0-d999-4a96-85c5-f21af80f6ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:02.990455 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a725d0-d999-4a96-85c5-f21af80f6ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:02.990885 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a725d0-d999-4a96-85c5-f21af80f6ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:02.991505 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a725d0-d999-4a96-85c5-f21af80f6ba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:02.992482 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a725d0-d999-4a96-85c5-f21af80f6ba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:02.994762 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a725d0-d999-4a96-85c5-f21af80f6ba7 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:03.014445 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 949/1889] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:54:03.015706 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a248c-d0f2-4f60-a346-84c7c7f6d521 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:03.053105 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a248c-d0f2-4f60-a346-84c7c7f6d521 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:03.065987 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3104dbb-9a79-4343-a2ce-30ce691848c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:03.067469 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3104dbb-9a79-4343-a2ce-30ce691848c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:03.067960 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3104dbb-9a79-4343-a2ce-30ce691848c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:03.068372 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3104dbb-9a79-4343-a2ce-30ce691848c4 admin admin] PATH_INFO: `/v3/projects/a22a730947cd4fd1b494ddf4794d5370/users/107236d57a1e46738e4b08da66be3a30/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:03.096071 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3104dbb-9a79-4343-a2ce-30ce691848c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a22a730947cd4fd1b494ddf4794d5370, user_id=107236d57a1e46738e4b08da66be3a30, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:03.099404 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3104dbb-9a79-4343-a2ce-30ce691848c4 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:03.124605 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 941/1890] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:54:03 2022] PUT /identity/v3/projects/a22a730947cd4fd1b494ddf4794d5370/users/107236d57a1e46738e4b08da66be3a30/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:54:03.139662 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09949a0-668c-4647-b166-fab5145200ba None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:03.140076 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09949a0-668c-4647-b166-fab5145200ba None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:03.140525 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09949a0-668c-4647-b166-fab5145200ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:03.192392 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-d09949a0-668c-4647-b166-fab5145200ba None None] MFA Rules not processed for user `107236d57a1e46738e4b08da66be3a30`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:54:03.194565 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-d09949a0-668c-4647-b166-fab5145200ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:03.371790 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 950/1891] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:54:03 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:54:03.374730 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3104dbb-9a79-4343-a2ce-30ce691848c4 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:03.552939 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3104dbb-9a79-4343-a2ce-30ce691848c4 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:03.575469 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47aeef-cd81-466e-a480-7158482a2e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:03.575469 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47aeef-cd81-466e-a480-7158482a2e74 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:03.576044 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47aeef-cd81-466e-a480-7158482a2e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:03.576716 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47aeef-cd81-466e-a480-7158482a2e74 admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:03.578150 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a47aeef-cd81-466e-a480-7158482a2e74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:03.586663 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a47aeef-cd81-466e-a480-7158482a2e74 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:03.681245 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 942/1892] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:54:03 2022] POST /identity/v3/projects => generated 363 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:54:03.687054 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09949a0-668c-4647-b166-fab5145200ba None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:03.729809 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09949a0-668c-4647-b166-fab5145200ba None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:03.818141 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb02c32-fd32-47c9-98bb-d698df5df2d6 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:03.818905 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb02c32-fd32-47c9-98bb-d698df5df2d6 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:03.819422 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb02c32-fd32-47c9-98bb-d698df5df2d6 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:03.823848 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 943/1893] 10.222.0.49 () {54 vars in 921 bytes} [Fri Oct 28 20:54:03 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:54:03.839662 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3492e0-ba82-4a2d-9cac-09e086e83b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:03.840716 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3492e0-ba82-4a2d-9cac-09e086e83b34 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:03.840962 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3492e0-ba82-4a2d-9cac-09e086e83b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:03.846371 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3492e0-ba82-4a2d-9cac-09e086e83b34 admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:03.846371 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3492e0-ba82-4a2d-9cac-09e086e83b34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:03.846791 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3492e0-ba82-4a2d-9cac-09e086e83b34 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:03.857910 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e4533-aa4e-403f-8b44-effa7312e38d None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:03.858514 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e4533-aa4e-403f-8b44-effa7312e38d None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:03.859013 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e4533-aa4e-403f-8b44-effa7312e38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:03.903848 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 951/1894] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:54:03 2022] POST /identity/v3/users => generated 288 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:54:03.913255 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3492e0-ba82-4a2d-9cac-09e086e83b34 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:03.926124 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-8a9e4533-aa4e-403f-8b44-effa7312e38d None None] MFA Rules not processed for user `04bc6ee009e34a5f82e2807db51523d3`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:54:03.934503 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-8a9e4533-aa4e-403f-8b44-effa7312e38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:03.950992 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3492e0-ba82-4a2d-9cac-09e086e83b34 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:03.983497 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84dda1a-44fc-4547-8fbd-c37497e2ed6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:03.995726 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84dda1a-44fc-4547-8fbd-c37497e2ed6e admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:03.996343 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84dda1a-44fc-4547-8fbd-c37497e2ed6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:03.996952 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84dda1a-44fc-4547-8fbd-c37497e2ed6e admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:03.998442 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84dda1a-44fc-4547-8fbd-c37497e2ed6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:04.003182 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84dda1a-44fc-4547-8fbd-c37497e2ed6e admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:04.037664 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 952/1895] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:54:04.040579 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84dda1a-44fc-4547-8fbd-c37497e2ed6e admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:04.046218 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-d84dda1a-44fc-4547-8fbd-c37497e2ed6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:04.093648 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84dda1a-44fc-4547-8fbd-c37497e2ed6e admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:04.115021 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d7da4-9487-4b3e-9fa6-ff9a9c701008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:04.115962 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d7da4-9487-4b3e-9fa6-ff9a9c701008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:04.116246 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d7da4-9487-4b3e-9fa6-ff9a9c701008 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:04.116526 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d7da4-9487-4b3e-9fa6-ff9a9c701008 admin admin] PATH_INFO: `/v3/projects/ffe52be945ea4b3b8b64493677bb6b55` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:04.120289 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0d7da4-9487-4b3e-9fa6-ff9a9c701008 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffe52be945ea4b3b8b64493677bb6b55)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:04.123588 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0d7da4-9487-4b3e-9fa6-ff9a9c701008 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:04.167231 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 944/1896] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Oct 28 20:54:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:54:04.170055 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e4533-aa4e-403f-8b44-effa7312e38d None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:04.195177 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e4533-aa4e-403f-8b44-effa7312e38d None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:04.212147 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6e73f-ba22-4ac6-87f5-d6349b0e77a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:04.213079 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6e73f-ba22-4ac6-87f5-d6349b0e77a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:04.213372 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6e73f-ba22-4ac6-87f5-d6349b0e77a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:04.213709 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6e73f-ba22-4ac6-87f5-d6349b0e77a1 admin admin] PATH_INFO: `/v3/projects/1e65f3113912437ea549af27c6b4a63b/users/c9c3ddf662734243bcf37476e3c805cf/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:04.250738 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-5b0d7da4-9487-4b3e-9fa6-ff9a9c701008 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffe52be945ea4b3b8b64493677bb6b55', 'request_id': 'req-5b0d7da4-9487-4b3e-9fa6-ff9a9c701008'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:04.261036 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-5b0d7da4-9487-4b3e-9fa6-ff9a9c701008 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffe52be945ea4b3b8b64493677bb6b55', 'request_id': 'req-5b0d7da4-9487-4b3e-9fa6-ff9a9c701008'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:04.267642 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6e73f-ba22-4ac6-87f5-d6349b0e77a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e65f3113912437ea549af27c6b4a63b, user_id=c9c3ddf662734243bcf37476e3c805cf, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:04.272008 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-5b0d7da4-9487-4b3e-9fa6-ff9a9c701008 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffe52be945ea4b3b8b64493677bb6b55', 'request_id': 'req-5b0d7da4-9487-4b3e-9fa6-ff9a9c701008'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:04.286814 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6e73f-ba22-4ac6-87f5-d6349b0e77a1 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:04.296391 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-5b0d7da4-9487-4b3e-9fa6-ff9a9c701008 admin admin] The token cache is being invalidate because project ffe52be945ea4b3b8b64493677bb6b55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:54:04.296884 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-5b0d7da4-9487-4b3e-9fa6-ff9a9c701008 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:04.297739 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-5b0d7da4-9487-4b3e-9fa6-ff9a9c701008 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:04.301094 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 953/1897] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:54:04 2022] DELETE /identity/v3/projects/ffe52be945ea4b3b8b64493677bb6b55 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:54:04.307130 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7e03a-e91e-4624-a2fe-d921c6936469 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:04.307130 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7e03a-e91e-4624-a2fe-d921c6936469 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:04.307130 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7e03a-e91e-4624-a2fe-d921c6936469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:04.326687 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 945/1898] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:54:04 2022] PUT /identity/v3/projects/1e65f3113912437ea549af27c6b4a63b/users/c9c3ddf662734243bcf37476e3c805cf/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:54:04.332082 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6e73f-ba22-4ac6-87f5-d6349b0e77a1 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:04.338005 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-a8d7e03a-e91e-4624-a2fe-d921c6936469 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:54:04.339458 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-a8d7e03a-e91e-4624-a2fe-d921c6936469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:04.340090 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-aaa6e73f-ba22-4ac6-87f5-d6349b0e77a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:04.431697 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 954/1899] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:54:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:54:04.433561 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec7347-78d5-44cb-8c5b-6b2459f9abb6 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:04.433952 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec7347-78d5-44cb-8c5b-6b2459f9abb6 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:04.434382 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec7347-78d5-44cb-8c5b-6b2459f9abb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:04.459159 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-a8ec7347-78d5-44cb-8c5b-6b2459f9abb6 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:54:04.460580 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-a8ec7347-78d5-44cb-8c5b-6b2459f9abb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:04.499431 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 955/1900] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:54:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:54:04.503202 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec7347-78d5-44cb-8c5b-6b2459f9abb6 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:04.505838 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6e73f-ba22-4ac6-87f5-d6349b0e77a1 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:04.507077 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-a8ec7347-78d5-44cb-8c5b-6b2459f9abb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:04.513463 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7929bf-9ad1-40bf-afb2-2d9860b49897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:04.514891 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7929bf-9ad1-40bf-afb2-2d9860b49897 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:04.515359 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7929bf-9ad1-40bf-afb2-2d9860b49897 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:04.515949 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7929bf-9ad1-40bf-afb2-2d9860b49897 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:04.516904 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7929bf-9ad1-40bf-afb2-2d9860b49897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:04.519818 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7929bf-9ad1-40bf-afb2-2d9860b49897 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:04.550426 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 946/1901] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:54:04.556481 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7929bf-9ad1-40bf-afb2-2d9860b49897 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:04.592304 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7929bf-9ad1-40bf-afb2-2d9860b49897 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:04.598547 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15415635-a9b2-4eef-adeb-55c35f023d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:04.599557 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15415635-a9b2-4eef-adeb-55c35f023d5f admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:04.599929 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15415635-a9b2-4eef-adeb-55c35f023d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:04.600211 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15415635-a9b2-4eef-adeb-55c35f023d5f admin admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:04.601071 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15415635-a9b2-4eef-adeb-55c35f023d5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:54:04.601426 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15415635-a9b2-4eef-adeb-55c35f023d5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:04.603412 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15415635-a9b2-4eef-adeb-55c35f023d5f admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:04.623874 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 947/1902] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:54:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:54:04.629067 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15415635-a9b2-4eef-adeb-55c35f023d5f admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:04.641443 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15415635-a9b2-4eef-adeb-55c35f023d5f admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:04.654891 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689feb64-068b-4081-a9fb-b86e3e057ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:04.656477 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689feb64-068b-4081-a9fb-b86e3e057ccb admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:04.657189 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689feb64-068b-4081-a9fb-b86e3e057ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:04.658532 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689feb64-068b-4081-a9fb-b86e3e057ccb admin admin] PATH_INFO: `/v3/projects/1e65f3113912437ea549af27c6b4a63b/users/c9c3ddf662734243bcf37476e3c805cf/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:04.661846 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689feb64-068b-4081-a9fb-b86e3e057ccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e65f3113912437ea549af27c6b4a63b, user_id=c9c3ddf662734243bcf37476e3c805cf, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:04.664915 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689feb64-068b-4081-a9fb-b86e3e057ccb admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:04.681762 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 948/1903] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:54:04 2022] PUT /identity/v3/projects/1e65f3113912437ea549af27c6b4a63b/users/c9c3ddf662734243bcf37476e3c805cf/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:54:04.690727 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689feb64-068b-4081-a9fb-b86e3e057ccb admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:04.774127 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec7347-78d5-44cb-8c5b-6b2459f9abb6 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:04.868328 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689feb64-068b-4081-a9fb-b86e3e057ccb admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:04.883434 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5706d-f7d9-4c2b-95d2-e783cc0f03df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:04.884226 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5706d-f7d9-4c2b-95d2-e783cc0f03df admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:04.884509 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5706d-f7d9-4c2b-95d2-e783cc0f03df admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:04.884988 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5706d-f7d9-4c2b-95d2-e783cc0f03df admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:04.885605 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5706d-f7d9-4c2b-95d2-e783cc0f03df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:04.887968 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5706d-f7d9-4c2b-95d2-e783cc0f03df admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:04.952327 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 949/1904] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:54:04 2022] POST /identity/v3/projects => generated 371 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:54:04.959415 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3dd38-df42-4e46-a7c3-2dbddf3ca2cd None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:04.959624 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3dd38-df42-4e46-a7c3-2dbddf3ca2cd None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:04.959915 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3dd38-df42-4e46-a7c3-2dbddf3ca2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:04.975775 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c2f61-606f-42dd-b898-dc15c5b12c3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:04.976633 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c2f61-606f-42dd-b898-dc15c5b12c3d service nova] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:04.976971 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c2f61-606f-42dd-b898-dc15c5b12c3d service nova] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:04.977257 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c2f61-606f-42dd-b898-dc15c5b12c3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:04.985388 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-b68c2f61-606f-42dd-b898-dc15c5b12c3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:05.004985 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-bdc3dd38-df42-4e46-a7c3-2dbddf3ca2cd None None] MFA Rules not processed for user `c9c3ddf662734243bcf37476e3c805cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:54:05.007240 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-bdc3dd38-df42-4e46-a7c3-2dbddf3ca2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:05.016151 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c2f61-606f-42dd-b898-dc15c5b12c3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:05.023301 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c2f61-606f-42dd-b898-dc15c5b12c3d service nova] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:05.068993 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 956/1905] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:54:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:54:05.074902 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c2f61-606f-42dd-b898-dc15c5b12c3d service nova] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:05.130181 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c2f61-606f-42dd-b898-dc15c5b12c3d service nova] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:05.258491 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 950/1906] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:54:04 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:54:05.281846 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3dd38-df42-4e46-a7c3-2dbddf3ca2cd None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:05.284986 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-bdc3dd38-df42-4e46-a7c3-2dbddf3ca2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:05.335343 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b7dbd-a1d9-4b7b-ae2e-c92e8e010234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:05.342153 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b7dbd-a1d9-4b7b-ae2e-c92e8e010234 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:05.342583 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b7dbd-a1d9-4b7b-ae2e-c92e8e010234 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:05.342956 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b7dbd-a1d9-4b7b-ae2e-c92e8e010234 admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:05.344793 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b7dbd-a1d9-4b7b-ae2e-c92e8e010234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:05.346777 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b7dbd-a1d9-4b7b-ae2e-c92e8e010234 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:05.404559 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 957/1907] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:54:05 2022] POST /identity/v3/users => generated 286 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:54:05.409411 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b7dbd-a1d9-4b7b-ae2e-c92e8e010234 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:05.425589 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b7dbd-a1d9-4b7b-ae2e-c92e8e010234 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:05.435223 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265424ff-a0f9-4e33-adf7-533761e5d594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:05.436294 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265424ff-a0f9-4e33-adf7-533761e5d594 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:05.436591 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265424ff-a0f9-4e33-adf7-533761e5d594 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:05.437046 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265424ff-a0f9-4e33-adf7-533761e5d594 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:05.438131 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265424ff-a0f9-4e33-adf7-533761e5d594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:05.441961 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265424ff-a0f9-4e33-adf7-533761e5d594 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:05.459441 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 958/1908] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:54:05.461353 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265424ff-a0f9-4e33-adf7-533761e5d594 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:05.465457 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3dd38-df42-4e46-a7c3-2dbddf3ca2cd None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:05.471367 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7524ab-389a-49f2-95d4-9639cc8c44c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:05.472242 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7524ab-389a-49f2-95d4-9639cc8c44c8 service cinder] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:05.472628 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7524ab-389a-49f2-95d4-9639cc8c44c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:05.473007 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7524ab-389a-49f2-95d4-9639cc8c44c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:05.474980 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265424ff-a0f9-4e33-adf7-533761e5d594 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:05.481716 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa94a9-3c95-4874-9ab1-660f08fce51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:05.482811 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa94a9-3c95-4874-9ab1-660f08fce51a admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:05.483235 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa94a9-3c95-4874-9ab1-660f08fce51a admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:05.483645 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa94a9-3c95-4874-9ab1-660f08fce51a admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:05.484594 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa94a9-3c95-4874-9ab1-660f08fce51a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:05.489324 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7524ab-389a-49f2-95d4-9639cc8c44c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:05.489893 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa94a9-3c95-4874-9ab1-660f08fce51a admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:05.491329 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7524ab-389a-49f2-95d4-9639cc8c44c8 service cinder] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:05.505947 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 959/1909] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:54:05.512897 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa94a9-3c95-4874-9ab1-660f08fce51a admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:05.518374 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 951/1910] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:54:05 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:54:05.559480 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa94a9-3c95-4874-9ab1-660f08fce51a admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:05.584973 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd72c5-6fe1-4a47-bac0-f781d5a4cdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:05.586930 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd72c5-6fe1-4a47-bac0-f781d5a4cdef admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:05.587444 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd72c5-6fe1-4a47-bac0-f781d5a4cdef admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:05.587997 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd72c5-6fe1-4a47-bac0-f781d5a4cdef admin admin] PATH_INFO: `/v3/projects/e2cd03a700344414893c719d57e02801/users/a276dc11799a4ad3a0520ecc12cfe314/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:05.645896 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7524ab-389a-49f2-95d4-9639cc8c44c8 service cinder] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:05.656259 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd72c5-6fe1-4a47-bac0-f781d5a4cdef admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2cd03a700344414893c719d57e02801, user_id=a276dc11799a4ad3a0520ecc12cfe314, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:05.660570 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7524ab-389a-49f2-95d4-9639cc8c44c8 service cinder] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:05.663579 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd72c5-6fe1-4a47-bac0-f781d5a4cdef admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:05.682638 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ec722-84c2-462e-8fc9-e085a3395778 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:05.683644 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ec722-84c2-462e-8fc9-e085a3395778 service cinder] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:05.684110 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ec722-84c2-462e-8fc9-e085a3395778 service cinder] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:05.684555 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ec722-84c2-462e-8fc9-e085a3395778 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:05.687022 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-db5ec722-84c2-462e-8fc9-e085a3395778 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:05.702148 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 960/1911] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:54:05 2022] PUT /identity/v3/projects/e2cd03a700344414893c719d57e02801/users/a276dc11799a4ad3a0520ecc12cfe314/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:54:05.714036 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d1600-9226-487e-8903-dc3ea174decc None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:05.714524 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d1600-9226-487e-8903-dc3ea174decc None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:05.715645 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d1600-9226-487e-8903-dc3ea174decc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:05.800950 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-c58d1600-9226-487e-8903-dc3ea174decc None None] MFA Rules not processed for user `a276dc11799a4ad3a0520ecc12cfe314`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:54:05.802547 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-c58d1600-9226-487e-8903-dc3ea174decc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:05.908359 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ec722-84c2-462e-8fc9-e085a3395778 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:05.910966 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ec722-84c2-462e-8fc9-e085a3395778 service cinder] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:05.959457 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 952/1912] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:54:05 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:54:06.016004 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 961/1913] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:54:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:54:06.137993 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ec722-84c2-462e-8fc9-e085a3395778 service cinder] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:06.140585 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-db5ec722-84c2-462e-8fc9-e085a3395778 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:06.185888 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ec722-84c2-462e-8fc9-e085a3395778 service cinder] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:06.286443 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ea31f-1bb8-4de4-bfa8-5a202bc4d133 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:06.287926 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ea31f-1bb8-4de4-bfa8-5a202bc4d133 service cinder] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:06.288509 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ea31f-1bb8-4de4-bfa8-5a202bc4d133 service cinder] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:06.289009 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ea31f-1bb8-4de4-bfa8-5a202bc4d133 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:06.305231 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ea31f-1bb8-4de4-bfa8-5a202bc4d133 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:06.305231 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ea31f-1bb8-4de4-bfa8-5a202bc4d133 service cinder] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:06.319998 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 953/1914] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:54:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:54:06.341676 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d1600-9226-487e-8903-dc3ea174decc None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:06.455548 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d1600-9226-487e-8903-dc3ea174decc None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:06.461635 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011897c-410c-42d1-bb98-235a11d70513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:06.462843 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011897c-410c-42d1-bb98-235a11d70513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:06.463193 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011897c-410c-42d1-bb98-235a11d70513 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:06.463572 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011897c-410c-42d1-bb98-235a11d70513 admin admin] PATH_INFO: `/v3/users/a276dc11799a4ad3a0520ecc12cfe314` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:06.466849 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d011897c-410c-42d1-bb98-235a11d70513 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a276dc11799a4ad3a0520ecc12cfe314)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:06.471429 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d011897c-410c-42d1-bb98-235a11d70513 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:06.557859 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-d011897c-410c-42d1-bb98-235a11d70513 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a276dc11799a4ad3a0520ecc12cfe314'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:06.572640 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-d011897c-410c-42d1-bb98-235a11d70513 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a276dc11799a4ad3a0520ecc12cfe314'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:06.594324 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-d011897c-410c-42d1-bb98-235a11d70513 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a276dc11799a4ad3a0520ecc12cfe314'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:06.596301 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-d011897c-410c-42d1-bb98-235a11d70513 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a276dc11799a4ad3a0520ecc12cfe314'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:06.626837 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-d011897c-410c-42d1-bb98-235a11d70513 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a276dc11799a4ad3a0520ecc12cfe314'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:06.647009 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 962/1915] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:54:06 2022] DELETE /identity/v3/users/a276dc11799a4ad3a0520ecc12cfe314 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:54:06.648848 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fbb29-8448-44a1-a830-b383e1f718ee None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:06.649137 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fbb29-8448-44a1-a830-b383e1f718ee None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:06.649690 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fbb29-8448-44a1-a830-b383e1f718ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:06.673208 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-a60fbb29-8448-44a1-a830-b383e1f718ee None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:54:06.675973 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-a60fbb29-8448-44a1-a830-b383e1f718ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:06.764801 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 954/1916] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:54:06.779816 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011897c-410c-42d1-bb98-235a11d70513 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:06.782458 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-d011897c-410c-42d1-bb98-235a11d70513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:06.870329 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011897c-410c-42d1-bb98-235a11d70513 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:06.874843 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84104278-6311-466a-af28-967adb046507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:06.875507 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84104278-6311-466a-af28-967adb046507 service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:06.875812 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84104278-6311-466a-af28-967adb046507 service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:06.876094 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84104278-6311-466a-af28-967adb046507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:06.889453 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84104278-6311-466a-af28-967adb046507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:06.893018 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84104278-6311-466a-af28-967adb046507 service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:06.911303 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 963/1917] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:54:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:54:07.477997 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fbb29-8448-44a1-a830-b383e1f718ee None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:07.481925 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-a60fbb29-8448-44a1-a830-b383e1f718ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:07.526373 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fbb29-8448-44a1-a830-b383e1f718ee None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:07.536736 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a12ae-286e-4859-bafe-7a5cfc4f0009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:07.538623 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a12ae-286e-4859-bafe-7a5cfc4f0009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:07.539189 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a12ae-286e-4859-bafe-7a5cfc4f0009 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:07.539875 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a12ae-286e-4859-bafe-7a5cfc4f0009 admin admin] PATH_INFO: `/v3/projects/e2cd03a700344414893c719d57e02801` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:07.542848 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a12ae-286e-4859-bafe-7a5cfc4f0009 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2cd03a700344414893c719d57e02801)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:07.547443 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a12ae-286e-4859-bafe-7a5cfc4f0009 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:07.667110 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-435a12ae-286e-4859-bafe-7a5cfc4f0009 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2cd03a700344414893c719d57e02801', 'request_id': 'req-435a12ae-286e-4859-bafe-7a5cfc4f0009'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:07.677925 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-435a12ae-286e-4859-bafe-7a5cfc4f0009 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2cd03a700344414893c719d57e02801', 'request_id': 'req-435a12ae-286e-4859-bafe-7a5cfc4f0009'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:07.695781 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-435a12ae-286e-4859-bafe-7a5cfc4f0009 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2cd03a700344414893c719d57e02801', 'request_id': 'req-435a12ae-286e-4859-bafe-7a5cfc4f0009'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:07.722724 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-435a12ae-286e-4859-bafe-7a5cfc4f0009 admin admin] The token cache is being invalidate because project e2cd03a700344414893c719d57e02801 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:54:07.723461 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-435a12ae-286e-4859-bafe-7a5cfc4f0009 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:07.725321 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-435a12ae-286e-4859-bafe-7a5cfc4f0009 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:07.728978 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 955/1918] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:54:07 2022] DELETE /identity/v3/projects/e2cd03a700344414893c719d57e02801 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:54:07.735193 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db0e35-0105-4e99-bcbf-316b0ac7f8e5 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:07.736402 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db0e35-0105-4e99-bcbf-316b0ac7f8e5 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:07.736673 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db0e35-0105-4e99-bcbf-316b0ac7f8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:07.776233 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-f1db0e35-0105-4e99-bcbf-316b0ac7f8e5 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:54:07.778805 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-f1db0e35-0105-4e99-bcbf-316b0ac7f8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:07.897172 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 964/1919] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:54:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:54:07.908763 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a665cf-bbac-467e-9a60-c5b6c607a3fe None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:07.909453 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a665cf-bbac-467e-9a60-c5b6c607a3fe None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:07.909875 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a665cf-bbac-467e-9a60-c5b6c607a3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:07.956210 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-72a665cf-bbac-467e-9a60-c5b6c607a3fe None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:54:07.958621 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-72a665cf-bbac-467e-9a60-c5b6c607a3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:07.975419 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 956/1920] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:54:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:54:07.980257 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db0e35-0105-4e99-bcbf-316b0ac7f8e5 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:07.996543 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db0e35-0105-4e99-bcbf-316b0ac7f8e5 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:08.005470 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d87f24-1693-4ae7-b300-1a5d870ed187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:08.006769 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d87f24-1693-4ae7-b300-1a5d870ed187 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:08.007364 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d87f24-1693-4ae7-b300-1a5d870ed187 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:08.007980 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d87f24-1693-4ae7-b300-1a5d870ed187 admin admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:08.009468 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d87f24-1693-4ae7-b300-1a5d870ed187 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:54:08.010099 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d87f24-1693-4ae7-b300-1a5d870ed187 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:08.013311 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d87f24-1693-4ae7-b300-1a5d870ed187 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:08.035605 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 965/1921] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:54:08.040490 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a665cf-bbac-467e-9a60-c5b6c607a3fe None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:08.051586 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a665cf-bbac-467e-9a60-c5b6c607a3fe None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:08.056883 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f8164-de4e-4f8d-b645-aa40263f5d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:08.057565 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f8164-de4e-4f8d-b645-aa40263f5d4c admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:08.057848 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f8164-de4e-4f8d-b645-aa40263f5d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:08.058123 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f8164-de4e-4f8d-b645-aa40263f5d4c admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:08.058859 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f8164-de4e-4f8d-b645-aa40263f5d4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:08.060883 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f8164-de4e-4f8d-b645-aa40263f5d4c admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:08.103190 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 957/1922] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:54:08 2022] POST /identity/v3/projects => generated 381 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:54:08.110043 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d87f24-1693-4ae7-b300-1a5d870ed187 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:08.122726 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d87f24-1693-4ae7-b300-1a5d870ed187 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:08.197239 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7ece4-a94e-429f-ade7-ee1a92b57ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:08.198134 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7ece4-a94e-429f-ade7-ee1a92b57ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:08.198554 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7ece4-a94e-429f-ade7-ee1a92b57ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:08.198922 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7ece4-a94e-429f-ade7-ee1a92b57ae7 admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:08.199904 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7ece4-a94e-429f-ade7-ee1a92b57ae7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:08.202122 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7ece4-a94e-429f-ade7-ee1a92b57ae7 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:08.243803 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 966/1923] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:54:08 2022] POST /identity/v3/users => generated 291 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:54:08.247991 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f8164-de4e-4f8d-b645-aa40263f5d4c admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:08.260116 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f8164-de4e-4f8d-b645-aa40263f5d4c admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:08.265404 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38d4e9-e649-4b92-80b6-b3c406bc16b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:08.266193 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38d4e9-e649-4b92-80b6-b3c406bc16b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:08.266537 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38d4e9-e649-4b92-80b6-b3c406bc16b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:08.266874 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38d4e9-e649-4b92-80b6-b3c406bc16b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:08.269338 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38d4e9-e649-4b92-80b6-b3c406bc16b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:08.271028 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38d4e9-e649-4b92-80b6-b3c406bc16b8 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:08.284392 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 958/1924] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:54:08.290483 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7ece4-a94e-429f-ade7-ee1a92b57ae7 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:08.309317 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7ece4-a94e-429f-ade7-ee1a92b57ae7 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:08.317869 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2449f-bd0a-44f4-999a-bf0581287a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:08.318991 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2449f-bd0a-44f4-999a-bf0581287a3c admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:08.319471 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2449f-bd0a-44f4-999a-bf0581287a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:08.321558 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2449f-bd0a-44f4-999a-bf0581287a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:08.321558 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b2449f-bd0a-44f4-999a-bf0581287a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:08.324498 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b2449f-bd0a-44f4-999a-bf0581287a3c admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:08.341121 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 967/1925] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:54:08.347052 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38d4e9-e649-4b92-80b6-b3c406bc16b8 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:08.363673 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38d4e9-e649-4b92-80b6-b3c406bc16b8 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:08.375970 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c942289-0017-48a9-9855-623de82f96fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:08.377849 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c942289-0017-48a9-9855-623de82f96fc admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:08.378622 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c942289-0017-48a9-9855-623de82f96fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:08.379171 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c942289-0017-48a9-9855-623de82f96fc admin admin] PATH_INFO: `/v3/projects/1e9ccf17b7e64b9ead1431d098c44b25/users/3cee0aebbb43415c96e4dca0392f9d2e/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:08.405494 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c942289-0017-48a9-9855-623de82f96fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e9ccf17b7e64b9ead1431d098c44b25, user_id=3cee0aebbb43415c96e4dca0392f9d2e, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:08.409485 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c942289-0017-48a9-9855-623de82f96fc admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:08.432352 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 959/1926] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:54:08 2022] PUT /identity/v3/projects/1e9ccf17b7e64b9ead1431d098c44b25/users/3cee0aebbb43415c96e4dca0392f9d2e/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:54:08.451855 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bd4c0-403e-4c33-897f-bd814e010034 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:08.452328 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bd4c0-403e-4c33-897f-bd814e010034 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:08.452818 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bd4c0-403e-4c33-897f-bd814e010034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:08.495216 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-892bd4c0-403e-4c33-897f-bd814e010034 None None] MFA Rules not processed for user `3cee0aebbb43415c96e4dca0392f9d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:54:08.496528 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-892bd4c0-403e-4c33-897f-bd814e010034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:08.608131 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 968/1927] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:54:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:54:08.625801 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c942289-0017-48a9-9855-623de82f96fc admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:08.628592 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-4c942289-0017-48a9-9855-623de82f96fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:08.729095 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c942289-0017-48a9-9855-623de82f96fc admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:08.738814 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bd35f-e7c1-4ad9-a41e-3a8d8f31bc54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:08.740023 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bd35f-e7c1-4ad9-a41e-3a8d8f31bc54 service cinder] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:08.742840 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bd35f-e7c1-4ad9-a41e-3a8d8f31bc54 service cinder] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:08.743452 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bd35f-e7c1-4ad9-a41e-3a8d8f31bc54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:08.763595 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5bd35f-e7c1-4ad9-a41e-3a8d8f31bc54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:08.765638 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5bd35f-e7c1-4ad9-a41e-3a8d8f31bc54 service cinder] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:08.780059 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 960/1928] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:54:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:54:17.521821 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892bd4c0-403e-4c33-897f-bd814e010034 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:17.523726 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-892bd4c0-403e-4c33-897f-bd814e010034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:17.647052 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892bd4c0-403e-4c33-897f-bd814e010034 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:17.652512 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d9112-a8f3-4fd9-9541-df03a3792640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:17.653777 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d9112-a8f3-4fd9-9541-df03a3792640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:17.654068 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d9112-a8f3-4fd9-9541-df03a3792640 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:17.654344 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d9112-a8f3-4fd9-9541-df03a3792640 admin admin] PATH_INFO: `/v3/users/08f56cb899a54346997005d84a21a707` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:17.655617 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d9112-a8f3-4fd9-9541-df03a3792640 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08f56cb899a54346997005d84a21a707)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:17.658928 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d9112-a8f3-4fd9-9541-df03a3792640 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:17.754684 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-d80d9112-a8f3-4fd9-9541-df03a3792640 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08f56cb899a54346997005d84a21a707'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:17.778154 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-d80d9112-a8f3-4fd9-9541-df03a3792640 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08f56cb899a54346997005d84a21a707'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:17.804571 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-d80d9112-a8f3-4fd9-9541-df03a3792640 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08f56cb899a54346997005d84a21a707'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:17.812502 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-d80d9112-a8f3-4fd9-9541-df03a3792640 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08f56cb899a54346997005d84a21a707'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:17.839302 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-d80d9112-a8f3-4fd9-9541-df03a3792640 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08f56cb899a54346997005d84a21a707'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:17.851050 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 969/1929] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:54:17 2022] DELETE /identity/v3/users/08f56cb899a54346997005d84a21a707 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:54:17.860975 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e5453-e469-408c-b9b4-cec49091164c None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:17.861886 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e5453-e469-408c-b9b4-cec49091164c None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:17.861886 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e5453-e469-408c-b9b4-cec49091164c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:17.889364 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-736e5453-e469-408c-b9b4-cec49091164c None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:54:17.890882 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-736e5453-e469-408c-b9b4-cec49091164c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:17.985286 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 961/1930] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:54:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:54:18.003146 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d9112-a8f3-4fd9-9541-df03a3792640 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:18.004875 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-d80d9112-a8f3-4fd9-9541-df03a3792640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:18.165127 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d9112-a8f3-4fd9-9541-df03a3792640 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:18.169324 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281835e7-7a55-4f0e-9d80-0cdbadb769d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:18.169991 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281835e7-7a55-4f0e-9d80-0cdbadb769d2 service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:18.170269 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281835e7-7a55-4f0e-9d80-0cdbadb769d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:18.170772 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281835e7-7a55-4f0e-9d80-0cdbadb769d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:18.182383 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281835e7-7a55-4f0e-9d80-0cdbadb769d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:18.184208 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281835e7-7a55-4f0e-9d80-0cdbadb769d2 service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:18.213572 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 970/1931] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:54:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:54:18.764401 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e5453-e469-408c-b9b4-cec49091164c None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:18.770899 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-736e5453-e469-408c-b9b4-cec49091164c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:18.811199 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e5453-e469-408c-b9b4-cec49091164c None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:18.828571 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a62ad0-2063-495e-addd-d7e91c26cb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:18.833826 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a62ad0-2063-495e-addd-d7e91c26cb46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:18.834538 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a62ad0-2063-495e-addd-d7e91c26cb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:18.835062 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a62ad0-2063-495e-addd-d7e91c26cb46 admin admin] PATH_INFO: `/v3/projects/0a167a5f4e7547f5aab69e4b7122c7e2` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:18.839268 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a62ad0-2063-495e-addd-d7e91c26cb46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a167a5f4e7547f5aab69e4b7122c7e2)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:18.843526 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a62ad0-2063-495e-addd-d7e91c26cb46 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:18.971780 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-73a62ad0-2063-495e-addd-d7e91c26cb46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a167a5f4e7547f5aab69e4b7122c7e2', 'request_id': 'req-73a62ad0-2063-495e-addd-d7e91c26cb46'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:18.989252 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-73a62ad0-2063-495e-addd-d7e91c26cb46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a167a5f4e7547f5aab69e4b7122c7e2', 'request_id': 'req-73a62ad0-2063-495e-addd-d7e91c26cb46'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:19.004544 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-73a62ad0-2063-495e-addd-d7e91c26cb46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a167a5f4e7547f5aab69e4b7122c7e2', 'request_id': 'req-73a62ad0-2063-495e-addd-d7e91c26cb46'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:19.033276 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-73a62ad0-2063-495e-addd-d7e91c26cb46 admin admin] The token cache is being invalidate because project 0a167a5f4e7547f5aab69e4b7122c7e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:54:19.034444 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-73a62ad0-2063-495e-addd-d7e91c26cb46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:19.036177 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-73a62ad0-2063-495e-addd-d7e91c26cb46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:19.038998 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 962/1932] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:54:18 2022] DELETE /identity/v3/projects/0a167a5f4e7547f5aab69e4b7122c7e2 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:54:19.045480 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bd325-1eac-49b3-8974-20d33377be6d None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:19.046968 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bd325-1eac-49b3-8974-20d33377be6d None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:19.047486 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bd325-1eac-49b3-8974-20d33377be6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:19.074776 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-1b6bd325-1eac-49b3-8974-20d33377be6d None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:54:19.076834 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-1b6bd325-1eac-49b3-8974-20d33377be6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:19.195581 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 971/1933] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:54:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:54:19.209398 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388996e0-122d-43b5-a796-3074235ebf4a None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:19.209908 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388996e0-122d-43b5-a796-3074235ebf4a None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:19.210395 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388996e0-122d-43b5-a796-3074235ebf4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:19.258976 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-388996e0-122d-43b5-a796-3074235ebf4a None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:54:19.261098 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-388996e0-122d-43b5-a796-3074235ebf4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:19.275279 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 963/1934] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:54:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:54:19.281694 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bd325-1eac-49b3-8974-20d33377be6d None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:19.297130 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bd325-1eac-49b3-8974-20d33377be6d None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:19.306098 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cffffc0-aab4-4766-8ba1-e50848a2c3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:19.306931 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffffc0-aab4-4766-8ba1-e50848a2c3a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:19.307330 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffffc0-aab4-4766-8ba1-e50848a2c3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:19.307711 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffffc0-aab4-4766-8ba1-e50848a2c3a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:19.308641 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cffffc0-aab4-4766-8ba1-e50848a2c3a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:54:19.309360 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cffffc0-aab4-4766-8ba1-e50848a2c3a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:19.311401 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cffffc0-aab4-4766-8ba1-e50848a2c3a3 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:19.331550 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 972/1935] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:54:19.332898 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388996e0-122d-43b5-a796-3074235ebf4a None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:19.344213 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388996e0-122d-43b5-a796-3074235ebf4a None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:19.351915 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8acab-18a1-4d27-8124-f6e2c657cbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:19.352611 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8acab-18a1-4d27-8124-f6e2c657cbaf admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:19.352962 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8acab-18a1-4d27-8124-f6e2c657cbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:19.353199 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8acab-18a1-4d27-8124-f6e2c657cbaf admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:19.354198 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe8acab-18a1-4d27-8124-f6e2c657cbaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:19.356332 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe8acab-18a1-4d27-8124-f6e2c657cbaf admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:19.416030 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 964/1936] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:54:19 2022] POST /identity/v3/projects => generated 375 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:54:19.418932 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cffffc0-aab4-4766-8ba1-e50848a2c3a3 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:19.432021 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cffffc0-aab4-4766-8ba1-e50848a2c3a3 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:19.510503 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ae577-d635-420a-8827-3977e46de3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:19.511283 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ae577-d635-420a-8827-3977e46de3a1 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:19.511661 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ae577-d635-420a-8827-3977e46de3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:19.512007 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ae577-d635-420a-8827-3977e46de3a1 admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:19.512794 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ae577-d635-420a-8827-3977e46de3a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:19.514891 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ae577-d635-420a-8827-3977e46de3a1 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:19.550957 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 973/1937] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:54:19 2022] POST /identity/v3/users => generated 288 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:54:19.552447 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8acab-18a1-4d27-8124-f6e2c657cbaf admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:19.581141 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8acab-18a1-4d27-8124-f6e2c657cbaf admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:19.599774 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5db7b4-06aa-4f52-b4d0-17f564cbfd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:19.599774 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5db7b4-06aa-4f52-b4d0-17f564cbfd74 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:19.600603 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5db7b4-06aa-4f52-b4d0-17f564cbfd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:19.601070 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5db7b4-06aa-4f52-b4d0-17f564cbfd74 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:19.602544 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5db7b4-06aa-4f52-b4d0-17f564cbfd74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:19.608294 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5db7b4-06aa-4f52-b4d0-17f564cbfd74 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:19.640417 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 965/1938] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:54:19.641901 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ae577-d635-420a-8827-3977e46de3a1 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:19.653784 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ae577-d635-420a-8827-3977e46de3a1 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:19.661007 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d64e2-68e1-4927-89dc-2d1b881d8524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:19.662128 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d64e2-68e1-4927-89dc-2d1b881d8524 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:19.662601 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d64e2-68e1-4927-89dc-2d1b881d8524 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:19.663073 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d64e2-68e1-4927-89dc-2d1b881d8524 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:19.664078 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d64e2-68e1-4927-89dc-2d1b881d8524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:19.665942 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d64e2-68e1-4927-89dc-2d1b881d8524 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:19.681311 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 974/1939] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:54:19.682475 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5db7b4-06aa-4f52-b4d0-17f564cbfd74 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:19.701632 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5db7b4-06aa-4f52-b4d0-17f564cbfd74 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:19.708385 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca645b26-2ac1-459c-a7db-f2b58404b596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:19.709581 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca645b26-2ac1-459c-a7db-f2b58404b596 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:19.709933 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca645b26-2ac1-459c-a7db-f2b58404b596 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:19.710493 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca645b26-2ac1-459c-a7db-f2b58404b596 admin admin] PATH_INFO: `/v3/projects/9981f3807f9b41a3be1d1ef719734e51/users/40ba15ac1e1a4e699d83c5f4d9bec9f4/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:19.734760 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca645b26-2ac1-459c-a7db-f2b58404b596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9981f3807f9b41a3be1d1ef719734e51, user_id=40ba15ac1e1a4e699d83c5f4d9bec9f4, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:19.736724 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca645b26-2ac1-459c-a7db-f2b58404b596 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:19.759116 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 966/1940] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:54:19 2022] PUT /identity/v3/projects/9981f3807f9b41a3be1d1ef719734e51/users/40ba15ac1e1a4e699d83c5f4d9bec9f4/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:54:19.780117 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bb07e-d4b2-4461-9006-28a09b6d5b8d None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:19.780618 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bb07e-d4b2-4461-9006-28a09b6d5b8d None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:19.781099 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bb07e-d4b2-4461-9006-28a09b6d5b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:19.874881 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-d25bb07e-d4b2-4461-9006-28a09b6d5b8d None None] MFA Rules not processed for user `40ba15ac1e1a4e699d83c5f4d9bec9f4`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:54:19.877849 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-d25bb07e-d4b2-4461-9006-28a09b6d5b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:20.059610 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 975/1941] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:54:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:54:20.080253 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca645b26-2ac1-459c-a7db-f2b58404b596 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:20.083382 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-ca645b26-2ac1-459c-a7db-f2b58404b596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:20.286203 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca645b26-2ac1-459c-a7db-f2b58404b596 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:20.292571 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879cecb-920a-48e1-838b-0f6165b0a2e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:20.293816 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879cecb-920a-48e1-838b-0f6165b0a2e5 service cinder] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:20.294418 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879cecb-920a-48e1-838b-0f6165b0a2e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:20.295263 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879cecb-920a-48e1-838b-0f6165b0a2e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:20.307890 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25bb07e-d4b2-4461-9006-28a09b6d5b8d None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:20.310110 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-d25bb07e-d4b2-4461-9006-28a09b6d5b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:20.316166 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2879cecb-920a-48e1-838b-0f6165b0a2e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:20.319161 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2879cecb-920a-48e1-838b-0f6165b0a2e5 service cinder] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:20.337146 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 967/1942] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:54:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:54:20.455273 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25bb07e-d4b2-4461-9006-28a09b6d5b8d None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:20.463509 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c83f4-0921-48cb-a617-cd793210bcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:20.465219 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c83f4-0921-48cb-a617-cd793210bcf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:20.465811 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c83f4-0921-48cb-a617-cd793210bcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:20.466393 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c83f4-0921-48cb-a617-cd793210bcf1 admin admin] PATH_INFO: `/v3/users/107236d57a1e46738e4b08da66be3a30` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:20.468802 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c83f4-0921-48cb-a617-cd793210bcf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=107236d57a1e46738e4b08da66be3a30)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:20.473010 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c83f4-0921-48cb-a617-cd793210bcf1 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:20.578308 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-bb7c83f4-0921-48cb-a617-cd793210bcf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '107236d57a1e46738e4b08da66be3a30'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:20.597849 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-bb7c83f4-0921-48cb-a617-cd793210bcf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '107236d57a1e46738e4b08da66be3a30'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:20.615182 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-bb7c83f4-0921-48cb-a617-cd793210bcf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '107236d57a1e46738e4b08da66be3a30'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:20.618454 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-bb7c83f4-0921-48cb-a617-cd793210bcf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '107236d57a1e46738e4b08da66be3a30'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:20.650791 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-bb7c83f4-0921-48cb-a617-cd793210bcf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '107236d57a1e46738e4b08da66be3a30'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:20.663048 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 976/1943] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:54:20 2022] DELETE /identity/v3/users/107236d57a1e46738e4b08da66be3a30 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:54:20.671149 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4381913-0e35-4b37-8007-64453e8847d1 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:20.672453 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4381913-0e35-4b37-8007-64453e8847d1 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:20.673220 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4381913-0e35-4b37-8007-64453e8847d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:20.714111 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-c4381913-0e35-4b37-8007-64453e8847d1 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:54:20.716022 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-c4381913-0e35-4b37-8007-64453e8847d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:20.725665 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c83f4-0921-48cb-a617-cd793210bcf1 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:20.728368 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-bb7c83f4-0921-48cb-a617-cd793210bcf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:20.827362 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 968/1944] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:54:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:54:20.875730 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4381913-0e35-4b37-8007-64453e8847d1 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:20.878124 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-c4381913-0e35-4b37-8007-64453e8847d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:20.906199 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c83f4-0921-48cb-a617-cd793210bcf1 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:20.918829 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2dd926-87b9-4969-b96e-26c66e1a87ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:20.921358 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2dd926-87b9-4969-b96e-26c66e1a87ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:20.921589 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2dd926-87b9-4969-b96e-26c66e1a87ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:20.922046 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2dd926-87b9-4969-b96e-26c66e1a87ab admin admin] PATH_INFO: `/v3/users/3cee0aebbb43415c96e4dca0392f9d2e` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:20.925136 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2dd926-87b9-4969-b96e-26c66e1a87ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cee0aebbb43415c96e4dca0392f9d2e)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:20.929185 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2dd926-87b9-4969-b96e-26c66e1a87ab admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:21.042074 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4381913-0e35-4b37-8007-64453e8847d1 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:21.049268 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ddcbb5-94e5-4cf7-9f9b-bfbc1d3a0266 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:21.050078 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddcbb5-94e5-4cf7-9f9b-bfbc1d3a0266 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:21.051239 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddcbb5-94e5-4cf7-9f9b-bfbc1d3a0266 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:21.052504 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddcbb5-94e5-4cf7-9f9b-bfbc1d3a0266 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:21.074558 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ddcbb5-94e5-4cf7-9f9b-bfbc1d3a0266 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:21.075874 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-3f2dd926-87b9-4969-b96e-26c66e1a87ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cee0aebbb43415c96e4dca0392f9d2e'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:21.082373 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ddcbb5-94e5-4cf7-9f9b-bfbc1d3a0266 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:21.096928 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-3f2dd926-87b9-4969-b96e-26c66e1a87ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cee0aebbb43415c96e4dca0392f9d2e'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:21.103911 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 969/1945] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:54:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:54:21.120322 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-3f2dd926-87b9-4969-b96e-26c66e1a87ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cee0aebbb43415c96e4dca0392f9d2e'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:21.122306 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-3f2dd926-87b9-4969-b96e-26c66e1a87ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cee0aebbb43415c96e4dca0392f9d2e'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:21.155793 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-3f2dd926-87b9-4969-b96e-26c66e1a87ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cee0aebbb43415c96e4dca0392f9d2e'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:21.176692 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 977/1946] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:54:20 2022] DELETE /identity/v3/users/3cee0aebbb43415c96e4dca0392f9d2e => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:54:21.177776 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ad702-bd97-4804-8686-ff2053a6ae7b None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:21.178137 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ad702-bd97-4804-8686-ff2053a6ae7b None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:21.178489 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ad702-bd97-4804-8686-ff2053a6ae7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:21.223176 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-6f0ad702-bd97-4804-8686-ff2053a6ae7b None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:54:21.225757 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-6f0ad702-bd97-4804-8686-ff2053a6ae7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:21.357223 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 970/1947] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:54:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:54:21.377819 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2dd926-87b9-4969-b96e-26c66e1a87ab admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:21.380167 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-3f2dd926-87b9-4969-b96e-26c66e1a87ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:21.504207 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2dd926-87b9-4969-b96e-26c66e1a87ab admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:21.511170 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93eaef-d36d-47d3-8987-6b7fd6d37019 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:21.512684 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93eaef-d36d-47d3-8987-6b7fd6d37019 service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:21.513265 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93eaef-d36d-47d3-8987-6b7fd6d37019 service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:21.515305 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93eaef-d36d-47d3-8987-6b7fd6d37019 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:21.537237 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93eaef-d36d-47d3-8987-6b7fd6d37019 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:21.543714 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93eaef-d36d-47d3-8987-6b7fd6d37019 service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:21.570349 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 978/1948] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:54:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:54:22.284911 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409caac-7964-4a06-91a3-3bd0bb1a18d9 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:22.285491 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409caac-7964-4a06-91a3-3bd0bb1a18d9 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:22.286255 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409caac-7964-4a06-91a3-3bd0bb1a18d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:22.322419 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-a409caac-7964-4a06-91a3-3bd0bb1a18d9 None None] MFA Rules not processed for user `40ba15ac1e1a4e699d83c5f4d9bec9f4`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:54:22.325517 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-a409caac-7964-4a06-91a3-3bd0bb1a18d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:22.464919 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 971/1949] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:54:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:54:22.632972 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93eaef-d36d-47d3-8987-6b7fd6d37019 service neutron] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:22.645147 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-7b93eaef-d36d-47d3-8987-6b7fd6d37019 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:22.678969 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93eaef-d36d-47d3-8987-6b7fd6d37019 service neutron] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:22.684892 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53222140-2463-4359-a366-43da33115324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:22.685770 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53222140-2463-4359-a366-43da33115324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:22.686054 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53222140-2463-4359-a366-43da33115324 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:22.686328 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53222140-2463-4359-a366-43da33115324 admin admin] PATH_INFO: `/v3/projects/a22a730947cd4fd1b494ddf4794d5370` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:22.689229 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53222140-2463-4359-a366-43da33115324 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a22a730947cd4fd1b494ddf4794d5370)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:22.691478 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53222140-2463-4359-a366-43da33115324 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:22.820612 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-53222140-2463-4359-a366-43da33115324 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a22a730947cd4fd1b494ddf4794d5370', 'request_id': 'req-53222140-2463-4359-a366-43da33115324'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:22.834772 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-53222140-2463-4359-a366-43da33115324 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a22a730947cd4fd1b494ddf4794d5370', 'request_id': 'req-53222140-2463-4359-a366-43da33115324'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:22.855347 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-53222140-2463-4359-a366-43da33115324 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a22a730947cd4fd1b494ddf4794d5370', 'request_id': 'req-53222140-2463-4359-a366-43da33115324'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:22.879195 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-53222140-2463-4359-a366-43da33115324 admin admin] The token cache is being invalidate because project a22a730947cd4fd1b494ddf4794d5370 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:54:22.879483 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-53222140-2463-4359-a366-43da33115324 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:22.880388 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-53222140-2463-4359-a366-43da33115324 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:22.882508 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 979/1950] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:54:22 2022] DELETE /identity/v3/projects/a22a730947cd4fd1b494ddf4794d5370 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:54:22.887450 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409caac-7964-4a06-91a3-3bd0bb1a18d9 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:22.916068 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409caac-7964-4a06-91a3-3bd0bb1a18d9 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:23.080406 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e653b0f-2c7d-4faf-bcdc-6ca3a83414dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:23.082013 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e653b0f-2c7d-4faf-bcdc-6ca3a83414dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:23.082498 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e653b0f-2c7d-4faf-bcdc-6ca3a83414dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:23.082991 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e653b0f-2c7d-4faf-bcdc-6ca3a83414dd admin admin] PATH_INFO: `/v3/users/c9c3ddf662734243bcf37476e3c805cf` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:23.085514 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e653b0f-2c7d-4faf-bcdc-6ca3a83414dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9c3ddf662734243bcf37476e3c805cf)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:23.089860 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e653b0f-2c7d-4faf-bcdc-6ca3a83414dd admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:23.268993 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-7e653b0f-2c7d-4faf-bcdc-6ca3a83414dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9c3ddf662734243bcf37476e3c805cf'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:23.300692 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53222140-2463-4359-a366-43da33115324 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:23.302202 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-53222140-2463-4359-a366-43da33115324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:23.312540 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-7e653b0f-2c7d-4faf-bcdc-6ca3a83414dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9c3ddf662734243bcf37476e3c805cf'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:23.320652 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-7e653b0f-2c7d-4faf-bcdc-6ca3a83414dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9c3ddf662734243bcf37476e3c805cf'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:23.350752 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53222140-2463-4359-a366-43da33115324 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:23.371844 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-7e653b0f-2c7d-4faf-bcdc-6ca3a83414dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9c3ddf662734243bcf37476e3c805cf'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:23.373502 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-7e653b0f-2c7d-4faf-bcdc-6ca3a83414dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9c3ddf662734243bcf37476e3c805cf'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:23.380948 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffad6fc-715a-4510-a170-25ad335a63ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:23.386702 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffad6fc-715a-4510-a170-25ad335a63ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:23.386905 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffad6fc-715a-4510-a170-25ad335a63ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:23.389421 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffad6fc-715a-4510-a170-25ad335a63ea admin admin] PATH_INFO: `/v3/projects/1e9ccf17b7e64b9ead1431d098c44b25` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:23.394923 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffad6fc-715a-4510-a170-25ad335a63ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e9ccf17b7e64b9ead1431d098c44b25)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:23.411100 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 972/1951] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:54:22 2022] DELETE /identity/v3/users/c9c3ddf662734243bcf37476e3c805cf => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:54:23.411829 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffad6fc-715a-4510-a170-25ad335a63ea admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:23.615509 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-bffad6fc-715a-4510-a170-25ad335a63ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e9ccf17b7e64b9ead1431d098c44b25', 'request_id': 'req-bffad6fc-715a-4510-a170-25ad335a63ea'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:23.636564 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-bffad6fc-715a-4510-a170-25ad335a63ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e9ccf17b7e64b9ead1431d098c44b25', 'request_id': 'req-bffad6fc-715a-4510-a170-25ad335a63ea'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:23.653808 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-bffad6fc-715a-4510-a170-25ad335a63ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e9ccf17b7e64b9ead1431d098c44b25', 'request_id': 'req-bffad6fc-715a-4510-a170-25ad335a63ea'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:23.705459 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-bffad6fc-715a-4510-a170-25ad335a63ea admin admin] The token cache is being invalidate because project 1e9ccf17b7e64b9ead1431d098c44b25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:54:23.706374 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-bffad6fc-715a-4510-a170-25ad335a63ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:23.709828 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-bffad6fc-715a-4510-a170-25ad335a63ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:23.723593 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 980/1952] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:54:23 2022] DELETE /identity/v3/projects/1e9ccf17b7e64b9ead1431d098c44b25 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:54:23.723887 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ed98d-a81b-45d6-882e-2f230cb891ec None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:23.724357 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ed98d-a81b-45d6-882e-2f230cb891ec None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:23.724690 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ed98d-a81b-45d6-882e-2f230cb891ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:23.809404 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-c41ed98d-a81b-45d6-882e-2f230cb891ec None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:54:23.818539 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-c41ed98d-a81b-45d6-882e-2f230cb891ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:24.015656 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 973/1953] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:54:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:54:24.023559 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e8018-c7d1-4f30-8951-76d1aeadb23a None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:24.023941 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e8018-c7d1-4f30-8951-76d1aeadb23a None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:24.024436 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e8018-c7d1-4f30-8951-76d1aeadb23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:24.048350 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-752e8018-c7d1-4f30-8951-76d1aeadb23a None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:54:24.049959 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-752e8018-c7d1-4f30-8951-76d1aeadb23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:24.068787 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 981/1954] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:54:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:54:24.069612 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ed98d-a81b-45d6-882e-2f230cb891ec None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:24.080875 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ed98d-a81b-45d6-882e-2f230cb891ec None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:24.098060 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2ec86-c60a-4de7-81bd-58aa65911193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:24.098769 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2ec86-c60a-4de7-81bd-58aa65911193 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:24.099053 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2ec86-c60a-4de7-81bd-58aa65911193 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:24.099330 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2ec86-c60a-4de7-81bd-58aa65911193 admin admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:24.100153 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2ec86-c60a-4de7-81bd-58aa65911193 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:54:24.100466 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2ec86-c60a-4de7-81bd-58aa65911193 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:24.102229 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2ec86-c60a-4de7-81bd-58aa65911193 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:24.134160 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 974/1955] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:54:24.137154 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e8018-c7d1-4f30-8951-76d1aeadb23a None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:24.149406 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e8018-c7d1-4f30-8951-76d1aeadb23a None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:24.163914 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79f9d5-d8f7-4b9a-8402-820fd9340668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:24.164617 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79f9d5-d8f7-4b9a-8402-820fd9340668 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:24.164951 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79f9d5-d8f7-4b9a-8402-820fd9340668 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:24.165221 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79f9d5-d8f7-4b9a-8402-820fd9340668 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:24.169255 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d79f9d5-d8f7-4b9a-8402-820fd9340668 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:24.187432 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d79f9d5-d8f7-4b9a-8402-820fd9340668 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:24.254425 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 982/1956] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:54:24 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:54:24.254642 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2ec86-c60a-4de7-81bd-58aa65911193 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:24.273115 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2ec86-c60a-4de7-81bd-58aa65911193 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:24.325851 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79f9d5-d8f7-4b9a-8402-820fd9340668 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:24.327691 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-0d79f9d5-d8f7-4b9a-8402-820fd9340668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:24.417369 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c72dc6-d5c4-4c4d-a792-df3ec47f7ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:24.419715 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c72dc6-d5c4-4c4d-a792-df3ec47f7ccc admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:24.419715 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c72dc6-d5c4-4c4d-a792-df3ec47f7ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:24.419715 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c72dc6-d5c4-4c4d-a792-df3ec47f7ccc admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:24.420707 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c72dc6-d5c4-4c4d-a792-df3ec47f7ccc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:24.425112 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c72dc6-d5c4-4c4d-a792-df3ec47f7ccc admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:24.473438 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79f9d5-d8f7-4b9a-8402-820fd9340668 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:24.479439 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1c93a-43bc-42c8-b3a3-e02a4d81ac07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:24.480505 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1c93a-43bc-42c8-b3a3-e02a4d81ac07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:24.480842 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1c93a-43bc-42c8-b3a3-e02a4d81ac07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:24.481155 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1c93a-43bc-42c8-b3a3-e02a4d81ac07 admin admin] PATH_INFO: `/v3/projects/1e65f3113912437ea549af27c6b4a63b` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:24.481359 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 975/1957] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:54:24 2022] POST /identity/v3/users => generated 288 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:54:24.486373 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c72dc6-d5c4-4c4d-a792-df3ec47f7ccc admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:24.487669 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1c93a-43bc-42c8-b3a3-e02a4d81ac07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e65f3113912437ea549af27c6b4a63b)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:24.489808 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1c93a-43bc-42c8-b3a3-e02a4d81ac07 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:24.515499 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c72dc6-d5c4-4c4d-a792-df3ec47f7ccc admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:24.543975 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f374a-ac34-41ea-8dc2-b9d7a5fb55df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:24.544676 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f374a-ac34-41ea-8dc2-b9d7a5fb55df admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:24.544953 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f374a-ac34-41ea-8dc2-b9d7a5fb55df admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:24.545221 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f374a-ac34-41ea-8dc2-b9d7a5fb55df admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:24.548275 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f374a-ac34-41ea-8dc2-b9d7a5fb55df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:24.550277 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f374a-ac34-41ea-8dc2-b9d7a5fb55df admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:24.557572 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-87e1c93a-43bc-42c8-b3a3-e02a4d81ac07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e65f3113912437ea549af27c6b4a63b', 'request_id': 'req-87e1c93a-43bc-42c8-b3a3-e02a4d81ac07'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:24.565663 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-87e1c93a-43bc-42c8-b3a3-e02a4d81ac07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e65f3113912437ea549af27c6b4a63b', 'request_id': 'req-87e1c93a-43bc-42c8-b3a3-e02a4d81ac07'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:24.582693 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-87e1c93a-43bc-42c8-b3a3-e02a4d81ac07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e65f3113912437ea549af27c6b4a63b', 'request_id': 'req-87e1c93a-43bc-42c8-b3a3-e02a4d81ac07'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:24.590453 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 976/1958] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:54:24.597657 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f374a-ac34-41ea-8dc2-b9d7a5fb55df admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:24.618269 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-87e1c93a-43bc-42c8-b3a3-e02a4d81ac07 admin admin] The token cache is being invalidate because project 1e65f3113912437ea549af27c6b4a63b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:54:24.618520 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-87e1c93a-43bc-42c8-b3a3-e02a4d81ac07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:24.622106 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-87e1c93a-43bc-42c8-b3a3-e02a4d81ac07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:24.635863 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 983/1959] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:54:24 2022] DELETE /identity/v3/projects/1e65f3113912437ea549af27c6b4a63b => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:54:24.639915 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f374a-ac34-41ea-8dc2-b9d7a5fb55df admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:24.640492 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37233eca-d8e0-4ae2-890a-8cb177bc16f7 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:24.642771 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37233eca-d8e0-4ae2-890a-8cb177bc16f7 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:24.643670 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37233eca-d8e0-4ae2-890a-8cb177bc16f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:24.691079 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-37233eca-d8e0-4ae2-890a-8cb177bc16f7 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:54:24.697875 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-37233eca-d8e0-4ae2-890a-8cb177bc16f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:24.717717 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c9106-4ea5-419c-998b-e60216fd47f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:24.718742 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c9106-4ea5-419c-998b-e60216fd47f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:24.719347 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c9106-4ea5-419c-998b-e60216fd47f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:24.720445 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c9106-4ea5-419c-998b-e60216fd47f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:24.721389 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c9106-4ea5-419c-998b-e60216fd47f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:24.723477 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c9106-4ea5-419c-998b-e60216fd47f4 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:24.772278 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 977/1960] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:54:24.773548 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c9106-4ea5-419c-998b-e60216fd47f4 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:24.776245 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-ea3c9106-4ea5-419c-998b-e60216fd47f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:24.804811 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c9106-4ea5-419c-998b-e60216fd47f4 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:24.818289 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bb7dc-1374-465d-81ee-2ad3a241e02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:24.819853 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bb7dc-1374-465d-81ee-2ad3a241e02f admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:24.820679 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bb7dc-1374-465d-81ee-2ad3a241e02f admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:24.821122 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bb7dc-1374-465d-81ee-2ad3a241e02f admin admin] PATH_INFO: `/v3/projects/0520536308fd4d46a03fee927289e1c8/users/05723f88446942628869ca3d1540c620/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:24.840740 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 984/1961] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:54:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:54:24.854419 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a259546-26ee-40b0-87cc-c37911642cf2 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:24.854916 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a259546-26ee-40b0-87cc-c37911642cf2 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:24.855524 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a259546-26ee-40b0-87cc-c37911642cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:24.864939 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8bb7dc-1374-465d-81ee-2ad3a241e02f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0520536308fd4d46a03fee927289e1c8, user_id=05723f88446942628869ca3d1540c620, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:24.869717 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8bb7dc-1374-465d-81ee-2ad3a241e02f admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:24.894837 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 978/1962] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:54:24 2022] PUT /identity/v3/projects/0520536308fd4d46a03fee927289e1c8/users/05723f88446942628869ca3d1540c620/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:54:24.908293 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-6a259546-26ee-40b0-87cc-c37911642cf2 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:54:24.909581 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a53b6-7251-4a9c-b514-8354f1590a9f None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:24.909978 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a53b6-7251-4a9c-b514-8354f1590a9f None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:24.910170 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-6a259546-26ee-40b0-87cc-c37911642cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:24.910441 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a53b6-7251-4a9c-b514-8354f1590a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:24.972998 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-486a53b6-7251-4a9c-b514-8354f1590a9f None None] MFA Rules not processed for user `05723f88446942628869ca3d1540c620`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:54:24.989786 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-486a53b6-7251-4a9c-b514-8354f1590a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:25.038963 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 985/1963] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:54:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:54:25.045203 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a259546-26ee-40b0-87cc-c37911642cf2 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:25.074420 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a259546-26ee-40b0-87cc-c37911642cf2 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:25.101920 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2444a-4f73-4194-bb8a-96db2de79c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:25.103107 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2444a-4f73-4194-bb8a-96db2de79c34 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:25.103552 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2444a-4f73-4194-bb8a-96db2de79c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:25.104038 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2444a-4f73-4194-bb8a-96db2de79c34 admin admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:25.105370 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2444a-4f73-4194-bb8a-96db2de79c34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:54:25.105943 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2444a-4f73-4194-bb8a-96db2de79c34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:25.109312 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2444a-4f73-4194-bb8a-96db2de79c34 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:25.145666 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 986/1964] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:54:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:54:25.147630 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2444a-4f73-4194-bb8a-96db2de79c34 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:25.167145 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2444a-4f73-4194-bb8a-96db2de79c34 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:25.177804 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399562cf-1846-4ba7-ae84-75d9dd216b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:25.178938 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399562cf-1846-4ba7-ae84-75d9dd216b3f admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:25.179444 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399562cf-1846-4ba7-ae84-75d9dd216b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:25.179987 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399562cf-1846-4ba7-ae84-75d9dd216b3f admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:25.181388 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399562cf-1846-4ba7-ae84-75d9dd216b3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:25.185793 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399562cf-1846-4ba7-ae84-75d9dd216b3f admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:25.261490 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 987/1965] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:54:25 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:54:25.263302 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399562cf-1846-4ba7-ae84-75d9dd216b3f admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:25.363692 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 979/1966] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:54:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:54:25.384237 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a53b6-7251-4a9c-b514-8354f1590a9f None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:25.392610 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-486a53b6-7251-4a9c-b514-8354f1590a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:25.470904 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a53b6-7251-4a9c-b514-8354f1590a9f None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:25.535536 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399562cf-1846-4ba7-ae84-75d9dd216b3f admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:25.549585 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6490b29-d309-40a3-b40e-95a3564d6cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:25.552083 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6490b29-d309-40a3-b40e-95a3564d6cfb admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:25.552299 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6490b29-d309-40a3-b40e-95a3564d6cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:25.552480 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6490b29-d309-40a3-b40e-95a3564d6cfb admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:25.554909 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6490b29-d309-40a3-b40e-95a3564d6cfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:25.556508 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6490b29-d309-40a3-b40e-95a3564d6cfb admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:25.591032 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d8162-aa06-4913-9e6f-e4dc38584170 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:25.593396 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d8162-aa06-4913-9e6f-e4dc38584170 service cinder] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:25.595444 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d8162-aa06-4913-9e6f-e4dc38584170 service cinder] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:25.598100 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d8162-aa06-4913-9e6f-e4dc38584170 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:25.605226 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 988/1967] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:54:25 2022] POST /identity/v3/users => generated 289 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:54:25.610803 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6490b29-d309-40a3-b40e-95a3564d6cfb admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:25.629252 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6490b29-d309-40a3-b40e-95a3564d6cfb admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:25.643838 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec938461-1973-4cf5-9bc8-4cfc39df0f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:25.644656 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec938461-1973-4cf5-9bc8-4cfc39df0f2b admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:25.647028 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec938461-1973-4cf5-9bc8-4cfc39df0f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:25.649707 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec938461-1973-4cf5-9bc8-4cfc39df0f2b admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:25.650814 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec938461-1973-4cf5-9bc8-4cfc39df0f2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:25.656175 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec938461-1973-4cf5-9bc8-4cfc39df0f2b admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:25.678825 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 989/1968] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:54:25.680787 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec938461-1973-4cf5-9bc8-4cfc39df0f2b admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:25.699157 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec938461-1973-4cf5-9bc8-4cfc39df0f2b admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:25.707535 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e8e6b-2be0-4ff4-adba-9e2883840f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:25.709345 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e8e6b-2be0-4ff4-adba-9e2883840f0b admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:25.714004 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d8162-aa06-4913-9e6f-e4dc38584170 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:25.716022 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d8162-aa06-4913-9e6f-e4dc38584170 service cinder] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:25.725834 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e8e6b-2be0-4ff4-adba-9e2883840f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:25.729228 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e8e6b-2be0-4ff4-adba-9e2883840f0b admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:25.731732 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6e8e6b-2be0-4ff4-adba-9e2883840f0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:25.735820 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6e8e6b-2be0-4ff4-adba-9e2883840f0b admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:25.751805 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 990/1969] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:54:25.756219 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e8e6b-2be0-4ff4-adba-9e2883840f0b admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:25.764637 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 980/1970] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:54:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:54:25.784198 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e8e6b-2be0-4ff4-adba-9e2883840f0b admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:25.790485 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc2e31-34ad-4fe7-b30d-4b803073fda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:25.791859 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc2e31-34ad-4fe7-b30d-4b803073fda3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:25.792343 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc2e31-34ad-4fe7-b30d-4b803073fda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:25.792796 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc2e31-34ad-4fe7-b30d-4b803073fda3 admin admin] PATH_INFO: `/v3/projects/ab284a174c674de5a97e024079c0b646/users/21ddc19fa0744b07a260fb17ea038d5b/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:25.818293 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc2e31-34ad-4fe7-b30d-4b803073fda3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab284a174c674de5a97e024079c0b646, user_id=21ddc19fa0744b07a260fb17ea038d5b, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:25.822101 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc2e31-34ad-4fe7-b30d-4b803073fda3 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:25.849278 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 991/1971] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:54:25 2022] PUT /identity/v3/projects/ab284a174c674de5a97e024079c0b646/users/21ddc19fa0744b07a260fb17ea038d5b/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:54:25.861771 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e970a-d7bd-4c9c-9d30-0767fd98945e None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:25.862177 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e970a-d7bd-4c9c-9d30-0767fd98945e None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:25.862546 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e970a-d7bd-4c9c-9d30-0767fd98945e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:25.899190 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-910e970a-d7bd-4c9c-9d30-0767fd98945e None None] MFA Rules not processed for user `21ddc19fa0744b07a260fb17ea038d5b`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:54:25.900634 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-910e970a-d7bd-4c9c-9d30-0767fd98945e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:26.036686 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 981/1972] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:54:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:54:26.043223 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc2e31-34ad-4fe7-b30d-4b803073fda3 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:26.185172 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc2e31-34ad-4fe7-b30d-4b803073fda3 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:26.185172 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822774d8-7c5d-4d10-84f6-a53804f52287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:26.185985 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822774d8-7c5d-4d10-84f6-a53804f52287 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:26.186719 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822774d8-7c5d-4d10-84f6-a53804f52287 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:26.187420 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822774d8-7c5d-4d10-84f6-a53804f52287 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:26.190762 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822774d8-7c5d-4d10-84f6-a53804f52287 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:26.194641 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822774d8-7c5d-4d10-84f6-a53804f52287 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:26.325157 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 992/1973] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:54:26 2022] POST /identity/v3/projects => generated 377 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:54:26.326079 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e970a-d7bd-4c9c-9d30-0767fd98945e None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:26.352839 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e970a-d7bd-4c9c-9d30-0767fd98945e None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:26.436299 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11adb28-0bdf-4342-a755-94f5c39cf477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:26.436998 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11adb28-0bdf-4342-a755-94f5c39cf477 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:26.437278 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11adb28-0bdf-4342-a755-94f5c39cf477 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:26.437546 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11adb28-0bdf-4342-a755-94f5c39cf477 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:26.439428 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11adb28-0bdf-4342-a755-94f5c39cf477 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:26.441508 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11adb28-0bdf-4342-a755-94f5c39cf477 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:26.477603 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 982/1974] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:54:26 2022] POST /identity/v3/users => generated 295 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:54:26.480585 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822774d8-7c5d-4d10-84f6-a53804f52287 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:26.502572 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822774d8-7c5d-4d10-84f6-a53804f52287 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:26.522388 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743e3f1-3d98-4736-8275-1b62ee2f8faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:26.523227 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743e3f1-3d98-4736-8275-1b62ee2f8faa admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:26.523427 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743e3f1-3d98-4736-8275-1b62ee2f8faa admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:26.523696 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743e3f1-3d98-4736-8275-1b62ee2f8faa admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:26.524732 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743e3f1-3d98-4736-8275-1b62ee2f8faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:26.530049 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743e3f1-3d98-4736-8275-1b62ee2f8faa admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:26.555243 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 993/1975] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:54:26.561091 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11adb28-0bdf-4342-a755-94f5c39cf477 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:26.587513 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11adb28-0bdf-4342-a755-94f5c39cf477 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:26.605620 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59bbff-dd35-4ab3-8681-1937cd9e6eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:26.607058 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59bbff-dd35-4ab3-8681-1937cd9e6eca admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:26.607500 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59bbff-dd35-4ab3-8681-1937cd9e6eca admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:26.608450 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59bbff-dd35-4ab3-8681-1937cd9e6eca admin admin] PATH_INFO: `/v3/projects/5a74645ff5474bf1b6caceab324b9384/users/1d776c4c224e4cd4bdc6f844aa6835d7/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:26.651490 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59bbff-dd35-4ab3-8681-1937cd9e6eca admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a74645ff5474bf1b6caceab324b9384, user_id=1d776c4c224e4cd4bdc6f844aa6835d7, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:26.658310 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59bbff-dd35-4ab3-8681-1937cd9e6eca admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:26.687818 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 983/1976] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:54:26 2022] PUT /identity/v3/projects/5a74645ff5474bf1b6caceab324b9384/users/1d776c4c224e4cd4bdc6f844aa6835d7/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:54:26.690245 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743e3f1-3d98-4736-8275-1b62ee2f8faa admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:26.713190 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743e3f1-3d98-4736-8275-1b62ee2f8faa admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:26.858351 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21380c7c-a8f5-4384-be5d-c32763d7ba33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:26.859156 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21380c7c-a8f5-4384-be5d-c32763d7ba33 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:26.859436 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21380c7c-a8f5-4384-be5d-c32763d7ba33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:26.859721 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21380c7c-a8f5-4384-be5d-c32763d7ba33 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:26.861506 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21380c7c-a8f5-4384-be5d-c32763d7ba33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:26.863244 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21380c7c-a8f5-4384-be5d-c32763d7ba33 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:26.879110 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 994/1977] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:54:26.881029 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59bbff-dd35-4ab3-8681-1937cd9e6eca admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:26.897023 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59bbff-dd35-4ab3-8681-1937cd9e6eca admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:26.907594 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db73eb-b079-4ff5-acb0-8b1be786724b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:26.909653 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db73eb-b079-4ff5-acb0-8b1be786724b admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:26.910487 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db73eb-b079-4ff5-acb0-8b1be786724b admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:26.911387 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db73eb-b079-4ff5-acb0-8b1be786724b admin admin] PATH_INFO: `/v3/projects/5a74645ff5474bf1b6caceab324b9384/users/1d776c4c224e4cd4bdc6f844aa6835d7/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:26.915966 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87db73eb-b079-4ff5-acb0-8b1be786724b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a74645ff5474bf1b6caceab324b9384, user_id=1d776c4c224e4cd4bdc6f844aa6835d7, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:26.923483 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87db73eb-b079-4ff5-acb0-8b1be786724b admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:26.945853 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 984/1978] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:54:26 2022] PUT /identity/v3/projects/5a74645ff5474bf1b6caceab324b9384/users/1d776c4c224e4cd4bdc6f844aa6835d7/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:54:26.971064 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a99715-004e-4c9f-a99d-de6aa2a977d1 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:26.971439 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a99715-004e-4c9f-a99d-de6aa2a977d1 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:26.974461 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a99715-004e-4c9f-a99d-de6aa2a977d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:27.057380 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-00a99715-004e-4c9f-a99d-de6aa2a977d1 None None] MFA Rules not processed for user `1d776c4c224e4cd4bdc6f844aa6835d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:54:27.059900 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-00a99715-004e-4c9f-a99d-de6aa2a977d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:27.240506 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 995/1979] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:54:26 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:54:27.248368 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db73eb-b079-4ff5-acb0-8b1be786724b admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:27.251450 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-87db73eb-b079-4ff5-acb0-8b1be786724b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:27.377684 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db73eb-b079-4ff5-acb0-8b1be786724b admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:27.383428 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f269c43-1326-40f9-b9a4-68f1b547feee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:27.384591 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f269c43-1326-40f9-b9a4-68f1b547feee service cinder] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:27.385110 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f269c43-1326-40f9-b9a4-68f1b547feee service cinder] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:27.385617 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f269c43-1326-40f9-b9a4-68f1b547feee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:27.480237 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f269c43-1326-40f9-b9a4-68f1b547feee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:27.481845 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f269c43-1326-40f9-b9a4-68f1b547feee service cinder] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:27.505954 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 985/1980] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:54:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:54:39.821150 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a99715-004e-4c9f-a99d-de6aa2a977d1 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:39.831722 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a99715-004e-4c9f-a99d-de6aa2a977d1 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:39.835766 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e938577-32ae-47a2-811a-d3a6f70478f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:39.836436 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e938577-32ae-47a2-811a-d3a6f70478f6 service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:39.836719 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e938577-32ae-47a2-811a-d3a6f70478f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:39.836995 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e938577-32ae-47a2-811a-d3a6f70478f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:39.848869 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e938577-32ae-47a2-811a-d3a6f70478f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:39.850339 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e938577-32ae-47a2-811a-d3a6f70478f6 service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:39.863851 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 996/1981] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:54:39 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:54:49.448722 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f269c43-1326-40f9-b9a4-68f1b547feee service cinder] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:49.450398 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-3f269c43-1326-40f9-b9a4-68f1b547feee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:49.682256 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f269c43-1326-40f9-b9a4-68f1b547feee service cinder] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:49.687365 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b137bff-9e2e-4017-9485-7b23b0e07e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:49.688493 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b137bff-9e2e-4017-9485-7b23b0e07e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:49.688779 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b137bff-9e2e-4017-9485-7b23b0e07e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:49.689037 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b137bff-9e2e-4017-9485-7b23b0e07e77 admin admin] PATH_INFO: `/v3/users/59e07e89a62b42a4974f3b226cc2b8a0` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:49.690437 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b137bff-9e2e-4017-9485-7b23b0e07e77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59e07e89a62b42a4974f3b226cc2b8a0)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:49.692499 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b137bff-9e2e-4017-9485-7b23b0e07e77 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:49.764107 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-2b137bff-9e2e-4017-9485-7b23b0e07e77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59e07e89a62b42a4974f3b226cc2b8a0'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:49.773266 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-2b137bff-9e2e-4017-9485-7b23b0e07e77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59e07e89a62b42a4974f3b226cc2b8a0'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:49.774265 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-2b137bff-9e2e-4017-9485-7b23b0e07e77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59e07e89a62b42a4974f3b226cc2b8a0'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:49.788318 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-2b137bff-9e2e-4017-9485-7b23b0e07e77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59e07e89a62b42a4974f3b226cc2b8a0'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:49.788605 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-2b137bff-9e2e-4017-9485-7b23b0e07e77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59e07e89a62b42a4974f3b226cc2b8a0'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:49.808004 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 986/1982] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:54:49 2022] DELETE /identity/v3/users/59e07e89a62b42a4974f3b226cc2b8a0 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:54:50.104121 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e938577-32ae-47a2-811a-d3a6f70478f6 service cinder] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:50.174708 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e938577-32ae-47a2-811a-d3a6f70478f6 service cinder] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:50.245489 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e114fef-11b4-456c-974b-1beec1f20240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:50.246841 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e114fef-11b4-456c-974b-1beec1f20240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:50.247259 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e114fef-11b4-456c-974b-1beec1f20240 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:50.247594 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e114fef-11b4-456c-974b-1beec1f20240 admin admin] PATH_INFO: `/v3/projects/dca1f27b8d344d09bd6637d783fa6361` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:50.249873 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e114fef-11b4-456c-974b-1beec1f20240 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dca1f27b8d344d09bd6637d783fa6361)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:50.255554 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e114fef-11b4-456c-974b-1beec1f20240 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:50.328100 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-9e114fef-11b4-456c-974b-1beec1f20240 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dca1f27b8d344d09bd6637d783fa6361', 'request_id': 'req-9e114fef-11b4-456c-974b-1beec1f20240'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:50.338132 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-9e114fef-11b4-456c-974b-1beec1f20240 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dca1f27b8d344d09bd6637d783fa6361', 'request_id': 'req-9e114fef-11b4-456c-974b-1beec1f20240'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:50.350401 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-9e114fef-11b4-456c-974b-1beec1f20240 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dca1f27b8d344d09bd6637d783fa6361', 'request_id': 'req-9e114fef-11b4-456c-974b-1beec1f20240'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:50.367381 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-9e114fef-11b4-456c-974b-1beec1f20240 admin admin] The token cache is being invalidate because project dca1f27b8d344d09bd6637d783fa6361 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:54:50.367930 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-9e114fef-11b4-456c-974b-1beec1f20240 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:50.369151 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-9e114fef-11b4-456c-974b-1beec1f20240 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:50.372022 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 997/1983] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:54:50 2022] DELETE /identity/v3/projects/dca1f27b8d344d09bd6637d783fa6361 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:54:50.389263 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f104e-91ee-45ce-924d-c0d9ddc666a9 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:50.389624 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f104e-91ee-45ce-924d-c0d9ddc666a9 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:50.389966 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f104e-91ee-45ce-924d-c0d9ddc666a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:50.412043 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-8e2f104e-91ee-45ce-924d-c0d9ddc666a9 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:54:50.413268 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-8e2f104e-91ee-45ce-924d-c0d9ddc666a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:50.503922 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 987/1984] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:54:50.515955 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73549729-a15b-49b9-a870-1b187cfa1b97 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:50.516614 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73549729-a15b-49b9-a870-1b187cfa1b97 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:50.517217 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73549729-a15b-49b9-a870-1b187cfa1b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:50.547627 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-73549729-a15b-49b9-a870-1b187cfa1b97 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:54:50.549322 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-73549729-a15b-49b9-a870-1b187cfa1b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:50.558231 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 998/1985] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:54:50.564373 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f104e-91ee-45ce-924d-c0d9ddc666a9 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:50.582748 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f104e-91ee-45ce-924d-c0d9ddc666a9 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:50.590619 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19377830-5f41-408d-82d2-cab98571e5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:50.591809 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19377830-5f41-408d-82d2-cab98571e5da admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:50.592338 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19377830-5f41-408d-82d2-cab98571e5da admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:50.592825 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19377830-5f41-408d-82d2-cab98571e5da admin admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:50.594826 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19377830-5f41-408d-82d2-cab98571e5da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:54:50.595352 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19377830-5f41-408d-82d2-cab98571e5da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:50.598609 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19377830-5f41-408d-82d2-cab98571e5da admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:50.618555 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 988/1986] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:54:50.624093 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73549729-a15b-49b9-a870-1b187cfa1b97 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:50.635576 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73549729-a15b-49b9-a870-1b187cfa1b97 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:50.642003 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d61cfb-ceb5-4108-b1a5-c49670b6c569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:50.642896 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d61cfb-ceb5-4108-b1a5-c49670b6c569 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:50.643285 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d61cfb-ceb5-4108-b1a5-c49670b6c569 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:50.643666 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d61cfb-ceb5-4108-b1a5-c49670b6c569 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:50.644528 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d61cfb-ceb5-4108-b1a5-c49670b6c569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:50.646587 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d61cfb-ceb5-4108-b1a5-c49670b6c569 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:50.677429 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 999/1987] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:54:50 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:54:50.682054 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19377830-5f41-408d-82d2-cab98571e5da admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:50.693672 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19377830-5f41-408d-82d2-cab98571e5da admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:50.784962 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab154380-b716-4d28-b728-b3ec923605a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:50.786118 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab154380-b716-4d28-b728-b3ec923605a9 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:50.786593 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab154380-b716-4d28-b728-b3ec923605a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:50.787090 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab154380-b716-4d28-b728-b3ec923605a9 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:50.788394 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab154380-b716-4d28-b728-b3ec923605a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:50.792144 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab154380-b716-4d28-b728-b3ec923605a9 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:50.818313 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 989/1988] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:54:50 2022] POST /identity/v3/users => generated 284 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:54:50.822899 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d61cfb-ceb5-4108-b1a5-c49670b6c569 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:50.834303 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d61cfb-ceb5-4108-b1a5-c49670b6c569 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:50.839122 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4260e-2cc8-4998-a898-18baade332f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:50.839835 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4260e-2cc8-4998-a898-18baade332f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:50.840114 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4260e-2cc8-4998-a898-18baade332f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:50.840386 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4260e-2cc8-4998-a898-18baade332f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:50.841127 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4260e-2cc8-4998-a898-18baade332f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:50.842781 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4260e-2cc8-4998-a898-18baade332f6 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:50.856430 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1000/1989] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:54:50.862511 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab154380-b716-4d28-b728-b3ec923605a9 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:50.872926 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab154380-b716-4d28-b728-b3ec923605a9 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:50.879708 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72cc83-86cc-42a3-9bd0-24fa2d3b4588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:50.880980 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72cc83-86cc-42a3-9bd0-24fa2d3b4588 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:50.881492 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72cc83-86cc-42a3-9bd0-24fa2d3b4588 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:50.881980 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72cc83-86cc-42a3-9bd0-24fa2d3b4588 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:50.883221 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72cc83-86cc-42a3-9bd0-24fa2d3b4588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:50.885904 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72cc83-86cc-42a3-9bd0-24fa2d3b4588 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:50.903224 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 990/1990] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:54:50.909961 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4260e-2cc8-4998-a898-18baade332f6 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:50.923018 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4260e-2cc8-4998-a898-18baade332f6 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:50.928747 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8473dd6-249c-46d0-b694-010a3e90b1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:50.929687 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8473dd6-249c-46d0-b694-010a3e90b1b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:50.930170 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8473dd6-249c-46d0-b694-010a3e90b1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:50.930583 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8473dd6-249c-46d0-b694-010a3e90b1b5 admin admin] PATH_INFO: `/v3/projects/bbec12007b3843f5b8fafc2e9a0ed8a9/users/7095a45d24ac49e2a78efb71bc740aac/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:50.948788 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8473dd6-249c-46d0-b694-010a3e90b1b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbec12007b3843f5b8fafc2e9a0ed8a9, user_id=7095a45d24ac49e2a78efb71bc740aac, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:50.951501 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8473dd6-249c-46d0-b694-010a3e90b1b5 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:50.967934 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1001/1991] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:54:50 2022] PUT /identity/v3/projects/bbec12007b3843f5b8fafc2e9a0ed8a9/users/7095a45d24ac49e2a78efb71bc740aac/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:54:50.979909 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d8acc-fa71-4e07-9315-8b4c1c523358 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:50.980241 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d8acc-fa71-4e07-9315-8b4c1c523358 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:50.980449 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d8acc-fa71-4e07-9315-8b4c1c523358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:51.011209 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-785d8acc-fa71-4e07-9315-8b4c1c523358 None None] MFA Rules not processed for user `7095a45d24ac49e2a78efb71bc740aac`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:54:51.012774 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-785d8acc-fa71-4e07-9315-8b4c1c523358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:51.102628 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 991/1992] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:54:50 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:54:51.107378 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8473dd6-249c-46d0-b694-010a3e90b1b5 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:51.181653 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8473dd6-249c-46d0-b694-010a3e90b1b5 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:51.187558 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c9fe6-e76a-403a-a1c7-4acdb2da511b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:51.188466 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c9fe6-e76a-403a-a1c7-4acdb2da511b admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:51.188936 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c9fe6-e76a-403a-a1c7-4acdb2da511b admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:51.189409 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c9fe6-e76a-403a-a1c7-4acdb2da511b admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:51.191035 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c9fe6-e76a-403a-a1c7-4acdb2da511b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:51.193386 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c9fe6-e76a-403a-a1c7-4acdb2da511b admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:51.230435 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1002/1993] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:54:51 2022] POST /identity/v3/projects => generated 369 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:54:51.236976 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d8acc-fa71-4e07-9315-8b4c1c523358 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:51.258582 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d8acc-fa71-4e07-9315-8b4c1c523358 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:51.366181 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093e33c-a3c7-414f-a831-9d3621607de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:51.367247 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093e33c-a3c7-414f-a831-9d3621607de7 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:51.367698 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093e33c-a3c7-414f-a831-9d3621607de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:51.368178 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093e33c-a3c7-414f-a831-9d3621607de7 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:51.369362 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093e33c-a3c7-414f-a831-9d3621607de7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:51.371963 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093e33c-a3c7-414f-a831-9d3621607de7 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:51.402804 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 992/1994] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:54:51 2022] POST /identity/v3/users => generated 291 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:54:51.407428 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c9fe6-e76a-403a-a1c7-4acdb2da511b admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:51.419805 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c9fe6-e76a-403a-a1c7-4acdb2da511b admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:51.425619 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f95d65-d56d-446a-b1fb-ce18078f921f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:51.426294 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f95d65-d56d-446a-b1fb-ce18078f921f admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:51.426575 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f95d65-d56d-446a-b1fb-ce18078f921f admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:51.426851 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f95d65-d56d-446a-b1fb-ce18078f921f admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:51.427586 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f95d65-d56d-446a-b1fb-ce18078f921f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:51.429294 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f95d65-d56d-446a-b1fb-ce18078f921f admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:51.443801 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1003/1995] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:54:51.450028 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093e33c-a3c7-414f-a831-9d3621607de7 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:51.473392 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093e33c-a3c7-414f-a831-9d3621607de7 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:51.482130 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf3c6f-7f34-49ee-8cbb-fd9d665ce6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:51.483671 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf3c6f-7f34-49ee-8cbb-fd9d665ce6d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:51.484227 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf3c6f-7f34-49ee-8cbb-fd9d665ce6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:51.485302 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf3c6f-7f34-49ee-8cbb-fd9d665ce6d3 admin admin] PATH_INFO: `/v3/projects/266694e87a02417f8c5931e2413db93d/users/d2131fb435fd49f8bbe726e275e5d5b5/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:51.511646 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf3c6f-7f34-49ee-8cbb-fd9d665ce6d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=266694e87a02417f8c5931e2413db93d, user_id=d2131fb435fd49f8bbe726e275e5d5b5, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:51.514385 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf3c6f-7f34-49ee-8cbb-fd9d665ce6d3 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:51.536295 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 993/1996] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:54:51 2022] PUT /identity/v3/projects/266694e87a02417f8c5931e2413db93d/users/d2131fb435fd49f8bbe726e275e5d5b5/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:54:51.542416 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f95d65-d56d-446a-b1fb-ce18078f921f admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:51.567087 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f95d65-d56d-446a-b1fb-ce18078f921f admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:51.682269 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6131bec-c7e7-4f14-ad75-66dc6a40ee21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:51.683145 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6131bec-c7e7-4f14-ad75-66dc6a40ee21 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:51.683634 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6131bec-c7e7-4f14-ad75-66dc6a40ee21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:51.684168 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6131bec-c7e7-4f14-ad75-66dc6a40ee21 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:51.685551 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6131bec-c7e7-4f14-ad75-66dc6a40ee21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:51.689033 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6131bec-c7e7-4f14-ad75-66dc6a40ee21 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:51.707580 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1004/1997] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:54:51.712798 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf3c6f-7f34-49ee-8cbb-fd9d665ce6d3 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:51.725295 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf3c6f-7f34-49ee-8cbb-fd9d665ce6d3 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:51.730039 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ed6d4-b613-46c7-a23c-0ff0997b4597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:51.730938 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ed6d4-b613-46c7-a23c-0ff0997b4597 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:51.731206 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ed6d4-b613-46c7-a23c-0ff0997b4597 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:51.731475 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ed6d4-b613-46c7-a23c-0ff0997b4597 admin admin] PATH_INFO: `/v3/projects/266694e87a02417f8c5931e2413db93d/users/d2131fb435fd49f8bbe726e275e5d5b5/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:51.733535 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715ed6d4-b613-46c7-a23c-0ff0997b4597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=266694e87a02417f8c5931e2413db93d, user_id=d2131fb435fd49f8bbe726e275e5d5b5, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:51.736831 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715ed6d4-b613-46c7-a23c-0ff0997b4597 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:51.748421 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 994/1998] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:54:51 2022] PUT /identity/v3/projects/266694e87a02417f8c5931e2413db93d/users/d2131fb435fd49f8bbe726e275e5d5b5/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:54:51.760947 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220a7c5-03c1-4f85-83d3-0de19cc6afa5 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:51.761359 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220a7c5-03c1-4f85-83d3-0de19cc6afa5 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:51.761732 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220a7c5-03c1-4f85-83d3-0de19cc6afa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:51.794162 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-5220a7c5-03c1-4f85-83d3-0de19cc6afa5 None None] MFA Rules not processed for user `d2131fb435fd49f8bbe726e275e5d5b5`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:54:51.795424 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-5220a7c5-03c1-4f85-83d3-0de19cc6afa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:51.882972 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1005/1999] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:54:51 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:54:51.896343 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ed6d4-b613-46c7-a23c-0ff0997b4597 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:51.898099 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-715ed6d4-b613-46c7-a23c-0ff0997b4597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:52.002316 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ed6d4-b613-46c7-a23c-0ff0997b4597 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:52.009018 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b9243-5ce3-4c37-b8b5-bf4046b02993 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:52.010125 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b9243-5ce3-4c37-b8b5-bf4046b02993 service cinder] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:52.010629 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b9243-5ce3-4c37-b8b5-bf4046b02993 service cinder] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:52.011128 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b9243-5ce3-4c37-b8b5-bf4046b02993 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:52.028741 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b9243-5ce3-4c37-b8b5-bf4046b02993 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:52.031612 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b9243-5ce3-4c37-b8b5-bf4046b02993 service cinder] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:52.050483 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 995/2000] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:54:51 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:54:54.049008 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220a7c5-03c1-4f85-83d3-0de19cc6afa5 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:54.161133 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220a7c5-03c1-4f85-83d3-0de19cc6afa5 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:54.169005 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f6c26-2867-444f-82a9-f1f98c19cfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:54.169939 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f6c26-2867-444f-82a9-f1f98c19cfba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:54.170221 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f6c26-2867-444f-82a9-f1f98c19cfba admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:54.170496 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f6c26-2867-444f-82a9-f1f98c19cfba admin admin] PATH_INFO: `/v3/users/7095a45d24ac49e2a78efb71bc740aac` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:54.172491 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f6c26-2867-444f-82a9-f1f98c19cfba admin admin] RBAC: Authorizing `identity:delete_user(user_id=7095a45d24ac49e2a78efb71bc740aac)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:54.174913 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f6c26-2867-444f-82a9-f1f98c19cfba admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:54.254561 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ca4f6c26-2867-444f-82a9-f1f98c19cfba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7095a45d24ac49e2a78efb71bc740aac'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:54.263625 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ca4f6c26-2867-444f-82a9-f1f98c19cfba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7095a45d24ac49e2a78efb71bc740aac'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:54.274678 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ca4f6c26-2867-444f-82a9-f1f98c19cfba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7095a45d24ac49e2a78efb71bc740aac'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:54.275468 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ca4f6c26-2867-444f-82a9-f1f98c19cfba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7095a45d24ac49e2a78efb71bc740aac'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:54.291532 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ca4f6c26-2867-444f-82a9-f1f98c19cfba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7095a45d24ac49e2a78efb71bc740aac'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:54.304272 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1006/2001] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:54:54 2022] DELETE /identity/v3/users/7095a45d24ac49e2a78efb71bc740aac => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:54:54.309480 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be59c19-822a-4e62-9bf1-53a158ae431b None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:54.310428 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be59c19-822a-4e62-9bf1-53a158ae431b None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:54.310428 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be59c19-822a-4e62-9bf1-53a158ae431b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:54.342969 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-0be59c19-822a-4e62-9bf1-53a158ae431b None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:54:54.344325 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-0be59c19-822a-4e62-9bf1-53a158ae431b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:54.452481 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 996/2002] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:54:54.467603 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f6c26-2867-444f-82a9-f1f98c19cfba admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:54.470317 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-ca4f6c26-2867-444f-82a9-f1f98c19cfba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:54.580068 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f6c26-2867-444f-82a9-f1f98c19cfba admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:54.585172 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e155d0e7-3801-4ab9-a2b7-f0232d270753 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:54.586096 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155d0e7-3801-4ab9-a2b7-f0232d270753 service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:54.586532 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155d0e7-3801-4ab9-a2b7-f0232d270753 service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:54.587024 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155d0e7-3801-4ab9-a2b7-f0232d270753 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:54.600111 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e155d0e7-3801-4ab9-a2b7-f0232d270753 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:54.602231 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e155d0e7-3801-4ab9-a2b7-f0232d270753 service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:54.615014 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1007/2003] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:54:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:54:54.966634 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be59c19-822a-4e62-9bf1-53a158ae431b None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:54.968583 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-0be59c19-822a-4e62-9bf1-53a158ae431b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:55.001697 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be59c19-822a-4e62-9bf1-53a158ae431b None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:55.011247 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a2bb6-3bd2-411e-b2a9-cd597843f6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:55.012995 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a2bb6-3bd2-411e-b2a9-cd597843f6d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:55.013516 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a2bb6-3bd2-411e-b2a9-cd597843f6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:55.015001 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a2bb6-3bd2-411e-b2a9-cd597843f6d3 admin admin] PATH_INFO: `/v3/projects/bbec12007b3843f5b8fafc2e9a0ed8a9` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:55.018061 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a2bb6-3bd2-411e-b2a9-cd597843f6d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbec12007b3843f5b8fafc2e9a0ed8a9)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:55.021994 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a2bb6-3bd2-411e-b2a9-cd597843f6d3 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:55.097316 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-407a2bb6-3bd2-411e-b2a9-cd597843f6d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbec12007b3843f5b8fafc2e9a0ed8a9', 'request_id': 'req-407a2bb6-3bd2-411e-b2a9-cd597843f6d3'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:55.111942 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-407a2bb6-3bd2-411e-b2a9-cd597843f6d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbec12007b3843f5b8fafc2e9a0ed8a9', 'request_id': 'req-407a2bb6-3bd2-411e-b2a9-cd597843f6d3'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:55.126875 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-407a2bb6-3bd2-411e-b2a9-cd597843f6d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbec12007b3843f5b8fafc2e9a0ed8a9', 'request_id': 'req-407a2bb6-3bd2-411e-b2a9-cd597843f6d3'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:55.154644 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-407a2bb6-3bd2-411e-b2a9-cd597843f6d3 admin admin] The token cache is being invalidate because project bbec12007b3843f5b8fafc2e9a0ed8a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:54:55.155219 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-407a2bb6-3bd2-411e-b2a9-cd597843f6d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:55.156952 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-407a2bb6-3bd2-411e-b2a9-cd597843f6d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:55.159854 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 997/2004] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:54:54 2022] DELETE /identity/v3/projects/bbec12007b3843f5b8fafc2e9a0ed8a9 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:54:55.166446 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e155d0e7-3801-4ab9-a2b7-f0232d270753 service neutron] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:55.185824 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e155d0e7-3801-4ab9-a2b7-f0232d270753 service neutron] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:55.304034 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225143d-80ab-4b17-861c-ceea82bb0d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:55.305003 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225143d-80ab-4b17-861c-ceea82bb0d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:55.305289 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225143d-80ab-4b17-861c-ceea82bb0d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:55.305565 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225143d-80ab-4b17-861c-ceea82bb0d64 admin admin] PATH_INFO: `/v3/users/d2131fb435fd49f8bbe726e275e5d5b5` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:55.306982 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1225143d-80ab-4b17-861c-ceea82bb0d64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2131fb435fd49f8bbe726e275e5d5b5)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:55.309446 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1225143d-80ab-4b17-861c-ceea82bb0d64 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:55.393120 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-1225143d-80ab-4b17-861c-ceea82bb0d64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2131fb435fd49f8bbe726e275e5d5b5'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:55.425476 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-1225143d-80ab-4b17-861c-ceea82bb0d64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2131fb435fd49f8bbe726e275e5d5b5'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:55.444359 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-1225143d-80ab-4b17-861c-ceea82bb0d64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2131fb435fd49f8bbe726e275e5d5b5'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:55.445490 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-1225143d-80ab-4b17-861c-ceea82bb0d64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2131fb435fd49f8bbe726e275e5d5b5'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:55.471543 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-1225143d-80ab-4b17-861c-ceea82bb0d64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2131fb435fd49f8bbe726e275e5d5b5'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:55.484352 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1008/2005] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:54:55 2022] DELETE /identity/v3/users/d2131fb435fd49f8bbe726e275e5d5b5 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:54:55.889107 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a2bb6-3bd2-411e-b2a9-cd597843f6d3 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:55.892331 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-407a2bb6-3bd2-411e-b2a9-cd597843f6d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:55.920003 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a2bb6-3bd2-411e-b2a9-cd597843f6d3 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:56.028487 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa049775-28a2-405c-84e8-d43d3ef92144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:56.030352 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa049775-28a2-405c-84e8-d43d3ef92144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:56.030851 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa049775-28a2-405c-84e8-d43d3ef92144 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:56.032210 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa049775-28a2-405c-84e8-d43d3ef92144 admin admin] PATH_INFO: `/v3/projects/266694e87a02417f8c5931e2413db93d` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:56.034433 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa049775-28a2-405c-84e8-d43d3ef92144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=266694e87a02417f8c5931e2413db93d)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:56.036537 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa049775-28a2-405c-84e8-d43d3ef92144 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:56.102758 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-fa049775-28a2-405c-84e8-d43d3ef92144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '266694e87a02417f8c5931e2413db93d', 'request_id': 'req-fa049775-28a2-405c-84e8-d43d3ef92144'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:56.113284 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-fa049775-28a2-405c-84e8-d43d3ef92144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '266694e87a02417f8c5931e2413db93d', 'request_id': 'req-fa049775-28a2-405c-84e8-d43d3ef92144'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:56.123633 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-fa049775-28a2-405c-84e8-d43d3ef92144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '266694e87a02417f8c5931e2413db93d', 'request_id': 'req-fa049775-28a2-405c-84e8-d43d3ef92144'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:56.142574 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-fa049775-28a2-405c-84e8-d43d3ef92144 admin admin] The token cache is being invalidate because project 266694e87a02417f8c5931e2413db93d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:54:56.143045 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-fa049775-28a2-405c-84e8-d43d3ef92144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:56.143851 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-fa049775-28a2-405c-84e8-d43d3ef92144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:54:56.146306 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 998/2006] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:54:55 2022] DELETE /identity/v3/projects/266694e87a02417f8c5931e2413db93d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:54:56.153742 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38656002-2d4d-4b0a-bc21-a3a9c6ebd3d7 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:56.154096 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38656002-2d4d-4b0a-bc21-a3a9c6ebd3d7 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:56.154394 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38656002-2d4d-4b0a-bc21-a3a9c6ebd3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:56.216818 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-38656002-2d4d-4b0a-bc21-a3a9c6ebd3d7 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:54:56.219471 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-38656002-2d4d-4b0a-bc21-a3a9c6ebd3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:56.335221 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1009/2007] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:54:56.337054 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5669e-5f94-48fe-9712-ed6775059dbf None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:56.337392 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5669e-5f94-48fe-9712-ed6775059dbf None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:56.337718 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5669e-5f94-48fe-9712-ed6775059dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:56.361991 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-78f5669e-5f94-48fe-9712-ed6775059dbf None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:54:56.363243 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-78f5669e-5f94-48fe-9712-ed6775059dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:56.372753 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 999/2008] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:54:56.379444 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38656002-2d4d-4b0a-bc21-a3a9c6ebd3d7 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:56.393268 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38656002-2d4d-4b0a-bc21-a3a9c6ebd3d7 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:56.402446 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f0d53-1915-412f-8596-fe7d190c5c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:56.403584 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f0d53-1915-412f-8596-fe7d190c5c7a admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:56.404137 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f0d53-1915-412f-8596-fe7d190c5c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:56.404638 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f0d53-1915-412f-8596-fe7d190c5c7a admin admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:56.406595 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f0d53-1915-412f-8596-fe7d190c5c7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:54:56.407167 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f0d53-1915-412f-8596-fe7d190c5c7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:56.410505 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f0d53-1915-412f-8596-fe7d190c5c7a admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:56.437261 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1010/2009] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:54:56.440705 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5669e-5f94-48fe-9712-ed6775059dbf None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:56.453273 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5669e-5f94-48fe-9712-ed6775059dbf None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:56.462826 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fc9be-8a2e-4341-b6db-c722f5a55196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:56.463989 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fc9be-8a2e-4341-b6db-c722f5a55196 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:56.464451 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fc9be-8a2e-4341-b6db-c722f5a55196 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:56.464899 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fc9be-8a2e-4341-b6db-c722f5a55196 admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:56.466391 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387fc9be-8a2e-4341-b6db-c722f5a55196 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:56.469935 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387fc9be-8a2e-4341-b6db-c722f5a55196 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:56.514780 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1000/2010] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:54:56 2022] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:54:56.519546 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f0d53-1915-412f-8596-fe7d190c5c7a admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:56.531968 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f0d53-1915-412f-8596-fe7d190c5c7a admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:56.597907 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482e7f3-6387-4ef9-8d6f-b89b4caf753a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:56.598509 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482e7f3-6387-4ef9-8d6f-b89b4caf753a admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:56.598790 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482e7f3-6387-4ef9-8d6f-b89b4caf753a admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:56.599066 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482e7f3-6387-4ef9-8d6f-b89b4caf753a admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:56.599812 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482e7f3-6387-4ef9-8d6f-b89b4caf753a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:56.601807 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482e7f3-6387-4ef9-8d6f-b89b4caf753a admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:56.629337 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1011/2011] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:54:56 2022] POST /identity/v3/users => generated 286 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:54:56.634589 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fc9be-8a2e-4341-b6db-c722f5a55196 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:56.650881 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fc9be-8a2e-4341-b6db-c722f5a55196 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:56.659013 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e406ae-9a56-426f-a3b6-984bb9d29e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:56.660295 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e406ae-9a56-426f-a3b6-984bb9d29e2f admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:56.660847 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e406ae-9a56-426f-a3b6-984bb9d29e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:56.661375 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e406ae-9a56-426f-a3b6-984bb9d29e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:56.662756 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e406ae-9a56-426f-a3b6-984bb9d29e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:56.668057 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e406ae-9a56-426f-a3b6-984bb9d29e2f admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:56.679961 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1001/2012] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:54:56.684576 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482e7f3-6387-4ef9-8d6f-b89b4caf753a admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:56.696449 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482e7f3-6387-4ef9-8d6f-b89b4caf753a admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:56.701365 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b88de2-4581-4bd6-adff-8da21b8694cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:56.702039 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b88de2-4581-4bd6-adff-8da21b8694cf admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:56.702320 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b88de2-4581-4bd6-adff-8da21b8694cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:56.702602 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b88de2-4581-4bd6-adff-8da21b8694cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:56.703469 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b88de2-4581-4bd6-adff-8da21b8694cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:56.705263 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b88de2-4581-4bd6-adff-8da21b8694cf admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:56.718770 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1012/2013] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:54:56.723975 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e406ae-9a56-426f-a3b6-984bb9d29e2f admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:56.736461 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e406ae-9a56-426f-a3b6-984bb9d29e2f admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:56.743709 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499dcd0-8a0a-4984-8a71-c45ebac93c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:56.744942 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499dcd0-8a0a-4984-8a71-c45ebac93c9a admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:56.745274 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499dcd0-8a0a-4984-8a71-c45ebac93c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:56.745595 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499dcd0-8a0a-4984-8a71-c45ebac93c9a admin admin] PATH_INFO: `/v3/projects/a8e723cbd90248a99fc57b0f91499d2b/users/81d0863e38c14abf8de01799923ffe39/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:56.764253 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b499dcd0-8a0a-4984-8a71-c45ebac93c9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8e723cbd90248a99fc57b0f91499d2b, user_id=81d0863e38c14abf8de01799923ffe39, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:56.767052 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b499dcd0-8a0a-4984-8a71-c45ebac93c9a admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:56.784932 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1002/2014] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:54:56 2022] PUT /identity/v3/projects/a8e723cbd90248a99fc57b0f91499d2b/users/81d0863e38c14abf8de01799923ffe39/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:54:56.790339 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2787de-3583-4bcd-a382-9169bebc059c None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:56.790605 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2787de-3583-4bcd-a382-9169bebc059c None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:56.790885 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2787de-3583-4bcd-a382-9169bebc059c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:56.811475 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-6d2787de-3583-4bcd-a382-9169bebc059c None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:54:56.813978 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-6d2787de-3583-4bcd-a382-9169bebc059c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:56.894947 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1013/2015] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:54:56.906950 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499dcd0-8a0a-4984-8a71-c45ebac93c9a admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:56.909515 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-b499dcd0-8a0a-4984-8a71-c45ebac93c9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:56.981468 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499dcd0-8a0a-4984-8a71-c45ebac93c9a admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:56.986703 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb876212-7cf0-43a5-a3ab-34cebc0fa924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:56.987437 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb876212-7cf0-43a5-a3ab-34cebc0fa924 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:56.987789 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb876212-7cf0-43a5-a3ab-34cebc0fa924 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:56.988112 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb876212-7cf0-43a5-a3ab-34cebc0fa924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:56.999677 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb876212-7cf0-43a5-a3ab-34cebc0fa924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:57.001286 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb876212-7cf0-43a5-a3ab-34cebc0fa924 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:57.012345 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1003/2016] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:54:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:54:57.826887 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bf558-c171-4560-916f-06ef685804e7 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:57.827454 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bf558-c171-4560-916f-06ef685804e7 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:57.827548 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bf558-c171-4560-916f-06ef685804e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:57.860646 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-dc9bf558-c171-4560-916f-06ef685804e7 None None] MFA Rules not processed for user `81d0863e38c14abf8de01799923ffe39`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:54:57.861910 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-dc9bf558-c171-4560-916f-06ef685804e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:57.946140 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1014/2017] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:54:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:54:57.950803 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb876212-7cf0-43a5-a3ab-34cebc0fa924 service neutron] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:57.962051 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb876212-7cf0-43a5-a3ab-34cebc0fa924 service neutron] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:57.966860 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399e555-6723-4289-b930-edc4c7f0b9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:57.967525 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399e555-6723-4289-b930-edc4c7f0b9c4 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:57.967839 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399e555-6723-4289-b930-edc4c7f0b9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:57.968151 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399e555-6723-4289-b930-edc4c7f0b9c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:57.969493 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399e555-6723-4289-b930-edc4c7f0b9c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:57.971421 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399e555-6723-4289-b930-edc4c7f0b9c4 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:58.006655 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1004/2018] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:54:57 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:54:58.007981 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9bf558-c171-4560-916f-06ef685804e7 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:58.020172 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9bf558-c171-4560-916f-06ef685804e7 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:58.083359 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb226e-5ed6-4bc7-bf4e-f97ba6b3c9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:58.084256 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb226e-5ed6-4bc7-bf4e-f97ba6b3c9b6 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:58.084606 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb226e-5ed6-4bc7-bf4e-f97ba6b3c9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:58.084927 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb226e-5ed6-4bc7-bf4e-f97ba6b3c9b6 admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:58.085705 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb226e-5ed6-4bc7-bf4e-f97ba6b3c9b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:58.088089 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb226e-5ed6-4bc7-bf4e-f97ba6b3c9b6 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:58.111136 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1015/2019] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:54:58 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:54:58.115531 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399e555-6723-4289-b930-edc4c7f0b9c4 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:58.127236 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399e555-6723-4289-b930-edc4c7f0b9c4 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:58.132354 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3be657-9d1e-4523-8610-4587339fc6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:58.133035 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3be657-9d1e-4523-8610-4587339fc6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:58.133316 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3be657-9d1e-4523-8610-4587339fc6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:58.133592 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3be657-9d1e-4523-8610-4587339fc6b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:58.134327 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3be657-9d1e-4523-8610-4587339fc6b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:58.136072 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3be657-9d1e-4523-8610-4587339fc6b2 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:58.148136 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1005/2020] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:54:58.154100 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb226e-5ed6-4bc7-bf4e-f97ba6b3c9b6 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:58.172281 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb226e-5ed6-4bc7-bf4e-f97ba6b3c9b6 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:58.180145 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85be743-743e-420b-b9da-8a90fd430acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:58.181708 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85be743-743e-420b-b9da-8a90fd430acf admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:58.182190 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85be743-743e-420b-b9da-8a90fd430acf admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:58.182660 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85be743-743e-420b-b9da-8a90fd430acf admin admin] PATH_INFO: `/v3/projects/82c149dbe8114cfdac97b6335c054af0/users/6c34db3a90204045a68a2728b32fff77/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:58.207662 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85be743-743e-420b-b9da-8a90fd430acf admin admin] RBAC: Authorizing `identity:create_grant(project_id=82c149dbe8114cfdac97b6335c054af0, user_id=6c34db3a90204045a68a2728b32fff77, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:58.210555 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85be743-743e-420b-b9da-8a90fd430acf admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:58.229293 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1016/2021] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:54:58 2022] PUT /identity/v3/projects/82c149dbe8114cfdac97b6335c054af0/users/6c34db3a90204045a68a2728b32fff77/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:54:58.233920 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3be657-9d1e-4523-8610-4587339fc6b2 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:58.245529 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3be657-9d1e-4523-8610-4587339fc6b2 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:58.324120 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe8c89-e04d-4e5d-b1f7-2ae06b09b8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:58.324977 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe8c89-e04d-4e5d-b1f7-2ae06b09b8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:58.325310 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe8c89-e04d-4e5d-b1f7-2ae06b09b8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:58.325633 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe8c89-e04d-4e5d-b1f7-2ae06b09b8c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:58.326423 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe8c89-e04d-4e5d-b1f7-2ae06b09b8c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:58.329159 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe8c89-e04d-4e5d-b1f7-2ae06b09b8c0 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:58.341007 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1006/2022] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:54:58.345927 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85be743-743e-420b-b9da-8a90fd430acf admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:58.361076 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85be743-743e-420b-b9da-8a90fd430acf admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:58.368925 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf371a-cfcc-40b6-920a-0e7c526c639a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:58.370475 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf371a-cfcc-40b6-920a-0e7c526c639a admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:58.370943 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf371a-cfcc-40b6-920a-0e7c526c639a admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:58.371429 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf371a-cfcc-40b6-920a-0e7c526c639a admin admin] PATH_INFO: `/v3/projects/82c149dbe8114cfdac97b6335c054af0/users/6c34db3a90204045a68a2728b32fff77/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:58.375549 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf371a-cfcc-40b6-920a-0e7c526c639a admin admin] RBAC: Authorizing `identity:create_grant(project_id=82c149dbe8114cfdac97b6335c054af0, user_id=6c34db3a90204045a68a2728b32fff77, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:58.380961 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf371a-cfcc-40b6-920a-0e7c526c639a admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:58.400524 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1017/2023] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:54:58 2022] PUT /identity/v3/projects/82c149dbe8114cfdac97b6335c054af0/users/6c34db3a90204045a68a2728b32fff77/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:54:59.319013 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273890c-e3c5-4a0e-aa75-1583cc8f24b9 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:59.319662 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273890c-e3c5-4a0e-aa75-1583cc8f24b9 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:59.319662 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273890c-e3c5-4a0e-aa75-1583cc8f24b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:59.353117 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-a273890c-e3c5-4a0e-aa75-1583cc8f24b9 None None] MFA Rules not processed for user `6c34db3a90204045a68a2728b32fff77`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:54:59.354391 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-a273890c-e3c5-4a0e-aa75-1583cc8f24b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:59.454028 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1007/2024] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:54:59 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:54:59.467450 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf371a-cfcc-40b6-920a-0e7c526c639a admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:54:59.470464 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-4edf371a-cfcc-40b6-920a-0e7c526c639a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:54:59.547329 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf371a-cfcc-40b6-920a-0e7c526c639a admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:54:59.550774 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471d17e-4fc9-4120-be0d-90f0f0619781 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:54:59.551432 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471d17e-4fc9-4120-be0d-90f0f0619781 service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:54:59.551714 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471d17e-4fc9-4120-be0d-90f0f0619781 service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:54:59.552027 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471d17e-4fc9-4120-be0d-90f0f0619781 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:54:59.612843 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a471d17e-4fc9-4120-be0d-90f0f0619781 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:54:59.614349 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a471d17e-4fc9-4120-be0d-90f0f0619781 service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:54:59.624285 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1018/2025] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:54:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:55:00.076230 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273890c-e3c5-4a0e-aa75-1583cc8f24b9 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:00.077705 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-a273890c-e3c5-4a0e-aa75-1583cc8f24b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:00.161429 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273890c-e3c5-4a0e-aa75-1583cc8f24b9 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:00.168466 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936782f-1f78-4cdf-959c-06ff91d2f06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:00.169417 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936782f-1f78-4cdf-959c-06ff91d2f06f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:00.169698 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936782f-1f78-4cdf-959c-06ff91d2f06f admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:00.170011 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936782f-1f78-4cdf-959c-06ff91d2f06f admin admin] PATH_INFO: `/v3/users/05723f88446942628869ca3d1540c620` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:00.171277 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936782f-1f78-4cdf-959c-06ff91d2f06f admin admin] RBAC: Authorizing `identity:delete_user(user_id=05723f88446942628869ca3d1540c620)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:00.173599 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936782f-1f78-4cdf-959c-06ff91d2f06f admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:00.231854 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-2936782f-1f78-4cdf-959c-06ff91d2f06f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05723f88446942628869ca3d1540c620'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:00.240855 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-2936782f-1f78-4cdf-959c-06ff91d2f06f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05723f88446942628869ca3d1540c620'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:00.241624 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-2936782f-1f78-4cdf-959c-06ff91d2f06f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05723f88446942628869ca3d1540c620'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:00.259984 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-2936782f-1f78-4cdf-959c-06ff91d2f06f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05723f88446942628869ca3d1540c620'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:00.261321 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-2936782f-1f78-4cdf-959c-06ff91d2f06f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05723f88446942628869ca3d1540c620'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:00.280942 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1008/2026] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:55:00 2022] DELETE /identity/v3/users/05723f88446942628869ca3d1540c620 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:55:00.287305 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63dcf3-49e7-43eb-acf4-17edb6526769 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:00.287944 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63dcf3-49e7-43eb-acf4-17edb6526769 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:00.288428 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63dcf3-49e7-43eb-acf4-17edb6526769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:00.308699 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-4b63dcf3-49e7-43eb-acf4-17edb6526769 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:00.310482 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-4b63dcf3-49e7-43eb-acf4-17edb6526769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:00.379668 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1019/2027] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:55:00.390817 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936782f-1f78-4cdf-959c-06ff91d2f06f admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:00.393124 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-2936782f-1f78-4cdf-959c-06ff91d2f06f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:00.472266 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936782f-1f78-4cdf-959c-06ff91d2f06f admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:00.476701 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c08be-5516-4d17-9157-f0f06df1a258 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:00.477635 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c08be-5516-4d17-9157-f0f06df1a258 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:00.477962 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c08be-5516-4d17-9157-f0f06df1a258 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:00.478338 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c08be-5516-4d17-9157-f0f06df1a258 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:00.489090 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c08be-5516-4d17-9157-f0f06df1a258 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:00.490553 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c08be-5516-4d17-9157-f0f06df1a258 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:00.502893 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1009/2028] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:55:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:55:00.821559 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63dcf3-49e7-43eb-acf4-17edb6526769 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:00.824976 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-4b63dcf3-49e7-43eb-acf4-17edb6526769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:00.880628 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63dcf3-49e7-43eb-acf4-17edb6526769 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:00.891317 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc729c6f-4ebb-4a01-ba28-d4f4a0b254cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:00.892704 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc729c6f-4ebb-4a01-ba28-d4f4a0b254cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:00.894160 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc729c6f-4ebb-4a01-ba28-d4f4a0b254cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:00.894778 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc729c6f-4ebb-4a01-ba28-d4f4a0b254cc admin admin] PATH_INFO: `/v3/projects/0520536308fd4d46a03fee927289e1c8` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:00.898434 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc729c6f-4ebb-4a01-ba28-d4f4a0b254cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0520536308fd4d46a03fee927289e1c8)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:00.904030 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc729c6f-4ebb-4a01-ba28-d4f4a0b254cc admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:01.020237 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-fc729c6f-4ebb-4a01-ba28-d4f4a0b254cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0520536308fd4d46a03fee927289e1c8', 'request_id': 'req-fc729c6f-4ebb-4a01-ba28-d4f4a0b254cc'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:01.027499 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-fc729c6f-4ebb-4a01-ba28-d4f4a0b254cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0520536308fd4d46a03fee927289e1c8', 'request_id': 'req-fc729c6f-4ebb-4a01-ba28-d4f4a0b254cc'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:01.039187 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-fc729c6f-4ebb-4a01-ba28-d4f4a0b254cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0520536308fd4d46a03fee927289e1c8', 'request_id': 'req-fc729c6f-4ebb-4a01-ba28-d4f4a0b254cc'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:01.057758 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-fc729c6f-4ebb-4a01-ba28-d4f4a0b254cc admin admin] The token cache is being invalidate because project 0520536308fd4d46a03fee927289e1c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:55:01.058344 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-fc729c6f-4ebb-4a01-ba28-d4f4a0b254cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:01.059162 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-fc729c6f-4ebb-4a01-ba28-d4f4a0b254cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:01.060806 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1020/2029] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:55:00 2022] DELETE /identity/v3/projects/0520536308fd4d46a03fee927289e1c8 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:01.142531 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c08be-5516-4d17-9157-f0f06df1a258 service neutron] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:01.144198 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-2d0c08be-5516-4d17-9157-f0f06df1a258 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:01.263568 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c08be-5516-4d17-9157-f0f06df1a258 service neutron] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:01.392821 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a14f4a-9a21-46d4-8cb1-a1d8d5008e9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:01.394544 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a14f4a-9a21-46d4-8cb1-a1d8d5008e9b service cinder] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:01.394990 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a14f4a-9a21-46d4-8cb1-a1d8d5008e9b service cinder] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:01.395444 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a14f4a-9a21-46d4-8cb1-a1d8d5008e9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:01.397774 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-b8a14f4a-9a21-46d4-8cb1-a1d8d5008e9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:01.486856 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a14f4a-9a21-46d4-8cb1-a1d8d5008e9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:01.488592 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a14f4a-9a21-46d4-8cb1-a1d8d5008e9b service cinder] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:01.508163 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1010/2030] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:55:01 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:55:05.900064 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e436b07-e072-4c12-aa64-eebc42da099b None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:05.901043 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e436b07-e072-4c12-aa64-eebc42da099b None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:05.901043 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e436b07-e072-4c12-aa64-eebc42da099b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:05.923472 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-8e436b07-e072-4c12-aa64-eebc42da099b None None] MFA Rules not processed for user `78cde480dd8b4a85ac30895026bfc406`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:05.925108 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-8e436b07-e072-4c12-aa64-eebc42da099b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:05.992930 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1021/2031] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Oct 28 20:55:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:55:06.039112 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a14f4a-9a21-46d4-8cb1-a1d8d5008e9b service cinder] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:06.040733 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-b8a14f4a-9a21-46d4-8cb1-a1d8d5008e9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:06.117114 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a14f4a-9a21-46d4-8cb1-a1d8d5008e9b service cinder] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:06.122513 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88634e2e-5d44-4e02-ad00-d88600792ff8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d70db11d2d4923943bc6479bc49206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:06.123181 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88634e2e-5d44-4e02-ad00-d88600792ff8 service swift] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:06.123457 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88634e2e-5d44-4e02-ad00-d88600792ff8 service swift] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:06.123725 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88634e2e-5d44-4e02-ad00-d88600792ff8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:06.132903 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88634e2e-5d44-4e02-ad00-d88600792ff8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:06.134537 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88634e2e-5d44-4e02-ad00-d88600792ff8 service swift] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:06.143971 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1011/2032] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Oct 28 20:55:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 20:55:06.817674 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05db6a5-29a9-40c7-99f1-b916d6640b8f None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:06.817961 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05db6a5-29a9-40c7-99f1-b916d6640b8f None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:06.818245 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05db6a5-29a9-40c7-99f1-b916d6640b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:06.839466 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-c05db6a5-29a9-40c7-99f1-b916d6640b8f None None] MFA Rules not processed for user `78cde480dd8b4a85ac30895026bfc406`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:06.840804 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-c05db6a5-29a9-40c7-99f1-b916d6640b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:06.852458 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1022/2033] 10.222.0.49 () {58 vars in 967 bytes} [Fri Oct 28 20:55:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:55:06.870616 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88634e2e-5d44-4e02-ad00-d88600792ff8 service swift] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:06.884426 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88634e2e-5d44-4e02-ad00-d88600792ff8 service swift] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:06.896090 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12811840-31ae-4751-b8fd-36aff6a074c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d70db11d2d4923943bc6479bc49206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:06.896090 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12811840-31ae-4751-b8fd-36aff6a074c9 service swift] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:06.896090 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12811840-31ae-4751-b8fd-36aff6a074c9 service swift] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:06.896090 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12811840-31ae-4751-b8fd-36aff6a074c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:06.914894 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12811840-31ae-4751-b8fd-36aff6a074c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:06.918020 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12811840-31ae-4751-b8fd-36aff6a074c9 service swift] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:06.932862 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1012/2034] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Oct 28 20:55:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 20:55:07.245226 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c2202-4caa-404d-81a2-f4939f5efb11 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:07.245915 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c2202-4caa-404d-81a2-f4939f5efb11 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:07.245915 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c2202-4caa-404d-81a2-f4939f5efb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:07.269392 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-d94c2202-4caa-404d-81a2-f4939f5efb11 None None] MFA Rules not processed for user `78cde480dd8b4a85ac30895026bfc406`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:07.270882 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-d94c2202-4caa-404d-81a2-f4939f5efb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:07.279551 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1023/2035] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Oct 28 20:55:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:55:07.294063 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12811840-31ae-4751-b8fd-36aff6a074c9 service swift] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:07.306304 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12811840-31ae-4751-b8fd-36aff6a074c9 service swift] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:07.311784 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579b5a6-3968-478d-981a-f5af3afc1f16 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d70db11d2d4923943bc6479bc49206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:07.313318 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579b5a6-3968-478d-981a-f5af3afc1f16 service swift] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:07.313598 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579b5a6-3968-478d-981a-f5af3afc1f16 service swift] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:07.313869 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579b5a6-3968-478d-981a-f5af3afc1f16 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:07.323884 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579b5a6-3968-478d-981a-f5af3afc1f16 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:07.325347 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579b5a6-3968-478d-981a-f5af3afc1f16 service swift] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:07.335792 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1013/2036] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Oct 28 20:55:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 20:55:07.765767 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7cbdd-6790-4a7b-a1c9-964d4090213f None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:07.766737 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7cbdd-6790-4a7b-a1c9-964d4090213f None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:07.767023 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7cbdd-6790-4a7b-a1c9-964d4090213f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:07.789468 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-e3f7cbdd-6790-4a7b-a1c9-964d4090213f None None] MFA Rules not processed for user `78cde480dd8b4a85ac30895026bfc406`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:07.790957 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-e3f7cbdd-6790-4a7b-a1c9-964d4090213f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:07.798836 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1024/2037] 10.222.0.49 () {58 vars in 967 bytes} [Fri Oct 28 20:55:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:55:07.817472 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579b5a6-3968-478d-981a-f5af3afc1f16 service swift] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:07.840857 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579b5a6-3968-478d-981a-f5af3afc1f16 service swift] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:07.852646 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9907d2-76d7-4bfa-bccd-de331a74e2fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d70db11d2d4923943bc6479bc49206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:07.853817 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9907d2-76d7-4bfa-bccd-de331a74e2fd service swift] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:07.854478 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9907d2-76d7-4bfa-bccd-de331a74e2fd service swift] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:07.855103 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9907d2-76d7-4bfa-bccd-de331a74e2fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:07.873735 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9907d2-76d7-4bfa-bccd-de331a74e2fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:07.876291 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9907d2-76d7-4bfa-bccd-de331a74e2fd service swift] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:07.890804 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1014/2038] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Oct 28 20:55:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 20:55:09.620717 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7cbdd-6790-4a7b-a1c9-964d4090213f None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:09.622869 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-e3f7cbdd-6790-4a7b-a1c9-964d4090213f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:09.711328 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7cbdd-6790-4a7b-a1c9-964d4090213f None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:09.716010 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8dd2f5-5ce1-4cb1-8600-7ffbe59edddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:09.717290 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8dd2f5-5ce1-4cb1-8600-7ffbe59edddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:09.717496 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8dd2f5-5ce1-4cb1-8600-7ffbe59edddb admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:09.717666 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8dd2f5-5ce1-4cb1-8600-7ffbe59edddb admin admin] PATH_INFO: `/v3/users/21ddc19fa0744b07a260fb17ea038d5b` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:09.719620 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8dd2f5-5ce1-4cb1-8600-7ffbe59edddb admin admin] RBAC: Authorizing `identity:delete_user(user_id=21ddc19fa0744b07a260fb17ea038d5b)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:09.722015 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8dd2f5-5ce1-4cb1-8600-7ffbe59edddb admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:09.792849 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-6d8dd2f5-5ce1-4cb1-8600-7ffbe59edddb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21ddc19fa0744b07a260fb17ea038d5b'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:09.801679 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-6d8dd2f5-5ce1-4cb1-8600-7ffbe59edddb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21ddc19fa0744b07a260fb17ea038d5b'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:09.811057 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-6d8dd2f5-5ce1-4cb1-8600-7ffbe59edddb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21ddc19fa0744b07a260fb17ea038d5b'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:09.812658 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-6d8dd2f5-5ce1-4cb1-8600-7ffbe59edddb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21ddc19fa0744b07a260fb17ea038d5b'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:09.832344 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-6d8dd2f5-5ce1-4cb1-8600-7ffbe59edddb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21ddc19fa0744b07a260fb17ea038d5b'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:09.839184 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1025/2039] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:55:09 2022] DELETE /identity/v3/users/21ddc19fa0744b07a260fb17ea038d5b => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:09.844720 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46e649-84a2-4853-9f4a-14e3a67bb016 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:09.845514 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46e649-84a2-4853-9f4a-14e3a67bb016 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:09.845514 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46e649-84a2-4853-9f4a-14e3a67bb016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:09.865222 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-ef46e649-84a2-4853-9f4a-14e3a67bb016 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:09.866717 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-ef46e649-84a2-4853-9f4a-14e3a67bb016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:09.936443 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1015/2040] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:55:09.947460 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8dd2f5-5ce1-4cb1-8600-7ffbe59edddb admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:09.949420 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-6d8dd2f5-5ce1-4cb1-8600-7ffbe59edddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:10.017266 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8dd2f5-5ce1-4cb1-8600-7ffbe59edddb admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:10.020960 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c96c84-eab9-45f1-8cf1-4b1838f6b720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:10.021614 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c96c84-eab9-45f1-8cf1-4b1838f6b720 service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:10.021895 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c96c84-eab9-45f1-8cf1-4b1838f6b720 service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:10.022167 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c96c84-eab9-45f1-8cf1-4b1838f6b720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:10.033236 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c96c84-eab9-45f1-8cf1-4b1838f6b720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:10.034858 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c96c84-eab9-45f1-8cf1-4b1838f6b720 service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:10.045930 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1026/2041] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:55:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:55:10.343907 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef46e649-84a2-4853-9f4a-14e3a67bb016 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:10.346603 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-ef46e649-84a2-4853-9f4a-14e3a67bb016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:10.369685 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef46e649-84a2-4853-9f4a-14e3a67bb016 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:10.378918 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e7850-390d-4f59-8527-3d6eae55404d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:10.381433 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e7850-390d-4f59-8527-3d6eae55404d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:10.382184 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e7850-390d-4f59-8527-3d6eae55404d admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:10.382876 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e7850-390d-4f59-8527-3d6eae55404d admin admin] PATH_INFO: `/v3/users/40ba15ac1e1a4e699d83c5f4d9bec9f4` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:10.385267 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e7850-390d-4f59-8527-3d6eae55404d admin admin] RBAC: Authorizing `identity:delete_user(user_id=40ba15ac1e1a4e699d83c5f4d9bec9f4)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:10.389350 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e7850-390d-4f59-8527-3d6eae55404d admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:10.392705 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c96c84-eab9-45f1-8cf1-4b1838f6b720 service neutron] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:10.394992 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-f8c96c84-eab9-45f1-8cf1-4b1838f6b720 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:10.425772 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c96c84-eab9-45f1-8cf1-4b1838f6b720 service neutron] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:10.439164 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10dab9-c72a-471b-92ae-40e1de34cedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:10.441067 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10dab9-c72a-471b-92ae-40e1de34cedb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:10.441502 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10dab9-c72a-471b-92ae-40e1de34cedb admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:10.442154 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10dab9-c72a-471b-92ae-40e1de34cedb admin admin] PATH_INFO: `/v3/projects/ab284a174c674de5a97e024079c0b646` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:10.444949 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10dab9-c72a-471b-92ae-40e1de34cedb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab284a174c674de5a97e024079c0b646)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:10.449285 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10dab9-c72a-471b-92ae-40e1de34cedb admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:10.489829 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-5b0e7850-390d-4f59-8527-3d6eae55404d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40ba15ac1e1a4e699d83c5f4d9bec9f4'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:10.499732 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-5b0e7850-390d-4f59-8527-3d6eae55404d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40ba15ac1e1a4e699d83c5f4d9bec9f4'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:10.500706 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-5b0e7850-390d-4f59-8527-3d6eae55404d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40ba15ac1e1a4e699d83c5f4d9bec9f4'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:10.516813 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-5b0e7850-390d-4f59-8527-3d6eae55404d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40ba15ac1e1a4e699d83c5f4d9bec9f4'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:10.517904 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-5b0e7850-390d-4f59-8527-3d6eae55404d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40ba15ac1e1a4e699d83c5f4d9bec9f4'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:10.537041 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-7d10dab9-c72a-471b-92ae-40e1de34cedb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab284a174c674de5a97e024079c0b646', 'request_id': 'req-7d10dab9-c72a-471b-92ae-40e1de34cedb'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:10.538453 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1016/2042] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:55:10 2022] DELETE /identity/v3/users/40ba15ac1e1a4e699d83c5f4d9bec9f4 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:10.543345 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e65ca-6460-4a37-9541-97c7debe4fa3 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:10.543613 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e65ca-6460-4a37-9541-97c7debe4fa3 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:10.543994 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e65ca-6460-4a37-9541-97c7debe4fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:10.548761 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-7d10dab9-c72a-471b-92ae-40e1de34cedb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab284a174c674de5a97e024079c0b646', 'request_id': 'req-7d10dab9-c72a-471b-92ae-40e1de34cedb'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:10.561293 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-7d10dab9-c72a-471b-92ae-40e1de34cedb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab284a174c674de5a97e024079c0b646', 'request_id': 'req-7d10dab9-c72a-471b-92ae-40e1de34cedb'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:10.572431 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-667e65ca-6460-4a37-9541-97c7debe4fa3 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:10.574387 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-667e65ca-6460-4a37-9541-97c7debe4fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:10.583673 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-7d10dab9-c72a-471b-92ae-40e1de34cedb admin admin] The token cache is being invalidate because project ab284a174c674de5a97e024079c0b646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:55:10.584369 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-7d10dab9-c72a-471b-92ae-40e1de34cedb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:10.585590 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-7d10dab9-c72a-471b-92ae-40e1de34cedb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:10.588556 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1027/2043] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:55:10 2022] DELETE /identity/v3/projects/ab284a174c674de5a97e024079c0b646 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:55:10.595625 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10dab9-c72a-471b-92ae-40e1de34cedb admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:10.598344 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-7d10dab9-c72a-471b-92ae-40e1de34cedb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:10.687662 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1017/2044] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:55:10.700049 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e65ca-6460-4a37-9541-97c7debe4fa3 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:10.706022 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-667e65ca-6460-4a37-9541-97c7debe4fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:10.728990 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10dab9-c72a-471b-92ae-40e1de34cedb admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:10.737614 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0e8be-cce0-49e2-bc7d-940b3d2cc539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:10.739179 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0e8be-cce0-49e2-bc7d-940b3d2cc539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:10.739793 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0e8be-cce0-49e2-bc7d-940b3d2cc539 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:10.740334 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0e8be-cce0-49e2-bc7d-940b3d2cc539 admin admin] PATH_INFO: `/v3/users/1d776c4c224e4cd4bdc6f844aa6835d7` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:10.742585 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0e8be-cce0-49e2-bc7d-940b3d2cc539 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d776c4c224e4cd4bdc6f844aa6835d7)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:10.745874 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0e8be-cce0-49e2-bc7d-940b3d2cc539 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:10.823826 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e65ca-6460-4a37-9541-97c7debe4fa3 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:10.828611 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e6adf-51e5-4e58-b9d5-5b5d8ed13d44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:10.829457 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e6adf-51e5-4e58-b9d5-5b5d8ed13d44 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:10.829743 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e6adf-51e5-4e58-b9d5-5b5d8ed13d44 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:10.830017 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e6adf-51e5-4e58-b9d5-5b5d8ed13d44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:10.841314 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e6adf-51e5-4e58-b9d5-5b5d8ed13d44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:10.844032 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e6adf-51e5-4e58-b9d5-5b5d8ed13d44 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:10.849899 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-f0c0e8be-cce0-49e2-bc7d-940b3d2cc539 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d776c4c224e4cd4bdc6f844aa6835d7'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:10.855670 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1018/2045] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:55:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:55:10.872684 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-f0c0e8be-cce0-49e2-bc7d-940b3d2cc539 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d776c4c224e4cd4bdc6f844aa6835d7'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:10.892769 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-f0c0e8be-cce0-49e2-bc7d-940b3d2cc539 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d776c4c224e4cd4bdc6f844aa6835d7'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:10.894114 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-f0c0e8be-cce0-49e2-bc7d-940b3d2cc539 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d776c4c224e4cd4bdc6f844aa6835d7'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:10.924899 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-f0c0e8be-cce0-49e2-bc7d-940b3d2cc539 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d776c4c224e4cd4bdc6f844aa6835d7'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:10.936939 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1028/2046] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:55:10 2022] DELETE /identity/v3/users/1d776c4c224e4cd4bdc6f844aa6835d7 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:11.211939 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e6adf-51e5-4e58-b9d5-5b5d8ed13d44 service neutron] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:11.214540 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-609e6adf-51e5-4e58-b9d5-5b5d8ed13d44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:11.240698 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e6adf-51e5-4e58-b9d5-5b5d8ed13d44 service neutron] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:11.329555 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458b855-9374-41d0-8a66-4ba4f6dd85d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:11.330610 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458b855-9374-41d0-8a66-4ba4f6dd85d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:11.331105 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458b855-9374-41d0-8a66-4ba4f6dd85d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:11.331543 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458b855-9374-41d0-8a66-4ba4f6dd85d6 admin admin] PATH_INFO: `/v3/projects/9981f3807f9b41a3be1d1ef719734e51` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:11.332993 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a458b855-9374-41d0-8a66-4ba4f6dd85d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9981f3807f9b41a3be1d1ef719734e51)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:11.335019 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a458b855-9374-41d0-8a66-4ba4f6dd85d6 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:11.390764 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-a458b855-9374-41d0-8a66-4ba4f6dd85d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9981f3807f9b41a3be1d1ef719734e51', 'request_id': 'req-a458b855-9374-41d0-8a66-4ba4f6dd85d6'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:11.398259 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-a458b855-9374-41d0-8a66-4ba4f6dd85d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9981f3807f9b41a3be1d1ef719734e51', 'request_id': 'req-a458b855-9374-41d0-8a66-4ba4f6dd85d6'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:11.406391 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-a458b855-9374-41d0-8a66-4ba4f6dd85d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9981f3807f9b41a3be1d1ef719734e51', 'request_id': 'req-a458b855-9374-41d0-8a66-4ba4f6dd85d6'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:11.422517 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-a458b855-9374-41d0-8a66-4ba4f6dd85d6 admin admin] The token cache is being invalidate because project 9981f3807f9b41a3be1d1ef719734e51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:55:11.423102 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-a458b855-9374-41d0-8a66-4ba4f6dd85d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:11.423521 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-a458b855-9374-41d0-8a66-4ba4f6dd85d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:11.425167 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1019/2047] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:55:11 2022] DELETE /identity/v3/projects/9981f3807f9b41a3be1d1ef719734e51 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:11.431583 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513a35b-d411-4ceb-9710-9d3d90c3a2fb None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:11.432140 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513a35b-d411-4ceb-9710-9d3d90c3a2fb None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:11.432600 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513a35b-d411-4ceb-9710-9d3d90c3a2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:11.471259 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-9513a35b-d411-4ceb-9710-9d3d90c3a2fb None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:11.473045 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-9513a35b-d411-4ceb-9710-9d3d90c3a2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:11.572741 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1029/2048] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:55:11.587351 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4dbfe-b981-402a-9a4c-e83b321c8589 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:11.588202 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4dbfe-b981-402a-9a4c-e83b321c8589 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:11.589133 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4dbfe-b981-402a-9a4c-e83b321c8589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:11.624950 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-a8b4dbfe-b981-402a-9a4c-e83b321c8589 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:11.626563 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-a8b4dbfe-b981-402a-9a4c-e83b321c8589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:11.635318 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1020/2049] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:55:11.639908 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513a35b-d411-4ceb-9710-9d3d90c3a2fb None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:11.652431 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513a35b-d411-4ceb-9710-9d3d90c3a2fb None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:11.661605 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4ec71-4918-4271-8575-f1e9b691558b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:11.664199 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4ec71-4918-4271-8575-f1e9b691558b admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:11.665078 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4ec71-4918-4271-8575-f1e9b691558b admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:11.665442 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4ec71-4918-4271-8575-f1e9b691558b admin admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:11.666397 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4ec71-4918-4271-8575-f1e9b691558b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:55:11.666738 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4ec71-4918-4271-8575-f1e9b691558b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:11.669437 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4ec71-4918-4271-8575-f1e9b691558b admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:11.690943 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1030/2050] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:55:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:55:11.696322 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b4dbfe-b981-402a-9a4c-e83b321c8589 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:11.716824 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b4dbfe-b981-402a-9a4c-e83b321c8589 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:11.726527 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4b7f5-1a3b-42db-9d0f-513d96bf36ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:11.727681 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4b7f5-1a3b-42db-9d0f-513d96bf36ee admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:11.728227 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4b7f5-1a3b-42db-9d0f-513d96bf36ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:11.728723 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4b7f5-1a3b-42db-9d0f-513d96bf36ee admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:11.730021 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4b7f5-1a3b-42db-9d0f-513d96bf36ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:11.734296 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4b7f5-1a3b-42db-9d0f-513d96bf36ee admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:11.740269 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4ec71-4918-4271-8575-f1e9b691558b admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:11.742369 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-47c4ec71-4918-4271-8575-f1e9b691558b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:11.759419 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4ec71-4918-4271-8575-f1e9b691558b admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:11.765363 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e704103-fbc8-4646-9ac9-1ebb625e14e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:11.767539 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e704103-fbc8-4646-9ac9-1ebb625e14e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:11.768188 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e704103-fbc8-4646-9ac9-1ebb625e14e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:11.768573 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e704103-fbc8-4646-9ac9-1ebb625e14e2 admin admin] PATH_INFO: `/v3/projects/5a74645ff5474bf1b6caceab324b9384` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:11.771220 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e704103-fbc8-4646-9ac9-1ebb625e14e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a74645ff5474bf1b6caceab324b9384)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:11.774443 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e704103-fbc8-4646-9ac9-1ebb625e14e2 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:11.803846 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1021/2051] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:55:11 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:55:11.805465 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4b7f5-1a3b-42db-9d0f-513d96bf36ee admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:11.847715 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-1e704103-fbc8-4646-9ac9-1ebb625e14e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a74645ff5474bf1b6caceab324b9384', 'request_id': 'req-1e704103-fbc8-4646-9ac9-1ebb625e14e2'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:11.854462 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-1e704103-fbc8-4646-9ac9-1ebb625e14e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a74645ff5474bf1b6caceab324b9384', 'request_id': 'req-1e704103-fbc8-4646-9ac9-1ebb625e14e2'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:11.864664 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-1e704103-fbc8-4646-9ac9-1ebb625e14e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a74645ff5474bf1b6caceab324b9384', 'request_id': 'req-1e704103-fbc8-4646-9ac9-1ebb625e14e2'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:11.879668 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-1e704103-fbc8-4646-9ac9-1ebb625e14e2 admin admin] The token cache is being invalidate because project 5a74645ff5474bf1b6caceab324b9384 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:55:11.880079 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-1e704103-fbc8-4646-9ac9-1ebb625e14e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:11.880829 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-1e704103-fbc8-4646-9ac9-1ebb625e14e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:11.882437 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1031/2052] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:55:11 2022] DELETE /identity/v3/projects/5a74645ff5474bf1b6caceab324b9384 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:55:11.890666 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834e628-a3d5-45cb-b394-b2141eae1b0b None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:11.891275 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834e628-a3d5-45cb-b394-b2141eae1b0b None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:11.891895 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834e628-a3d5-45cb-b394-b2141eae1b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:11.903619 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4b7f5-1a3b-42db-9d0f-513d96bf36ee admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:11.924724 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-0834e628-a3d5-45cb-b394-b2141eae1b0b None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:11.927049 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-0834e628-a3d5-45cb-b394-b2141eae1b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:12.018937 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885442c-5f91-4e84-a428-6b2aca7deea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:12.020045 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885442c-5f91-4e84-a428-6b2aca7deea7 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:12.021490 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885442c-5f91-4e84-a428-6b2aca7deea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:12.022274 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885442c-5f91-4e84-a428-6b2aca7deea7 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:12.028905 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e885442c-5f91-4e84-a428-6b2aca7deea7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:12.034988 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e885442c-5f91-4e84-a428-6b2aca7deea7 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:12.062556 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1032/2053] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:55:12.080179 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5dc4a-fabd-4b0f-94f5-c4aeaea9ebfc None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:12.081220 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5dc4a-fabd-4b0f-94f5-c4aeaea9ebfc None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:12.082280 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5dc4a-fabd-4b0f-94f5-c4aeaea9ebfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:12.085185 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1022/2054] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:55:11 2022] POST /identity/v3/users => generated 286 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:55:12.089540 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885442c-5f91-4e84-a428-6b2aca7deea7 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:12.092577 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-e885442c-5f91-4e84-a428-6b2aca7deea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:12.121741 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-70e5dc4a-fabd-4b0f-94f5-c4aeaea9ebfc None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:12.124068 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-70e5dc4a-fabd-4b0f-94f5-c4aeaea9ebfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:12.130260 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885442c-5f91-4e84-a428-6b2aca7deea7 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:12.142215 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786cdca-6096-4af8-a097-f643366fa439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:12.143639 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786cdca-6096-4af8-a097-f643366fa439 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:12.144329 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786cdca-6096-4af8-a097-f643366fa439 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:12.144996 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786cdca-6096-4af8-a097-f643366fa439 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:12.146249 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d786cdca-6096-4af8-a097-f643366fa439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:12.150578 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1033/2055] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:55:12.156728 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d786cdca-6096-4af8-a097-f643366fa439 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:12.157358 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5dc4a-fabd-4b0f-94f5-c4aeaea9ebfc None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:12.181655 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1023/2056] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:55:12.183905 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5dc4a-fabd-4b0f-94f5-c4aeaea9ebfc None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:12.186092 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786cdca-6096-4af8-a097-f643366fa439 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:12.199487 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c75fed-d17f-4f5b-892c-19a8582a007f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:12.200193 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c75fed-d17f-4f5b-892c-19a8582a007f admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:12.200471 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c75fed-d17f-4f5b-892c-19a8582a007f admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:12.200781 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c75fed-d17f-4f5b-892c-19a8582a007f admin admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:12.201731 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c75fed-d17f-4f5b-892c-19a8582a007f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:55:12.202094 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c75fed-d17f-4f5b-892c-19a8582a007f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:12.207512 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786cdca-6096-4af8-a097-f643366fa439 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:12.209339 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c75fed-d17f-4f5b-892c-19a8582a007f admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:12.223882 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401267a9-75bb-472c-ad94-9d697358e64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:12.224588 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401267a9-75bb-472c-ad94-9d697358e64e admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:12.224863 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401267a9-75bb-472c-ad94-9d697358e64e admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:12.225127 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401267a9-75bb-472c-ad94-9d697358e64e admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:12.226068 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401267a9-75bb-472c-ad94-9d697358e64e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:12.227896 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401267a9-75bb-472c-ad94-9d697358e64e admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:12.241304 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1034/2057] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:55:12.250588 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1024/2058] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:55:12.250828 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c75fed-d17f-4f5b-892c-19a8582a007f admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:12.258028 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401267a9-75bb-472c-ad94-9d697358e64e admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:12.279487 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401267a9-75bb-472c-ad94-9d697358e64e admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:12.285127 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c75fed-d17f-4f5b-892c-19a8582a007f admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:12.287773 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34bd602-82e2-483b-811a-63693d304f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:12.288883 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34bd602-82e2-483b-811a-63693d304f7c admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:12.289268 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34bd602-82e2-483b-811a-63693d304f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:12.289643 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34bd602-82e2-483b-811a-63693d304f7c admin admin] PATH_INFO: `/v3/projects/803952ec317943c68a52064ca0c2535a/users/f4f5265b9b47425fb6e57f2448209927/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:12.293192 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b577db9-43eb-4747-bbc6-74d575504882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:12.295186 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b577db9-43eb-4747-bbc6-74d575504882 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:12.295847 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b577db9-43eb-4747-bbc6-74d575504882 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:12.297664 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b577db9-43eb-4747-bbc6-74d575504882 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:12.298753 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b577db9-43eb-4747-bbc6-74d575504882 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:12.301059 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b577db9-43eb-4747-bbc6-74d575504882 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:12.311957 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34bd602-82e2-483b-811a-63693d304f7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=803952ec317943c68a52064ca0c2535a, user_id=f4f5265b9b47425fb6e57f2448209927, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:12.317176 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34bd602-82e2-483b-811a-63693d304f7c admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:12.340560 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1025/2059] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:55:12 2022] PUT /identity/v3/projects/803952ec317943c68a52064ca0c2535a/users/f4f5265b9b47425fb6e57f2448209927/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:12.341629 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1035/2060] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:55:12 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:55:12.349130 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b577db9-43eb-4747-bbc6-74d575504882 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:12.349534 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791e559-89a3-458f-8edd-04962f937596 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:12.349644 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791e559-89a3-458f-8edd-04962f937596 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:12.350077 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791e559-89a3-458f-8edd-04962f937596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:12.378329 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-1791e559-89a3-458f-8edd-04962f937596 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:12.379852 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-1791e559-89a3-458f-8edd-04962f937596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:12.475791 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b577db9-43eb-4747-bbc6-74d575504882 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:12.481716 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9deae44-1474-439e-b846-6fcfe1e82e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:12.482312 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9deae44-1474-439e-b846-6fcfe1e82e23 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:12.482599 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9deae44-1474-439e-b846-6fcfe1e82e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:12.482877 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9deae44-1474-439e-b846-6fcfe1e82e23 admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:12.484679 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9deae44-1474-439e-b846-6fcfe1e82e23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:12.486970 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9deae44-1474-439e-b846-6fcfe1e82e23 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:12.506824 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1026/2061] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:55:12.519676 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791e559-89a3-458f-8edd-04962f937596 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:12.522282 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-1791e559-89a3-458f-8edd-04962f937596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:12.529537 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1036/2062] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:55:12 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:55:12.536351 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9deae44-1474-439e-b846-6fcfe1e82e23 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:12.550378 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9deae44-1474-439e-b846-6fcfe1e82e23 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:12.557507 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca188ea-eabd-4da0-989d-a14ec033a32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:12.558209 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca188ea-eabd-4da0-989d-a14ec033a32e admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:12.558488 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca188ea-eabd-4da0-989d-a14ec033a32e admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:12.558812 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca188ea-eabd-4da0-989d-a14ec033a32e admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:12.559642 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca188ea-eabd-4da0-989d-a14ec033a32e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:12.561395 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca188ea-eabd-4da0-989d-a14ec033a32e admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:12.587009 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1037/2063] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:55:12.591477 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca188ea-eabd-4da0-989d-a14ec033a32e admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:12.617507 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca188ea-eabd-4da0-989d-a14ec033a32e admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:12.627127 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee6c4c-7807-4f4b-b559-6e4ce63ff126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:12.628317 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee6c4c-7807-4f4b-b559-6e4ce63ff126 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:12.628615 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee6c4c-7807-4f4b-b559-6e4ce63ff126 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:12.629155 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee6c4c-7807-4f4b-b559-6e4ce63ff126 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:12.629845 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfee6c4c-7807-4f4b-b559-6e4ce63ff126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:12.631700 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfee6c4c-7807-4f4b-b559-6e4ce63ff126 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:12.644735 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1038/2064] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:55:12.651188 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee6c4c-7807-4f4b-b559-6e4ce63ff126 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:12.651475 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791e559-89a3-458f-8edd-04962f937596 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:12.658704 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00cd74-b3a2-4d20-9313-28dd7f993d3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:12.660043 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00cd74-b3a2-4d20-9313-28dd7f993d3e service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:12.660610 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00cd74-b3a2-4d20-9313-28dd7f993d3e service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:12.661154 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00cd74-b3a2-4d20-9313-28dd7f993d3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:12.664152 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee6c4c-7807-4f4b-b559-6e4ce63ff126 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:12.672389 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9cd725-1385-475e-b1c2-9dc2cea42dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:12.673712 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cd725-1385-475e-b1c2-9dc2cea42dcf admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:12.673989 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cd725-1385-475e-b1c2-9dc2cea42dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:12.674427 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cd725-1385-475e-b1c2-9dc2cea42dcf admin admin] PATH_INFO: `/v3/projects/4bc3c2f021704a71b50ee2524f6ccaa7/users/c5f84459aacb4d36a409a74eea857c64/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:12.678883 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00cd74-b3a2-4d20-9313-28dd7f993d3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:12.682409 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00cd74-b3a2-4d20-9313-28dd7f993d3e service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:12.694599 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9cd725-1385-475e-b1c2-9dc2cea42dcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bc3c2f021704a71b50ee2524f6ccaa7, user_id=c5f84459aacb4d36a409a74eea857c64, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:12.697695 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9cd725-1385-475e-b1c2-9dc2cea42dcf admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:12.697957 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1027/2065] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:55:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:55:12.715957 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1039/2066] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:55:12 2022] PUT /identity/v3/projects/4bc3c2f021704a71b50ee2524f6ccaa7/users/c5f84459aacb4d36a409a74eea857c64/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:55:12.731839 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cf4c7-62e0-42ac-a747-960822786905 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:12.732323 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cf4c7-62e0-42ac-a747-960822786905 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:12.732800 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cf4c7-62e0-42ac-a747-960822786905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:12.788859 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-f06cf4c7-62e0-42ac-a747-960822786905 None None] MFA Rules not processed for user `c5f84459aacb4d36a409a74eea857c64`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:12.793553 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-f06cf4c7-62e0-42ac-a747-960822786905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:12.906710 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1028/2067] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:55:12.911784 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9cd725-1385-475e-b1c2-9dc2cea42dcf admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:13.031938 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9cd725-1385-475e-b1c2-9dc2cea42dcf admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:13.038145 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c75cf-f26f-4500-865c-5cbcba579dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:13.038902 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c75cf-f26f-4500-865c-5cbcba579dfb admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:13.039236 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c75cf-f26f-4500-865c-5cbcba579dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:13.039570 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c75cf-f26f-4500-865c-5cbcba579dfb admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:13.040467 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c75cf-f26f-4500-865c-5cbcba579dfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:13.043108 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c75cf-f26f-4500-865c-5cbcba579dfb admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:13.079339 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1040/2068] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:55:12 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:55:13.083439 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06cf4c7-62e0-42ac-a747-960822786905 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:13.103438 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06cf4c7-62e0-42ac-a747-960822786905 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:13.207165 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ba523-5e05-4ba8-b033-ff5c32d854d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:13.208365 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ba523-5e05-4ba8-b033-ff5c32d854d8 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:13.208854 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ba523-5e05-4ba8-b033-ff5c32d854d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:13.209339 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ba523-5e05-4ba8-b033-ff5c32d854d8 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:13.210689 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ba523-5e05-4ba8-b033-ff5c32d854d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:13.214593 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ba523-5e05-4ba8-b033-ff5c32d854d8 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:13.253032 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1029/2069] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:55:13 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:55:13.257433 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c75cf-f26f-4500-865c-5cbcba579dfb admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:13.275414 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c75cf-f26f-4500-865c-5cbcba579dfb admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:13.287856 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1c815-502d-44b2-8f39-748e4ea66789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:13.290297 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1c815-502d-44b2-8f39-748e4ea66789 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:13.290887 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1c815-502d-44b2-8f39-748e4ea66789 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:13.291329 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1c815-502d-44b2-8f39-748e4ea66789 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:13.295385 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1c815-502d-44b2-8f39-748e4ea66789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:13.299569 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1c815-502d-44b2-8f39-748e4ea66789 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:13.361914 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1041/2070] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:55:13.363194 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ba523-5e05-4ba8-b033-ff5c32d854d8 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:13.375274 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ba523-5e05-4ba8-b033-ff5c32d854d8 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:13.380856 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4602eb6-c8ac-4ea4-a0cf-cfb4a022ff9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:13.381542 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4602eb6-c8ac-4ea4-a0cf-cfb4a022ff9b admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:13.381839 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4602eb6-c8ac-4ea4-a0cf-cfb4a022ff9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:13.382087 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4602eb6-c8ac-4ea4-a0cf-cfb4a022ff9b admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:13.383011 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4602eb6-c8ac-4ea4-a0cf-cfb4a022ff9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:13.384666 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4602eb6-c8ac-4ea4-a0cf-cfb4a022ff9b admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:13.410525 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1030/2071] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:55:13.414738 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1c815-502d-44b2-8f39-748e4ea66789 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:13.426470 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1c815-502d-44b2-8f39-748e4ea66789 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:13.431973 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c36a06-565a-4b8d-b661-d2324ed4e7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:13.433167 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c36a06-565a-4b8d-b661-d2324ed4e7ff admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:13.433453 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c36a06-565a-4b8d-b661-d2324ed4e7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:13.433732 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c36a06-565a-4b8d-b661-d2324ed4e7ff admin admin] PATH_INFO: `/v3/projects/82f9abe631224a8c8fa9abeaadbf9fdc/users/fbd72d8eb0af47838333b3ccb535003d/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:13.462986 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c36a06-565a-4b8d-b661-d2324ed4e7ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=82f9abe631224a8c8fa9abeaadbf9fdc, user_id=fbd72d8eb0af47838333b3ccb535003d, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:13.467146 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c36a06-565a-4b8d-b661-d2324ed4e7ff admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:13.492444 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1042/2072] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:55:13 2022] PUT /identity/v3/projects/82f9abe631224a8c8fa9abeaadbf9fdc/users/fbd72d8eb0af47838333b3ccb535003d/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:13.510149 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c893d-d35f-4738-b996-b14eec39ba85 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:13.510562 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c893d-d35f-4738-b996-b14eec39ba85 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:13.511028 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c893d-d35f-4738-b996-b14eec39ba85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:13.553432 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-374c893d-d35f-4738-b996-b14eec39ba85 None None] MFA Rules not processed for user `fbd72d8eb0af47838333b3ccb535003d`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:13.555980 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-374c893d-d35f-4738-b996-b14eec39ba85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:13.692011 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1031/2073] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:55:13.692155 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c36a06-565a-4b8d-b661-d2324ed4e7ff admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:13.820017 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c36a06-565a-4b8d-b661-d2324ed4e7ff admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:13.841084 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae8178-aba3-471e-8cb1-e31cb280a818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:13.841775 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae8178-aba3-471e-8cb1-e31cb280a818 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:13.842239 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae8178-aba3-471e-8cb1-e31cb280a818 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:13.842697 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae8178-aba3-471e-8cb1-e31cb280a818 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:13.844097 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae8178-aba3-471e-8cb1-e31cb280a818 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:13.846230 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae8178-aba3-471e-8cb1-e31cb280a818 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:13.914556 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1043/2074] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:55:13 2022] POST /identity/v3/projects => generated 387 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:55:13.919505 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c893d-d35f-4738-b996-b14eec39ba85 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:13.944592 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c893d-d35f-4738-b996-b14eec39ba85 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:14.040677 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2bf8fa-0c05-483e-9b29-3f1c84414be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:14.042229 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bf8fa-0c05-483e-9b29-3f1c84414be3 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:14.042939 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bf8fa-0c05-483e-9b29-3f1c84414be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:14.043637 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bf8fa-0c05-483e-9b29-3f1c84414be3 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:14.045667 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2bf8fa-0c05-483e-9b29-3f1c84414be3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:14.049525 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2bf8fa-0c05-483e-9b29-3f1c84414be3 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:14.091662 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1032/2075] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:55:13 2022] POST /identity/v3/users => generated 300 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:55:14.097198 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae8178-aba3-471e-8cb1-e31cb280a818 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:14.121517 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae8178-aba3-471e-8cb1-e31cb280a818 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:14.148231 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a44cd-1e14-4493-a0ea-07df98eee6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:14.149930 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a44cd-1e14-4493-a0ea-07df98eee6c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:14.150728 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a44cd-1e14-4493-a0ea-07df98eee6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:14.152736 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a44cd-1e14-4493-a0ea-07df98eee6c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:14.156734 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a44cd-1e14-4493-a0ea-07df98eee6c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:14.160760 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a44cd-1e14-4493-a0ea-07df98eee6c8 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:14.194958 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1044/2076] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:55:14.196368 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2bf8fa-0c05-483e-9b29-3f1c84414be3 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:14.214395 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2bf8fa-0c05-483e-9b29-3f1c84414be3 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:14.226548 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77357b26-9ebd-4a58-bb93-37ebfb6ae5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:14.227390 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77357b26-9ebd-4a58-bb93-37ebfb6ae5fe admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:14.227670 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77357b26-9ebd-4a58-bb93-37ebfb6ae5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:14.228980 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77357b26-9ebd-4a58-bb93-37ebfb6ae5fe admin admin] PATH_INFO: `/v3/projects/84427b72e221416cb887a50f7f4adf6e/users/24188deb53794bcfa8edf8f61f27c2e6/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:14.270510 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77357b26-9ebd-4a58-bb93-37ebfb6ae5fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=84427b72e221416cb887a50f7f4adf6e, user_id=24188deb53794bcfa8edf8f61f27c2e6, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:14.274002 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77357b26-9ebd-4a58-bb93-37ebfb6ae5fe admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:14.330150 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1033/2077] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:55:14 2022] PUT /identity/v3/projects/84427b72e221416cb887a50f7f4adf6e/users/24188deb53794bcfa8edf8f61f27c2e6/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:55:14.334186 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a44cd-1e14-4493-a0ea-07df98eee6c8 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:14.350070 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a44cd-1e14-4493-a0ea-07df98eee6c8 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:14.464225 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e6d96-fbb3-4b97-9a29-9aeba6a54f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:14.465015 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e6d96-fbb3-4b97-9a29-9aeba6a54f08 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:14.465948 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e6d96-fbb3-4b97-9a29-9aeba6a54f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:14.466394 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e6d96-fbb3-4b97-9a29-9aeba6a54f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:14.467510 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e6d96-fbb3-4b97-9a29-9aeba6a54f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:14.470522 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e6d96-fbb3-4b97-9a29-9aeba6a54f08 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:14.486012 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1045/2078] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:55:14.489625 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77357b26-9ebd-4a58-bb93-37ebfb6ae5fe admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:14.509860 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77357b26-9ebd-4a58-bb93-37ebfb6ae5fe admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:14.518704 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c9dc5-8447-42ad-b707-a06a011e37b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:14.520443 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c9dc5-8447-42ad-b707-a06a011e37b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:14.520949 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c9dc5-8447-42ad-b707-a06a011e37b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:14.521500 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c9dc5-8447-42ad-b707-a06a011e37b8 admin admin] PATH_INFO: `/v3/projects/84427b72e221416cb887a50f7f4adf6e/users/24188deb53794bcfa8edf8f61f27c2e6/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:14.525604 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c9dc5-8447-42ad-b707-a06a011e37b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84427b72e221416cb887a50f7f4adf6e, user_id=24188deb53794bcfa8edf8f61f27c2e6, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:14.530747 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c9dc5-8447-42ad-b707-a06a011e37b8 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:14.550294 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1034/2079] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:55:14 2022] PUT /identity/v3/projects/84427b72e221416cb887a50f7f4adf6e/users/24188deb53794bcfa8edf8f61f27c2e6/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:14.561098 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34e286-f482-4776-97f9-7e3fb49856b1 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:14.561368 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34e286-f482-4776-97f9-7e3fb49856b1 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:14.561668 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34e286-f482-4776-97f9-7e3fb49856b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:14.594174 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-1d34e286-f482-4776-97f9-7e3fb49856b1 None None] MFA Rules not processed for user `24188deb53794bcfa8edf8f61f27c2e6`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:14.595513 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-1d34e286-f482-4776-97f9-7e3fb49856b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:14.704680 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1046/2080] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:55:14.718936 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c9dc5-8447-42ad-b707-a06a011e37b8 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:14.721924 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-558c9dc5-8447-42ad-b707-a06a011e37b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:14.883381 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c9dc5-8447-42ad-b707-a06a011e37b8 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:14.890255 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5667051-14b1-4bf6-84f3-c20659bc0f96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:14.891408 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5667051-14b1-4bf6-84f3-c20659bc0f96 service cinder] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:14.891953 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5667051-14b1-4bf6-84f3-c20659bc0f96 service cinder] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:14.892452 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5667051-14b1-4bf6-84f3-c20659bc0f96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:14.912757 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5667051-14b1-4bf6-84f3-c20659bc0f96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:14.915470 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5667051-14b1-4bf6-84f3-c20659bc0f96 service cinder] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:14.935840 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1035/2081] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:55:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:55:16.107668 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34e286-f482-4776-97f9-7e3fb49856b1 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:16.120046 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34e286-f482-4776-97f9-7e3fb49856b1 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:16.125305 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb19c8f8-0fec-4b60-b6ab-b80c2b556799 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:16.126368 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19c8f8-0fec-4b60-b6ab-b80c2b556799 service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:16.126733 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19c8f8-0fec-4b60-b6ab-b80c2b556799 service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:16.126989 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19c8f8-0fec-4b60-b6ab-b80c2b556799 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:16.228817 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb19c8f8-0fec-4b60-b6ab-b80c2b556799 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:16.230335 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb19c8f8-0fec-4b60-b6ab-b80c2b556799 service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:16.264017 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1047/2082] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:55:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:55:19.294774 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855421d3-5c97-40d1-825b-fa8bffcb429a None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:19.296764 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855421d3-5c97-40d1-825b-fa8bffcb429a None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:19.297515 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855421d3-5c97-40d1-825b-fa8bffcb429a None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:19.301183 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1036/2083] 10.222.0.49 () {54 vars in 921 bytes} [Fri Oct 28 20:55:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:55:19.309574 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a04c15-1305-4fd2-8433-e8cbb2155dcf None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:19.310150 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a04c15-1305-4fd2-8433-e8cbb2155dcf None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:19.310259 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a04c15-1305-4fd2-8433-e8cbb2155dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:19.408596 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-a2a04c15-1305-4fd2-8433-e8cbb2155dcf None None] MFA Rules not processed for user `938634e835b94a75af698aef6941958f`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:19.413660 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-a2a04c15-1305-4fd2-8433-e8cbb2155dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:19.712595 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1048/2084] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Oct 28 20:55:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:55:19.804668 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855421d3-5c97-40d1-825b-fa8bffcb429a None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:19.810882 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-855421d3-5c97-40d1-825b-fa8bffcb429a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:19.949504 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855421d3-5c97-40d1-825b-fa8bffcb429a None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:19.980735 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ec13f-f247-449d-b3bc-d2223d2db9fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '938634e835b94a75af698aef6941958f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:19.982963 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ec13f-f247-449d-b3bc-d2223d2db9fd service placement] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:19.983765 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ec13f-f247-449d-b3bc-d2223d2db9fd service placement] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:19.986546 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ec13f-f247-449d-b3bc-d2223d2db9fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:20.064187 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ec13f-f247-449d-b3bc-d2223d2db9fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:20.070202 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ec13f-f247-449d-b3bc-d2223d2db9fd service placement] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:20.108158 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1037/2085] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:55:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:55:20.675974 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13d17b-df2d-452b-a443-52a7b81edcfc None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:20.676604 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13d17b-df2d-452b-a443-52a7b81edcfc None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:20.676604 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13d17b-df2d-452b-a443-52a7b81edcfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:20.712257 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-dd13d17b-df2d-452b-a443-52a7b81edcfc None None] MFA Rules not processed for user `f4f5265b9b47425fb6e57f2448209927`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:20.713692 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-dd13d17b-df2d-452b-a443-52a7b81edcfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:20.812619 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1049/2086] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:55:20.817413 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ec13f-f247-449d-b3bc-d2223d2db9fd service placement] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:20.909250 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ec13f-f247-449d-b3bc-d2223d2db9fd service placement] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:20.920717 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb99603-9745-40b2-9a81-b8bf0e607c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:20.922451 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb99603-9745-40b2-9a81-b8bf0e607c79 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:20.922794 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb99603-9745-40b2-9a81-b8bf0e607c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:20.923076 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb99603-9745-40b2-9a81-b8bf0e607c79 admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:20.925271 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb99603-9745-40b2-9a81-b8bf0e607c79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:20.927939 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb99603-9745-40b2-9a81-b8bf0e607c79 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:20.969584 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1038/2087] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:55:20 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:55:20.974385 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13d17b-df2d-452b-a443-52a7b81edcfc None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:21.007239 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13d17b-df2d-452b-a443-52a7b81edcfc None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:21.052801 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb99603-9745-40b2-9a81-b8bf0e607c79 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:21.054797 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-bdb99603-9745-40b2-9a81-b8bf0e607c79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:21.114830 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8269476-fb62-4d07-af2d-f8460cf2ba1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:21.115561 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8269476-fb62-4d07-af2d-f8460cf2ba1a admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:21.115880 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8269476-fb62-4d07-af2d-f8460cf2ba1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:21.116404 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8269476-fb62-4d07-af2d-f8460cf2ba1a admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:21.117321 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8269476-fb62-4d07-af2d-f8460cf2ba1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:21.119386 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8269476-fb62-4d07-af2d-f8460cf2ba1a admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:21.145794 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1050/2088] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:55:20 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:55:21.151477 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8269476-fb62-4d07-af2d-f8460cf2ba1a admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:21.163845 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8269476-fb62-4d07-af2d-f8460cf2ba1a admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:21.169558 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb99603-9745-40b2-9a81-b8bf0e607c79 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:21.170026 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf80f4-7213-4cf1-bd5c-f7ee0cfaabe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:21.170708 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf80f4-7213-4cf1-bd5c-f7ee0cfaabe1 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:21.171036 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf80f4-7213-4cf1-bd5c-f7ee0cfaabe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:21.172032 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf80f4-7213-4cf1-bd5c-f7ee0cfaabe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:21.173907 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf80f4-7213-4cf1-bd5c-f7ee0cfaabe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:21.175654 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf80f4-7213-4cf1-bd5c-f7ee0cfaabe1 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:21.180896 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d467c4-0857-44bc-b170-c1764869476f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:21.182342 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d467c4-0857-44bc-b170-c1764869476f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:21.182806 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d467c4-0857-44bc-b170-c1764869476f admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:21.183291 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d467c4-0857-44bc-b170-c1764869476f admin admin] PATH_INFO: `/v3/users/81d0863e38c14abf8de01799923ffe39` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:21.185965 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d467c4-0857-44bc-b170-c1764869476f admin admin] RBAC: Authorizing `identity:delete_user(user_id=81d0863e38c14abf8de01799923ffe39)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:21.189663 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1051/2089] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:55:21.192732 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d467c4-0857-44bc-b170-c1764869476f admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:21.196125 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf80f4-7213-4cf1-bd5c-f7ee0cfaabe1 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:21.210885 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf80f4-7213-4cf1-bd5c-f7ee0cfaabe1 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:21.217379 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6c550-28da-4226-9dbd-f9f962d59d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:21.219194 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6c550-28da-4226-9dbd-f9f962d59d0c admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:21.219638 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6c550-28da-4226-9dbd-f9f962d59d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:21.220009 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6c550-28da-4226-9dbd-f9f962d59d0c admin admin] PATH_INFO: `/v3/projects/c22913a3602f4ae3a2cd3425a87aa345/users/62f1caee714d494c95c0f6c76ab510d3/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:21.247912 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6c550-28da-4226-9dbd-f9f962d59d0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c22913a3602f4ae3a2cd3425a87aa345, user_id=62f1caee714d494c95c0f6c76ab510d3, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:21.253775 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6c550-28da-4226-9dbd-f9f962d59d0c admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:21.293875 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-49d467c4-0857-44bc-b170-c1764869476f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81d0863e38c14abf8de01799923ffe39'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:21.311849 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1052/2090] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:55:21 2022] PUT /identity/v3/projects/c22913a3602f4ae3a2cd3425a87aa345/users/62f1caee714d494c95c0f6c76ab510d3/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:21.312674 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-49d467c4-0857-44bc-b170-c1764869476f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81d0863e38c14abf8de01799923ffe39'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:21.312674 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-49d467c4-0857-44bc-b170-c1764869476f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81d0863e38c14abf8de01799923ffe39'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:21.321727 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6c550-28da-4226-9dbd-f9f962d59d0c admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:21.326296 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-49d467c4-0857-44bc-b170-c1764869476f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81d0863e38c14abf8de01799923ffe39'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:21.327042 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-49d467c4-0857-44bc-b170-c1764869476f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81d0863e38c14abf8de01799923ffe39'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:21.337126 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-27e6c550-28da-4226-9dbd-f9f962d59d0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:21.376841 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1039/2091] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:55:21 2022] DELETE /identity/v3/users/81d0863e38c14abf8de01799923ffe39 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:55:21.494770 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6c550-28da-4226-9dbd-f9f962d59d0c admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:21.593520 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d467c4-0857-44bc-b170-c1764869476f admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:21.596689 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-49d467c4-0857-44bc-b170-c1764869476f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:21.597476 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54993307-1033-4ed6-83f8-6b9928260475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:21.598616 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54993307-1033-4ed6-83f8-6b9928260475 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:21.599286 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54993307-1033-4ed6-83f8-6b9928260475 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:21.599724 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54993307-1033-4ed6-83f8-6b9928260475 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:21.602376 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54993307-1033-4ed6-83f8-6b9928260475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:21.605692 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54993307-1033-4ed6-83f8-6b9928260475 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:21.633658 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1053/2092] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:55:21.641866 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54993307-1033-4ed6-83f8-6b9928260475 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:21.667030 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54993307-1033-4ed6-83f8-6b9928260475 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:21.683646 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd7364-48ef-43d4-8a5b-9c9dc9524256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:21.685529 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd7364-48ef-43d4-8a5b-9c9dc9524256 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:21.686155 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd7364-48ef-43d4-8a5b-9c9dc9524256 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:21.686784 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd7364-48ef-43d4-8a5b-9c9dc9524256 admin admin] PATH_INFO: `/v3/projects/c22913a3602f4ae3a2cd3425a87aa345/users/62f1caee714d494c95c0f6c76ab510d3/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:21.691272 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd7364-48ef-43d4-8a5b-9c9dc9524256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c22913a3602f4ae3a2cd3425a87aa345, user_id=62f1caee714d494c95c0f6c76ab510d3, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:21.698722 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd7364-48ef-43d4-8a5b-9c9dc9524256 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:21.722919 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1054/2093] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:55:21 2022] PUT /identity/v3/projects/c22913a3602f4ae3a2cd3425a87aa345/users/62f1caee714d494c95c0f6c76ab510d3/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:21.722919 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd7364-48ef-43d4-8a5b-9c9dc9524256 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:21.725212 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-58cd7364-48ef-43d4-8a5b-9c9dc9524256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:21.776954 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d467c4-0857-44bc-b170-c1764869476f admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:21.872475 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924a899-dea6-460d-8e20-d7d19f200d96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:21.874273 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924a899-dea6-460d-8e20-d7d19f200d96 service cinder] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:21.874761 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924a899-dea6-460d-8e20-d7d19f200d96 service cinder] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:21.875187 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924a899-dea6-460d-8e20-d7d19f200d96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:21.877577 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-a924a899-dea6-460d-8e20-d7d19f200d96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:21.887693 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd7364-48ef-43d4-8a5b-9c9dc9524256 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:21.894335 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e654479-7843-48ab-8cc9-97d7f59b4d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:21.895285 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e654479-7843-48ab-8cc9-97d7f59b4d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:21.895615 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e654479-7843-48ab-8cc9-97d7f59b4d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:21.895886 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e654479-7843-48ab-8cc9-97d7f59b4d4c admin admin] PATH_INFO: `/v3/projects/a8e723cbd90248a99fc57b0f91499d2b` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:21.897323 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e654479-7843-48ab-8cc9-97d7f59b4d4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8e723cbd90248a99fc57b0f91499d2b)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:21.900051 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e654479-7843-48ab-8cc9-97d7f59b4d4c admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:21.972384 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-6e654479-7843-48ab-8cc9-97d7f59b4d4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8e723cbd90248a99fc57b0f91499d2b', 'request_id': 'req-6e654479-7843-48ab-8cc9-97d7f59b4d4c'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:21.984865 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924a899-dea6-460d-8e20-d7d19f200d96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:21.986422 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924a899-dea6-460d-8e20-d7d19f200d96 service cinder] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:21.992403 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-6e654479-7843-48ab-8cc9-97d7f59b4d4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8e723cbd90248a99fc57b0f91499d2b', 'request_id': 'req-6e654479-7843-48ab-8cc9-97d7f59b4d4c'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:21.997004 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1040/2094] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:55:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:55:22.005748 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-6e654479-7843-48ab-8cc9-97d7f59b4d4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8e723cbd90248a99fc57b0f91499d2b', 'request_id': 'req-6e654479-7843-48ab-8cc9-97d7f59b4d4c'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:22.037586 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-6e654479-7843-48ab-8cc9-97d7f59b4d4c admin admin] The token cache is being invalidate because project a8e723cbd90248a99fc57b0f91499d2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:55:22.039938 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-6e654479-7843-48ab-8cc9-97d7f59b4d4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:22.041175 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-6e654479-7843-48ab-8cc9-97d7f59b4d4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:22.053304 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1055/2095] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:55:21 2022] DELETE /identity/v3/projects/a8e723cbd90248a99fc57b0f91499d2b => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:22.054599 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924a899-dea6-460d-8e20-d7d19f200d96 service cinder] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:22.072338 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924a899-dea6-460d-8e20-d7d19f200d96 service cinder] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:22.185407 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbe6d8-329c-4f0a-9a5d-635736072659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:22.188303 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbe6d8-329c-4f0a-9a5d-635736072659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:22.188636 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbe6d8-329c-4f0a-9a5d-635736072659 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:22.190276 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbe6d8-329c-4f0a-9a5d-635736072659 admin admin] PATH_INFO: `/v3/users/6c34db3a90204045a68a2728b32fff77` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:22.190772 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abbe6d8-329c-4f0a-9a5d-635736072659 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c34db3a90204045a68a2728b32fff77)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:22.192977 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abbe6d8-329c-4f0a-9a5d-635736072659 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:22.341959 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-6abbe6d8-329c-4f0a-9a5d-635736072659 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c34db3a90204045a68a2728b32fff77'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:22.353679 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-6abbe6d8-329c-4f0a-9a5d-635736072659 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c34db3a90204045a68a2728b32fff77'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:22.354489 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-6abbe6d8-329c-4f0a-9a5d-635736072659 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c34db3a90204045a68a2728b32fff77'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:22.371562 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-6abbe6d8-329c-4f0a-9a5d-635736072659 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c34db3a90204045a68a2728b32fff77'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:22.371562 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-6abbe6d8-329c-4f0a-9a5d-635736072659 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c34db3a90204045a68a2728b32fff77'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:22.393243 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1041/2096] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:55:22 2022] DELETE /identity/v3/users/6c34db3a90204045a68a2728b32fff77 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:22.812319 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e654479-7843-48ab-8cc9-97d7f59b4d4c admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:22.815087 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-6e654479-7843-48ab-8cc9-97d7f59b4d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:22.888745 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e654479-7843-48ab-8cc9-97d7f59b4d4c admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:23.079633 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f42aa-78a5-40c4-89eb-a538b4b432e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:23.082012 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f42aa-78a5-40c4-89eb-a538b4b432e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:23.083108 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f42aa-78a5-40c4-89eb-a538b4b432e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:23.083894 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f42aa-78a5-40c4-89eb-a538b4b432e1 admin admin] PATH_INFO: `/v3/projects/82c149dbe8114cfdac97b6335c054af0` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:23.087257 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f42aa-78a5-40c4-89eb-a538b4b432e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82c149dbe8114cfdac97b6335c054af0)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:23.091810 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f42aa-78a5-40c4-89eb-a538b4b432e1 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:23.204918 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-9a6f42aa-78a5-40c4-89eb-a538b4b432e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82c149dbe8114cfdac97b6335c054af0', 'request_id': 'req-9a6f42aa-78a5-40c4-89eb-a538b4b432e1'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:23.226397 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-9a6f42aa-78a5-40c4-89eb-a538b4b432e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82c149dbe8114cfdac97b6335c054af0', 'request_id': 'req-9a6f42aa-78a5-40c4-89eb-a538b4b432e1'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:23.244085 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-9a6f42aa-78a5-40c4-89eb-a538b4b432e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82c149dbe8114cfdac97b6335c054af0', 'request_id': 'req-9a6f42aa-78a5-40c4-89eb-a538b4b432e1'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:23.302063 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-9a6f42aa-78a5-40c4-89eb-a538b4b432e1 admin admin] The token cache is being invalidate because project 82c149dbe8114cfdac97b6335c054af0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:55:23.307888 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-9a6f42aa-78a5-40c4-89eb-a538b4b432e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:23.310921 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-9a6f42aa-78a5-40c4-89eb-a538b4b432e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:23.318518 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1056/2097] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:55:22 2022] DELETE /identity/v3/projects/82c149dbe8114cfdac97b6335c054af0 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:23.320500 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667efcc8-00c0-4bf1-9f05-f1ad972eb173 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:23.321024 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667efcc8-00c0-4bf1-9f05-f1ad972eb173 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:23.321136 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667efcc8-00c0-4bf1-9f05-f1ad972eb173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:23.378813 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-667efcc8-00c0-4bf1-9f05-f1ad972eb173 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:23.390626 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-667efcc8-00c0-4bf1-9f05-f1ad972eb173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:23.533160 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1042/2098] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:55:23.548590 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf150f8-d08a-4359-ae70-6338aba12019 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:23.549158 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf150f8-d08a-4359-ae70-6338aba12019 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:23.549446 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf150f8-d08a-4359-ae70-6338aba12019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:23.581344 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-4bf150f8-d08a-4359-ae70-6338aba12019 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:23.583487 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-4bf150f8-d08a-4359-ae70-6338aba12019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:23.613949 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1057/2099] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:55:23.620985 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667efcc8-00c0-4bf1-9f05-f1ad972eb173 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:23.637220 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667efcc8-00c0-4bf1-9f05-f1ad972eb173 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:23.660987 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5925b-a1cc-4a10-ae5a-45891b916135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:23.661702 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5925b-a1cc-4a10-ae5a-45891b916135 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:23.662321 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5925b-a1cc-4a10-ae5a-45891b916135 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:23.662597 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5925b-a1cc-4a10-ae5a-45891b916135 admin admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:23.663548 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5925b-a1cc-4a10-ae5a-45891b916135 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:55:23.663903 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5925b-a1cc-4a10-ae5a-45891b916135 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:23.666021 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5925b-a1cc-4a10-ae5a-45891b916135 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:23.704558 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1043/2100] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:55:23.708639 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf150f8-d08a-4359-ae70-6338aba12019 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:23.733881 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf150f8-d08a-4359-ae70-6338aba12019 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:23.739390 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffeaf0b-bb3e-4fdb-a320-0d777f0ca8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:23.740214 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffeaf0b-bb3e-4fdb-a320-0d777f0ca8a3 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:23.740434 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffeaf0b-bb3e-4fdb-a320-0d777f0ca8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:23.740831 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffeaf0b-bb3e-4fdb-a320-0d777f0ca8a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:23.741554 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffeaf0b-bb3e-4fdb-a320-0d777f0ca8a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:23.743785 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffeaf0b-bb3e-4fdb-a320-0d777f0ca8a3 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:23.785987 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1058/2101] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:55:23 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:55:23.792870 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5925b-a1cc-4a10-ae5a-45891b916135 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:23.823414 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5925b-a1cc-4a10-ae5a-45891b916135 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:23.907826 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cdd1d-be09-4ae0-9812-18b6845d9fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:23.908724 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cdd1d-be09-4ae0-9812-18b6845d9fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:23.909066 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cdd1d-be09-4ae0-9812-18b6845d9fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:23.909788 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cdd1d-be09-4ae0-9812-18b6845d9fc2 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:23.910972 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827cdd1d-be09-4ae0-9812-18b6845d9fc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:23.914013 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827cdd1d-be09-4ae0-9812-18b6845d9fc2 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:23.954147 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1044/2102] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:55:23 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:55:23.961016 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffeaf0b-bb3e-4fdb-a320-0d777f0ca8a3 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:23.973389 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffeaf0b-bb3e-4fdb-a320-0d777f0ca8a3 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:23.984261 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78362be5-d5c6-4493-81cb-ec6f22b40901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:23.985508 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78362be5-d5c6-4493-81cb-ec6f22b40901 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:23.986027 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78362be5-d5c6-4493-81cb-ec6f22b40901 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:23.986814 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78362be5-d5c6-4493-81cb-ec6f22b40901 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:23.990564 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78362be5-d5c6-4493-81cb-ec6f22b40901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:23.995703 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78362be5-d5c6-4493-81cb-ec6f22b40901 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:24.030080 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1059/2103] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:55:24.031444 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cdd1d-be09-4ae0-9812-18b6845d9fc2 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:24.045205 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cdd1d-be09-4ae0-9812-18b6845d9fc2 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:24.052804 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24cc7a-5a80-41f8-be12-368d23909bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:24.053791 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24cc7a-5a80-41f8-be12-368d23909bca admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:24.054825 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24cc7a-5a80-41f8-be12-368d23909bca admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:24.055330 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24cc7a-5a80-41f8-be12-368d23909bca admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:24.056408 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24cc7a-5a80-41f8-be12-368d23909bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:24.058344 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24cc7a-5a80-41f8-be12-368d23909bca admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:24.073762 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1045/2104] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:55:24.085264 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78362be5-d5c6-4493-81cb-ec6f22b40901 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:24.113738 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78362be5-d5c6-4493-81cb-ec6f22b40901 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:24.131384 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59395c3-3928-461d-b85f-0c7cb2952adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:24.133511 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59395c3-3928-461d-b85f-0c7cb2952adc admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:24.134290 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59395c3-3928-461d-b85f-0c7cb2952adc admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:24.135016 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59395c3-3928-461d-b85f-0c7cb2952adc admin admin] PATH_INFO: `/v3/projects/add910c9648d4accba287620ef72c06f/users/01b9673556844d688eaf38803269d4c0/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:24.195781 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59395c3-3928-461d-b85f-0c7cb2952adc admin admin] RBAC: Authorizing `identity:create_grant(project_id=add910c9648d4accba287620ef72c06f, user_id=01b9673556844d688eaf38803269d4c0, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:24.198766 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59395c3-3928-461d-b85f-0c7cb2952adc admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:24.238113 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1060/2105] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:55:24 2022] PUT /identity/v3/projects/add910c9648d4accba287620ef72c06f/users/01b9673556844d688eaf38803269d4c0/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:24.257580 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81091198-0786-4609-91d2-6ce3ff465d28 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:24.257782 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81091198-0786-4609-91d2-6ce3ff465d28 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:24.258081 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81091198-0786-4609-91d2-6ce3ff465d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:24.314795 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-81091198-0786-4609-91d2-6ce3ff465d28 None None] MFA Rules not processed for user `01b9673556844d688eaf38803269d4c0`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:24.316465 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-81091198-0786-4609-91d2-6ce3ff465d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:24.442825 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1046/2106] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:55:24.447404 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59395c3-3928-461d-b85f-0c7cb2952adc admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:24.560835 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59395c3-3928-461d-b85f-0c7cb2952adc admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:24.568271 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ec85c-f609-4d32-a59a-941033a57890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:24.569011 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ec85c-f609-4d32-a59a-941033a57890 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:24.569302 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ec85c-f609-4d32-a59a-941033a57890 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:24.569813 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ec85c-f609-4d32-a59a-941033a57890 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:24.570564 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ec85c-f609-4d32-a59a-941033a57890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:24.572890 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ec85c-f609-4d32-a59a-941033a57890 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:24.642386 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1061/2107] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:55:24 2022] POST /identity/v3/projects => generated 383 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:55:24.646551 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81091198-0786-4609-91d2-6ce3ff465d28 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:24.664974 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81091198-0786-4609-91d2-6ce3ff465d28 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:24.935156 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42285e2-80bb-4a91-8674-d19867b2496a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:24.935913 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42285e2-80bb-4a91-8674-d19867b2496a admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:24.936196 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42285e2-80bb-4a91-8674-d19867b2496a admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:24.942841 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42285e2-80bb-4a91-8674-d19867b2496a admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:24.944085 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42285e2-80bb-4a91-8674-d19867b2496a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:24.946338 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42285e2-80bb-4a91-8674-d19867b2496a admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:25.036027 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1047/2108] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:55:24 2022] POST /identity/v3/users => generated 298 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:55:25.041342 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ec85c-f609-4d32-a59a-941033a57890 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:25.079440 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ec85c-f609-4d32-a59a-941033a57890 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:25.091613 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856323fc-e86b-464b-bfb1-d2e5749c7f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:25.093389 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856323fc-e86b-464b-bfb1-d2e5749c7f71 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:25.094509 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856323fc-e86b-464b-bfb1-d2e5749c7f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:25.095334 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856323fc-e86b-464b-bfb1-d2e5749c7f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:25.097310 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856323fc-e86b-464b-bfb1-d2e5749c7f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:25.117599 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856323fc-e86b-464b-bfb1-d2e5749c7f71 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:25.173380 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1062/2109] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:55:25.180658 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42285e2-80bb-4a91-8674-d19867b2496a admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:25.229150 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42285e2-80bb-4a91-8674-d19867b2496a admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:25.239360 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53726b0-4cc8-4071-a0fe-48194ca57d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:25.241587 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53726b0-4cc8-4071-a0fe-48194ca57d49 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:25.242580 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53726b0-4cc8-4071-a0fe-48194ca57d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:25.243729 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53726b0-4cc8-4071-a0fe-48194ca57d49 admin admin] PATH_INFO: `/v3/projects/c3a9391cbbd144aca92630923908efb1/users/f8bcac9f8876439883181f89dc6097c9/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:25.285026 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53726b0-4cc8-4071-a0fe-48194ca57d49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3a9391cbbd144aca92630923908efb1, user_id=f8bcac9f8876439883181f89dc6097c9, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:25.290984 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53726b0-4cc8-4071-a0fe-48194ca57d49 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:25.344953 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856323fc-e86b-464b-bfb1-d2e5749c7f71 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:25.346631 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1048/2110] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:55:25 2022] PUT /identity/v3/projects/c3a9391cbbd144aca92630923908efb1/users/f8bcac9f8876439883181f89dc6097c9/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:25.357175 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856323fc-e86b-464b-bfb1-d2e5749c7f71 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:25.527499 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38dd260-b915-4c24-8b98-abf0924a4dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:25.528594 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38dd260-b915-4c24-8b98-abf0924a4dac admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:25.529144 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38dd260-b915-4c24-8b98-abf0924a4dac admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:25.529829 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38dd260-b915-4c24-8b98-abf0924a4dac admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:25.532018 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38dd260-b915-4c24-8b98-abf0924a4dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:25.534567 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38dd260-b915-4c24-8b98-abf0924a4dac admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:25.557656 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1063/2111] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:55:25.559205 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53726b0-4cc8-4071-a0fe-48194ca57d49 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:25.579143 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53726b0-4cc8-4071-a0fe-48194ca57d49 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:25.603544 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b200b-30db-4574-8685-fc188f832901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:25.604761 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b200b-30db-4574-8685-fc188f832901 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:25.605474 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b200b-30db-4574-8685-fc188f832901 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:25.606014 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b200b-30db-4574-8685-fc188f832901 admin admin] PATH_INFO: `/v3/projects/c3a9391cbbd144aca92630923908efb1/users/f8bcac9f8876439883181f89dc6097c9/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:25.610142 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b200b-30db-4574-8685-fc188f832901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3a9391cbbd144aca92630923908efb1, user_id=f8bcac9f8876439883181f89dc6097c9, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:25.623470 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b200b-30db-4574-8685-fc188f832901 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:25.682435 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1049/2112] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:55:25 2022] PUT /identity/v3/projects/c3a9391cbbd144aca92630923908efb1/users/f8bcac9f8876439883181f89dc6097c9/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:25.694415 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a58d77-1eb4-4318-a308-2f32b2763c9d None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:25.695008 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a58d77-1eb4-4318-a308-2f32b2763c9d None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:25.695433 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a58d77-1eb4-4318-a308-2f32b2763c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:25.795254 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-61a58d77-1eb4-4318-a308-2f32b2763c9d None None] MFA Rules not processed for user `f8bcac9f8876439883181f89dc6097c9`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:25.796708 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-61a58d77-1eb4-4318-a308-2f32b2763c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:25.804163 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b200b-30db-4574-8685-fc188f832901 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:25.807583 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-073b200b-30db-4574-8685-fc188f832901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:25.978321 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b200b-30db-4574-8685-fc188f832901 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:25.984959 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86107581-50c4-4419-909a-a993b45f5a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:25.986591 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86107581-50c4-4419-909a-a993b45f5a54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:25.986924 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86107581-50c4-4419-909a-a993b45f5a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:25.987543 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86107581-50c4-4419-909a-a993b45f5a54 admin admin] PATH_INFO: `/v3/users/c5f84459aacb4d36a409a74eea857c64` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:25.990332 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86107581-50c4-4419-909a-a993b45f5a54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5f84459aacb4d36a409a74eea857c64)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:25.994703 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86107581-50c4-4419-909a-a993b45f5a54 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:26.010856 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1064/2113] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:55:26.040236 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a58d77-1eb4-4318-a308-2f32b2763c9d None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:26.041859 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-61a58d77-1eb4-4318-a308-2f32b2763c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:26.119531 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-86107581-50c4-4419-909a-a993b45f5a54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5f84459aacb4d36a409a74eea857c64'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:26.131392 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-86107581-50c4-4419-909a-a993b45f5a54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5f84459aacb4d36a409a74eea857c64'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:26.132162 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-86107581-50c4-4419-909a-a993b45f5a54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5f84459aacb4d36a409a74eea857c64'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:26.165713 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-86107581-50c4-4419-909a-a993b45f5a54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5f84459aacb4d36a409a74eea857c64'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:26.168239 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-86107581-50c4-4419-909a-a993b45f5a54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5f84459aacb4d36a409a74eea857c64'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:26.170131 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a58d77-1eb4-4318-a308-2f32b2763c9d None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:26.179885 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eacf37-74dc-4e4e-a4d2-c5eef69442ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:26.180879 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eacf37-74dc-4e4e-a4d2-c5eef69442ff service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:26.181320 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eacf37-74dc-4e4e-a4d2-c5eef69442ff service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:26.181757 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eacf37-74dc-4e4e-a4d2-c5eef69442ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:26.185455 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-00eacf37-74dc-4e4e-a4d2-c5eef69442ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:26.197836 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1050/2114] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:55:25 2022] DELETE /identity/v3/users/c5f84459aacb4d36a409a74eea857c64 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:55:26.200357 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ddded3-c465-4359-956d-3964af20dea9 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:26.201300 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ddded3-c465-4359-956d-3964af20dea9 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:26.201981 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ddded3-c465-4359-956d-3964af20dea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:26.242106 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-09ddded3-c465-4359-956d-3964af20dea9 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:26.247536 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-09ddded3-c465-4359-956d-3964af20dea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:26.301255 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eacf37-74dc-4e4e-a4d2-c5eef69442ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:26.303116 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eacf37-74dc-4e4e-a4d2-c5eef69442ff service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:26.321767 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1065/2115] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:55:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:55:26.370153 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1051/2116] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:55:26.381123 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eacf37-74dc-4e4e-a4d2-c5eef69442ff service cinder] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:26.384547 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-00eacf37-74dc-4e4e-a4d2-c5eef69442ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:26.526798 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eacf37-74dc-4e4e-a4d2-c5eef69442ff service cinder] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:26.629011 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39334f-23fe-4ea3-b78e-09645742a278 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:26.630038 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39334f-23fe-4ea3-b78e-09645742a278 service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:26.630471 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39334f-23fe-4ea3-b78e-09645742a278 service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:26.630895 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39334f-23fe-4ea3-b78e-09645742a278 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:26.643381 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c39334f-23fe-4ea3-b78e-09645742a278 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:26.645468 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c39334f-23fe-4ea3-b78e-09645742a278 service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:26.665216 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1066/2117] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:55:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:55:28.000678 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ddded3-c465-4359-956d-3964af20dea9 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:28.003156 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-09ddded3-c465-4359-956d-3964af20dea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:28.032155 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ddded3-c465-4359-956d-3964af20dea9 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:28.044635 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684032f6-9f15-4871-af11-98a598920184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:28.047789 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684032f6-9f15-4871-af11-98a598920184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:28.048629 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684032f6-9f15-4871-af11-98a598920184 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:28.049404 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684032f6-9f15-4871-af11-98a598920184 admin admin] PATH_INFO: `/v3/projects/4bc3c2f021704a71b50ee2524f6ccaa7` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:28.052316 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684032f6-9f15-4871-af11-98a598920184 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bc3c2f021704a71b50ee2524f6ccaa7)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:28.057343 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684032f6-9f15-4871-af11-98a598920184 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:28.181752 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-684032f6-9f15-4871-af11-98a598920184 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bc3c2f021704a71b50ee2524f6ccaa7', 'request_id': 'req-684032f6-9f15-4871-af11-98a598920184'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:28.193740 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-684032f6-9f15-4871-af11-98a598920184 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bc3c2f021704a71b50ee2524f6ccaa7', 'request_id': 'req-684032f6-9f15-4871-af11-98a598920184'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:28.203411 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-684032f6-9f15-4871-af11-98a598920184 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bc3c2f021704a71b50ee2524f6ccaa7', 'request_id': 'req-684032f6-9f15-4871-af11-98a598920184'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:28.222716 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-684032f6-9f15-4871-af11-98a598920184 admin admin] The token cache is being invalidate because project 4bc3c2f021704a71b50ee2524f6ccaa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:55:28.223256 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-684032f6-9f15-4871-af11-98a598920184 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:28.224535 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-684032f6-9f15-4871-af11-98a598920184 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:28.227124 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1052/2118] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:55:27 2022] DELETE /identity/v3/projects/4bc3c2f021704a71b50ee2524f6ccaa7 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:28.231304 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39334f-23fe-4ea3-b78e-09645742a278 service neutron] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:28.247800 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39334f-23fe-4ea3-b78e-09645742a278 service neutron] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:28.428738 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec640294-f6c2-48f6-b37e-3327527be8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:28.430614 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec640294-f6c2-48f6-b37e-3327527be8df admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:28.431231 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec640294-f6c2-48f6-b37e-3327527be8df admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:28.431840 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec640294-f6c2-48f6-b37e-3327527be8df admin admin] PATH_INFO: `/v3/users/fbd72d8eb0af47838333b3ccb535003d` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:28.434358 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec640294-f6c2-48f6-b37e-3327527be8df admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbd72d8eb0af47838333b3ccb535003d)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:28.438614 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec640294-f6c2-48f6-b37e-3327527be8df admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:28.573118 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ec640294-f6c2-48f6-b37e-3327527be8df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbd72d8eb0af47838333b3ccb535003d'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:28.591150 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ec640294-f6c2-48f6-b37e-3327527be8df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbd72d8eb0af47838333b3ccb535003d'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:28.609674 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ec640294-f6c2-48f6-b37e-3327527be8df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbd72d8eb0af47838333b3ccb535003d'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:28.611368 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ec640294-f6c2-48f6-b37e-3327527be8df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbd72d8eb0af47838333b3ccb535003d'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:28.651926 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ec640294-f6c2-48f6-b37e-3327527be8df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbd72d8eb0af47838333b3ccb535003d'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:28.675046 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1067/2119] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:55:28 2022] DELETE /identity/v3/users/fbd72d8eb0af47838333b3ccb535003d => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:55:29.411037 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684032f6-9f15-4871-af11-98a598920184 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:29.416307 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-684032f6-9f15-4871-af11-98a598920184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:29.444617 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684032f6-9f15-4871-af11-98a598920184 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:29.627357 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c662fb-296f-4f03-a248-c1995fc8b9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:29.628914 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c662fb-296f-4f03-a248-c1995fc8b9e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:29.631367 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c662fb-296f-4f03-a248-c1995fc8b9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:29.634263 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c662fb-296f-4f03-a248-c1995fc8b9e5 admin admin] PATH_INFO: `/v3/projects/82f9abe631224a8c8fa9abeaadbf9fdc` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:29.637041 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c662fb-296f-4f03-a248-c1995fc8b9e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82f9abe631224a8c8fa9abeaadbf9fdc)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:29.641346 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c662fb-296f-4f03-a248-c1995fc8b9e5 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:29.759599 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-85c662fb-296f-4f03-a248-c1995fc8b9e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82f9abe631224a8c8fa9abeaadbf9fdc', 'request_id': 'req-85c662fb-296f-4f03-a248-c1995fc8b9e5'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:29.770535 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-85c662fb-296f-4f03-a248-c1995fc8b9e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82f9abe631224a8c8fa9abeaadbf9fdc', 'request_id': 'req-85c662fb-296f-4f03-a248-c1995fc8b9e5'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:29.785376 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-85c662fb-296f-4f03-a248-c1995fc8b9e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82f9abe631224a8c8fa9abeaadbf9fdc', 'request_id': 'req-85c662fb-296f-4f03-a248-c1995fc8b9e5'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:29.823113 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-85c662fb-296f-4f03-a248-c1995fc8b9e5 admin admin] The token cache is being invalidate because project 82f9abe631224a8c8fa9abeaadbf9fdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:55:29.823409 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-85c662fb-296f-4f03-a248-c1995fc8b9e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:29.826648 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-85c662fb-296f-4f03-a248-c1995fc8b9e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:29.830758 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1053/2120] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:55:29 2022] DELETE /identity/v3/projects/82f9abe631224a8c8fa9abeaadbf9fdc => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:29.834809 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec640294-f6c2-48f6-b37e-3327527be8df admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:29.837273 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-ec640294-f6c2-48f6-b37e-3327527be8df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:29.858950 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec640294-f6c2-48f6-b37e-3327527be8df admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:30.049638 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677cab2-72bf-466a-8ed4-26535723c8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:30.054486 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677cab2-72bf-466a-8ed4-26535723c8f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:30.055051 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677cab2-72bf-466a-8ed4-26535723c8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:30.055536 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677cab2-72bf-466a-8ed4-26535723c8f8 admin admin] PATH_INFO: `/v3/users/24188deb53794bcfa8edf8f61f27c2e6` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:30.059639 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677cab2-72bf-466a-8ed4-26535723c8f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24188deb53794bcfa8edf8f61f27c2e6)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:30.064153 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677cab2-72bf-466a-8ed4-26535723c8f8 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:30.147596 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-d677cab2-72bf-466a-8ed4-26535723c8f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24188deb53794bcfa8edf8f61f27c2e6'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:30.161533 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-d677cab2-72bf-466a-8ed4-26535723c8f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24188deb53794bcfa8edf8f61f27c2e6'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:30.187771 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-d677cab2-72bf-466a-8ed4-26535723c8f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24188deb53794bcfa8edf8f61f27c2e6'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:30.189294 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-d677cab2-72bf-466a-8ed4-26535723c8f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24188deb53794bcfa8edf8f61f27c2e6'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:30.237570 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-d677cab2-72bf-466a-8ed4-26535723c8f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24188deb53794bcfa8edf8f61f27c2e6'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:30.245130 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1068/2121] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:55:29 2022] DELETE /identity/v3/users/24188deb53794bcfa8edf8f61f27c2e6 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:55:30.946387 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c662fb-296f-4f03-a248-c1995fc8b9e5 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:30.947977 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-85c662fb-296f-4f03-a248-c1995fc8b9e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:30.984095 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c662fb-296f-4f03-a248-c1995fc8b9e5 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:31.073453 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b2f1b-30ee-45df-982d-52cd646d2a6c None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:31.075157 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b2f1b-30ee-45df-982d-52cd646d2a6c None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:31.075822 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b2f1b-30ee-45df-982d-52cd646d2a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:31.117949 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b3dda-7900-4af3-8c21-501d6c969f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:31.119167 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b3dda-7900-4af3-8c21-501d6c969f1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:31.119453 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b3dda-7900-4af3-8c21-501d6c969f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:31.119802 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b3dda-7900-4af3-8c21-501d6c969f1f admin admin] PATH_INFO: `/v3/projects/84427b72e221416cb887a50f7f4adf6e` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:31.121819 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-af4b2f1b-30ee-45df-982d-52cd646d2a6c None None] MFA Rules not processed for user `62f1caee714d494c95c0f6c76ab510d3`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:31.122745 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b3dda-7900-4af3-8c21-501d6c969f1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=84427b72e221416cb887a50f7f4adf6e)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:31.123372 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-af4b2f1b-30ee-45df-982d-52cd646d2a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:31.127495 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b3dda-7900-4af3-8c21-501d6c969f1f admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:31.215252 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0d8b3dda-7900-4af3-8c21-501d6c969f1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84427b72e221416cb887a50f7f4adf6e', 'request_id': 'req-0d8b3dda-7900-4af3-8c21-501d6c969f1f'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:31.227485 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0d8b3dda-7900-4af3-8c21-501d6c969f1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84427b72e221416cb887a50f7f4adf6e', 'request_id': 'req-0d8b3dda-7900-4af3-8c21-501d6c969f1f'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:31.236201 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0d8b3dda-7900-4af3-8c21-501d6c969f1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84427b72e221416cb887a50f7f4adf6e', 'request_id': 'req-0d8b3dda-7900-4af3-8c21-501d6c969f1f'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:31.239136 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1069/2122] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:55:31.260645 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0d8b3dda-7900-4af3-8c21-501d6c969f1f admin admin] The token cache is being invalidate because project 84427b72e221416cb887a50f7f4adf6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:55:31.260939 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0d8b3dda-7900-4af3-8c21-501d6c969f1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:31.261220 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b2f1b-30ee-45df-982d-52cd646d2a6c None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:31.261734 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0d8b3dda-7900-4af3-8c21-501d6c969f1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:31.263649 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-af4b2f1b-30ee-45df-982d-52cd646d2a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:31.268158 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1054/2123] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:55:30 2022] DELETE /identity/v3/projects/84427b72e221416cb887a50f7f4adf6e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:31.270738 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eec912-7b2c-4bb1-ab6c-a5b80dcd4100 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:31.271341 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eec912-7b2c-4bb1-ab6c-a5b80dcd4100 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:31.272083 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eec912-7b2c-4bb1-ab6c-a5b80dcd4100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:31.337931 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-f4eec912-7b2c-4bb1-ab6c-a5b80dcd4100 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:31.339943 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-f4eec912-7b2c-4bb1-ab6c-a5b80dcd4100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:31.471131 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1055/2124] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:55:31.479928 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b529b7-6646-4a63-99c6-323d1670a7bb None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:31.480558 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b529b7-6646-4a63-99c6-323d1670a7bb None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:31.480984 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b529b7-6646-4a63-99c6-323d1670a7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:31.538693 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-17b529b7-6646-4a63-99c6-323d1670a7bb None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:31.540409 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-17b529b7-6646-4a63-99c6-323d1670a7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:31.549309 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b2f1b-30ee-45df-982d-52cd646d2a6c None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:31.567037 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1056/2125] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:55:31.571042 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b529b7-6646-4a63-99c6-323d1670a7bb None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:31.594741 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b529b7-6646-4a63-99c6-323d1670a7bb None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:31.601947 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b3dd3-ee8d-41d7-9da1-d525c8af1f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:31.603024 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b3dd3-ee8d-41d7-9da1-d525c8af1f82 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:31.603321 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b3dd3-ee8d-41d7-9da1-d525c8af1f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:31.604251 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b3dd3-ee8d-41d7-9da1-d525c8af1f82 admin admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:31.605532 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b3dd3-ee8d-41d7-9da1-d525c8af1f82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:55:31.605785 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b3dd3-ee8d-41d7-9da1-d525c8af1f82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:31.610311 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b3dd3-ee8d-41d7-9da1-d525c8af1f82 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:31.647592 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1057/2126] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:55:31.656588 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b3dd3-ee8d-41d7-9da1-d525c8af1f82 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:31.690618 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b3dd3-ee8d-41d7-9da1-d525c8af1f82 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:31.690913 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dde78-7c8d-46fa-9639-b96befc82e06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:31.691583 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dde78-7c8d-46fa-9639-b96befc82e06 service nova] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:31.692082 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dde78-7c8d-46fa-9639-b96befc82e06 service nova] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:31.692710 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dde78-7c8d-46fa-9639-b96befc82e06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:31.695063 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-343dde78-7c8d-46fa-9639-b96befc82e06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:31.704358 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ccd3c3-a2d1-4e3e-bf58-b471bea5f83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:31.705753 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccd3c3-a2d1-4e3e-bf58-b471bea5f83e admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:31.706240 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccd3c3-a2d1-4e3e-bf58-b471bea5f83e admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:31.706774 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccd3c3-a2d1-4e3e-bf58-b471bea5f83e admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:31.707650 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ccd3c3-a2d1-4e3e-bf58-b471bea5f83e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:31.709667 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ccd3c3-a2d1-4e3e-bf58-b471bea5f83e admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:31.813075 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1058/2127] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:55:31 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:55:31.823359 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ccd3c3-a2d1-4e3e-bf58-b471bea5f83e admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:31.872846 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343dde78-7c8d-46fa-9639-b96befc82e06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:31.876641 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343dde78-7c8d-46fa-9639-b96befc82e06 service nova] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:31.901410 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1070/2128] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:55:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:55:31.953218 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ccd3c3-a2d1-4e3e-bf58-b471bea5f83e admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:31.967084 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2da72c-4e56-48fe-892e-3ea6dbde4b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:31.967990 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2da72c-4e56-48fe-892e-3ea6dbde4b47 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:31.968349 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2da72c-4e56-48fe-892e-3ea6dbde4b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:31.968810 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2da72c-4e56-48fe-892e-3ea6dbde4b47 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:31.969889 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2da72c-4e56-48fe-892e-3ea6dbde4b47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:31.978115 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2da72c-4e56-48fe-892e-3ea6dbde4b47 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:32.023707 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1059/2129] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:55:31 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:55:32.028447 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dde78-7c8d-46fa-9639-b96befc82e06 service nova] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:32.055987 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dde78-7c8d-46fa-9639-b96befc82e06 service nova] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:32.057803 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a3f9c-9e5c-4b08-b8e5-abf776d68b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:32.058580 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a3f9c-9e5c-4b08-b8e5-abf776d68b69 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:32.058860 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a3f9c-9e5c-4b08-b8e5-abf776d68b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:32.059177 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a3f9c-9e5c-4b08-b8e5-abf776d68b69 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:32.059952 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a3f9c-9e5c-4b08-b8e5-abf776d68b69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:32.063235 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a3f9c-9e5c-4b08-b8e5-abf776d68b69 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:32.088350 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1071/2130] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:55:32.094113 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2da72c-4e56-48fe-892e-3ea6dbde4b47 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:32.119717 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2da72c-4e56-48fe-892e-3ea6dbde4b47 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:32.142612 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64634c-574a-49e2-8ed6-e096f47fa9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:32.143295 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64634c-574a-49e2-8ed6-e096f47fa9dd admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:32.143573 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64634c-574a-49e2-8ed6-e096f47fa9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:32.143871 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64634c-574a-49e2-8ed6-e096f47fa9dd admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:32.144610 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e64634c-574a-49e2-8ed6-e096f47fa9dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:32.146222 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e64634c-574a-49e2-8ed6-e096f47fa9dd admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:32.210547 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1060/2131] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:55:32.217157 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a3f9c-9e5c-4b08-b8e5-abf776d68b69 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:32.228516 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64634c-574a-49e2-8ed6-e096f47fa9dd admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:32.232541 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-1e64634c-574a-49e2-8ed6-e096f47fa9dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:32.276462 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a3f9c-9e5c-4b08-b8e5-abf776d68b69 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:32.296558 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de739d82-c59d-479f-b1b7-2f759d0547fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:32.298936 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de739d82-c59d-479f-b1b7-2f759d0547fa admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:32.298936 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de739d82-c59d-479f-b1b7-2f759d0547fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:32.298936 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de739d82-c59d-479f-b1b7-2f759d0547fa admin admin] PATH_INFO: `/v3/projects/59af2e5ed1914affbbc7e86985e9102c/users/eba377274fcd43cf83722a1cc37dfe48/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:32.328879 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de739d82-c59d-479f-b1b7-2f759d0547fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=59af2e5ed1914affbbc7e86985e9102c, user_id=eba377274fcd43cf83722a1cc37dfe48, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:32.332246 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de739d82-c59d-479f-b1b7-2f759d0547fa admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:32.356810 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1072/2132] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:55:32 2022] PUT /identity/v3/projects/59af2e5ed1914affbbc7e86985e9102c/users/eba377274fcd43cf83722a1cc37dfe48/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:32.377267 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a82c67-d26e-4671-8ae1-800e07360d74 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:32.377697 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a82c67-d26e-4671-8ae1-800e07360d74 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:32.378913 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a82c67-d26e-4671-8ae1-800e07360d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:32.476221 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64634c-574a-49e2-8ed6-e096f47fa9dd admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:32.479710 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-50a82c67-d26e-4671-8ae1-800e07360d74 None None] MFA Rules not processed for user `eba377274fcd43cf83722a1cc37dfe48`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:32.481139 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-50a82c67-d26e-4671-8ae1-800e07360d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:32.596656 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c31a2-f9df-4862-a588-6ac3ef3f19ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:32.597337 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c31a2-f9df-4862-a588-6ac3ef3f19ed service cinder] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:32.597669 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c31a2-f9df-4862-a588-6ac3ef3f19ed service cinder] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:32.598430 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c31a2-f9df-4862-a588-6ac3ef3f19ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:32.600451 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-a30c31a2-f9df-4862-a588-6ac3ef3f19ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:32.657223 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1073/2133] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 28 20:55:32.664212 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a82c67-d26e-4671-8ae1-800e07360d74 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:32.705805 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c31a2-f9df-4862-a588-6ac3ef3f19ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:32.707611 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c31a2-f9df-4862-a588-6ac3ef3f19ed service cinder] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:32.729779 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1061/2134] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:55:32 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:55:32.756897 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a82c67-d26e-4671-8ae1-800e07360d74 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:32.762566 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d37829-c11b-48e1-aca9-3efe09f8c30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:32.764929 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d37829-c11b-48e1-aca9-3efe09f8c30d admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:32.764929 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d37829-c11b-48e1-aca9-3efe09f8c30d admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:32.764929 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d37829-c11b-48e1-aca9-3efe09f8c30d admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:32.765465 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d37829-c11b-48e1-aca9-3efe09f8c30d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:32.777777 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d37829-c11b-48e1-aca9-3efe09f8c30d admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:32.841670 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1074/2135] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:55:32 2022] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:55:32.847012 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c31a2-f9df-4862-a588-6ac3ef3f19ed service cinder] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:32.866662 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c31a2-f9df-4862-a588-6ac3ef3f19ed service cinder] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:32.995647 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ee9fc-2a61-4365-9623-422fa57ed643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:32.997427 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ee9fc-2a61-4365-9623-422fa57ed643 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:32.997913 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ee9fc-2a61-4365-9623-422fa57ed643 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:32.998367 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ee9fc-2a61-4365-9623-422fa57ed643 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:32.999464 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ee9fc-2a61-4365-9623-422fa57ed643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:33.002412 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ee9fc-2a61-4365-9623-422fa57ed643 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:33.034349 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1062/2136] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:55:32 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:55:33.040396 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d37829-c11b-48e1-aca9-3efe09f8c30d admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:33.094352 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d37829-c11b-48e1-aca9-3efe09f8c30d admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:33.120301 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd8d4d-c676-4f16-8f3b-5d27b58aef63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:33.122032 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd8d4d-c676-4f16-8f3b-5d27b58aef63 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:33.123010 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd8d4d-c676-4f16-8f3b-5d27b58aef63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:33.123786 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd8d4d-c676-4f16-8f3b-5d27b58aef63 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:33.125566 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd8d4d-c676-4f16-8f3b-5d27b58aef63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:33.137282 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd8d4d-c676-4f16-8f3b-5d27b58aef63 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:33.168095 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1075/2137] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:55:33.172719 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ee9fc-2a61-4365-9623-422fa57ed643 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:33.185807 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ee9fc-2a61-4365-9623-422fa57ed643 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:33.204963 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20878e-465e-41b4-b92f-aeb1cdaeabd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:33.205649 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20878e-465e-41b4-b92f-aeb1cdaeabd9 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:33.205966 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20878e-465e-41b4-b92f-aeb1cdaeabd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:33.206247 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20878e-465e-41b4-b92f-aeb1cdaeabd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:33.207020 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20878e-465e-41b4-b92f-aeb1cdaeabd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:33.208895 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20878e-465e-41b4-b92f-aeb1cdaeabd9 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:33.238809 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1063/2138] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:55:33.241786 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd8d4d-c676-4f16-8f3b-5d27b58aef63 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:33.255052 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd8d4d-c676-4f16-8f3b-5d27b58aef63 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:33.264225 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688dc19-4575-4e6d-aa81-df0edfeec85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:33.266189 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688dc19-4575-4e6d-aa81-df0edfeec85e admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:33.267268 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688dc19-4575-4e6d-aa81-df0edfeec85e admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:33.267268 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688dc19-4575-4e6d-aa81-df0edfeec85e admin admin] PATH_INFO: `/v3/projects/296ae9947eb24ad3b60840ffa6a28f3d/users/6c020f150f014b87a990e28bc6a05a9a/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:33.295280 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688dc19-4575-4e6d-aa81-df0edfeec85e admin admin] RBAC: Authorizing `identity:create_grant(project_id=296ae9947eb24ad3b60840ffa6a28f3d, user_id=6c020f150f014b87a990e28bc6a05a9a, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:33.299030 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688dc19-4575-4e6d-aa81-df0edfeec85e admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:33.341303 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1076/2139] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:55:33 2022] PUT /identity/v3/projects/296ae9947eb24ad3b60840ffa6a28f3d/users/6c020f150f014b87a990e28bc6a05a9a/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:33.343639 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f9867-1f63-4a3e-91e8-c9e902e5ead5 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:33.344156 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f9867-1f63-4a3e-91e8-c9e902e5ead5 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:33.344383 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f9867-1f63-4a3e-91e8-c9e902e5ead5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:33.390773 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-106f9867-1f63-4a3e-91e8-c9e902e5ead5 None None] MFA Rules not processed for user `6c020f150f014b87a990e28bc6a05a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:33.393047 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-106f9867-1f63-4a3e-91e8-c9e902e5ead5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:33.537443 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688dc19-4575-4e6d-aa81-df0edfeec85e admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:33.548298 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1064/2140] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:55:33.626153 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688dc19-4575-4e6d-aa81-df0edfeec85e admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:33.632067 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114524f-361f-40df-a6e1-1db73523d737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:33.632405 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114524f-361f-40df-a6e1-1db73523d737 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:33.632703 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114524f-361f-40df-a6e1-1db73523d737 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:33.633012 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114524f-361f-40df-a6e1-1db73523d737 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:33.633764 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1114524f-361f-40df-a6e1-1db73523d737 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:33.636055 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1114524f-361f-40df-a6e1-1db73523d737 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:33.695793 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1077/2141] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:55:33 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:55:33.697354 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f9867-1f63-4a3e-91e8-c9e902e5ead5 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:33.711301 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f9867-1f63-4a3e-91e8-c9e902e5ead5 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:33.794724 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e966b-fb04-434a-9cca-5e2db6365ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:33.795540 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e966b-fb04-434a-9cca-5e2db6365ee2 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:33.796510 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e966b-fb04-434a-9cca-5e2db6365ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:33.797956 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e966b-fb04-434a-9cca-5e2db6365ee2 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:33.797956 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e966b-fb04-434a-9cca-5e2db6365ee2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:33.799836 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e966b-fb04-434a-9cca-5e2db6365ee2 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:33.826917 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1065/2142] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:55:33 2022] POST /identity/v3/users => generated 298 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:55:33.830695 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114524f-361f-40df-a6e1-1db73523d737 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:33.844028 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114524f-361f-40df-a6e1-1db73523d737 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:33.850292 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17c0f0-898a-4a7c-af8d-ba6034a99b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:33.850670 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17c0f0-898a-4a7c-af8d-ba6034a99b26 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:33.850987 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17c0f0-898a-4a7c-af8d-ba6034a99b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:33.851260 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17c0f0-898a-4a7c-af8d-ba6034a99b26 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:33.852162 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c17c0f0-898a-4a7c-af8d-ba6034a99b26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:33.853916 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c17c0f0-898a-4a7c-af8d-ba6034a99b26 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:33.872169 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1078/2143] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:55:33.873676 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e966b-fb04-434a-9cca-5e2db6365ee2 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:33.886563 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e966b-fb04-434a-9cca-5e2db6365ee2 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:33.894025 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3baf1ec-63f7-43fb-b823-e7963d61b28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:33.895403 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3baf1ec-63f7-43fb-b823-e7963d61b28c admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:33.896330 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3baf1ec-63f7-43fb-b823-e7963d61b28c admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:33.896330 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3baf1ec-63f7-43fb-b823-e7963d61b28c admin admin] PATH_INFO: `/v3/projects/8b8f57f0c6ac4cb983796666fd5d4357/users/0b58b7f329d4476fbcfeaa0243474ca4/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:33.932375 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3baf1ec-63f7-43fb-b823-e7963d61b28c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b8f57f0c6ac4cb983796666fd5d4357, user_id=0b58b7f329d4476fbcfeaa0243474ca4, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:33.936590 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3baf1ec-63f7-43fb-b823-e7963d61b28c admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:33.976957 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17c0f0-898a-4a7c-af8d-ba6034a99b26 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:33.977143 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1066/2144] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:55:33 2022] PUT /identity/v3/projects/8b8f57f0c6ac4cb983796666fd5d4357/users/0b58b7f329d4476fbcfeaa0243474ca4/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:33.998902 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17c0f0-898a-4a7c-af8d-ba6034a99b26 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:34.073747 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae1813-83e1-45f1-b221-b37b48ca737c None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:34.074168 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae1813-83e1-45f1-b221-b37b48ca737c None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:34.074168 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae1813-83e1-45f1-b221-b37b48ca737c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:34.109173 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-7fae1813-83e1-45f1-b221-b37b48ca737c None None] MFA Rules not processed for user `f4f5265b9b47425fb6e57f2448209927`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:34.115362 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-7fae1813-83e1-45f1-b221-b37b48ca737c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:34.131018 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9ee58-7c0e-4b08-9ac2-9db65774b3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:34.131770 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9ee58-7c0e-4b08-9ac2-9db65774b3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:34.132061 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9ee58-7c0e-4b08-9ac2-9db65774b3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:34.133999 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9ee58-7c0e-4b08-9ac2-9db65774b3d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:34.135025 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9ee58-7c0e-4b08-9ac2-9db65774b3d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:34.136891 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9ee58-7c0e-4b08-9ac2-9db65774b3d2 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:34.160262 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1079/2145] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:55:34.165304 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9ee58-7c0e-4b08-9ac2-9db65774b3d2 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:34.182429 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9ee58-7c0e-4b08-9ac2-9db65774b3d2 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:34.189743 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022b9b3-d4a0-4b55-a43e-244149105a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:34.190998 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022b9b3-d4a0-4b55-a43e-244149105a83 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:34.191493 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022b9b3-d4a0-4b55-a43e-244149105a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:34.191964 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022b9b3-d4a0-4b55-a43e-244149105a83 admin admin] PATH_INFO: `/v3/projects/8b8f57f0c6ac4cb983796666fd5d4357/users/0b58b7f329d4476fbcfeaa0243474ca4/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:34.194464 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022b9b3-d4a0-4b55-a43e-244149105a83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b8f57f0c6ac4cb983796666fd5d4357, user_id=0b58b7f329d4476fbcfeaa0243474ca4, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:34.199267 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022b9b3-d4a0-4b55-a43e-244149105a83 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:34.211035 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1080/2146] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:55:34 2022] PUT /identity/v3/projects/8b8f57f0c6ac4cb983796666fd5d4357/users/0b58b7f329d4476fbcfeaa0243474ca4/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:55:34.229075 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdafd28-efd2-410f-95ea-4c43a69e2127 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:34.229397 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdafd28-efd2-410f-95ea-4c43a69e2127 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:34.229976 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdafd28-efd2-410f-95ea-4c43a69e2127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:34.287680 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-bbdafd28-efd2-410f-95ea-4c43a69e2127 None None] MFA Rules not processed for user `0b58b7f329d4476fbcfeaa0243474ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:34.289355 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-bbdafd28-efd2-410f-95ea-4c43a69e2127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:34.385736 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1067/2147] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:55:34.395540 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1081/2148] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:55:34.477502 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae1813-83e1-45f1-b221-b37b48ca737c None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:34.578066 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae1813-83e1-45f1-b221-b37b48ca737c None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:34.667977 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2debcd-b4e9-4e1c-a1f4-cfab75af397a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:34.669557 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2debcd-b4e9-4e1c-a1f4-cfab75af397a service cinder] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:34.671901 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2debcd-b4e9-4e1c-a1f4-cfab75af397a service cinder] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:34.671901 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2debcd-b4e9-4e1c-a1f4-cfab75af397a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:34.763066 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2debcd-b4e9-4e1c-a1f4-cfab75af397a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:34.766160 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2debcd-b4e9-4e1c-a1f4-cfab75af397a service cinder] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:34.782653 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1068/2149] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:55:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:55:36.557342 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdafd28-efd2-410f-95ea-4c43a69e2127 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:36.559381 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-bbdafd28-efd2-410f-95ea-4c43a69e2127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:36.575539 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdafd28-efd2-410f-95ea-4c43a69e2127 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:36.579524 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525738b-604a-4358-8fbd-cd0d6fcb3c57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:36.580217 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525738b-604a-4358-8fbd-cd0d6fcb3c57 service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:36.580692 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525738b-604a-4358-8fbd-cd0d6fcb3c57 service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:36.580969 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525738b-604a-4358-8fbd-cd0d6fcb3c57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:36.686402 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525738b-604a-4358-8fbd-cd0d6fcb3c57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:36.688517 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525738b-604a-4358-8fbd-cd0d6fcb3c57 service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:36.712460 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1082/2150] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:55:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:55:37.798440 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2debcd-b4e9-4e1c-a1f4-cfab75af397a service cinder] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:37.809110 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2debcd-b4e9-4e1c-a1f4-cfab75af397a service cinder] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:37.815577 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300a214-0dc1-4b0e-bef0-d84010eafd4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:37.815711 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300a214-0dc1-4b0e-bef0-d84010eafd4e service cinder] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:37.816163 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300a214-0dc1-4b0e-bef0-d84010eafd4e service cinder] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:37.817445 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300a214-0dc1-4b0e-bef0-d84010eafd4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:37.832212 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9300a214-0dc1-4b0e-bef0-d84010eafd4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:37.833715 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9300a214-0dc1-4b0e-bef0-d84010eafd4e service cinder] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:37.863868 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1069/2151] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:55:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:55:39.049980 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525738b-604a-4358-8fbd-cd0d6fcb3c57 service cinder] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:39.051924 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-b525738b-604a-4358-8fbd-cd0d6fcb3c57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:39.161857 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525738b-604a-4358-8fbd-cd0d6fcb3c57 service cinder] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:39.169076 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573d0e5-6e79-48f6-b6da-fb3bc1b3e135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:39.170204 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573d0e5-6e79-48f6-b6da-fb3bc1b3e135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:39.171329 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573d0e5-6e79-48f6-b6da-fb3bc1b3e135 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:39.171792 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573d0e5-6e79-48f6-b6da-fb3bc1b3e135 admin admin] PATH_INFO: `/v3/users/01b9673556844d688eaf38803269d4c0` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:39.174416 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4573d0e5-6e79-48f6-b6da-fb3bc1b3e135 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01b9673556844d688eaf38803269d4c0)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:39.176696 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4573d0e5-6e79-48f6-b6da-fb3bc1b3e135 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:39.258855 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-4573d0e5-6e79-48f6-b6da-fb3bc1b3e135 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01b9673556844d688eaf38803269d4c0'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:39.284432 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-4573d0e5-6e79-48f6-b6da-fb3bc1b3e135 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01b9673556844d688eaf38803269d4c0'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:39.299120 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-4573d0e5-6e79-48f6-b6da-fb3bc1b3e135 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01b9673556844d688eaf38803269d4c0'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:39.299982 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-4573d0e5-6e79-48f6-b6da-fb3bc1b3e135 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01b9673556844d688eaf38803269d4c0'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:39.318732 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-4573d0e5-6e79-48f6-b6da-fb3bc1b3e135 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01b9673556844d688eaf38803269d4c0'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:39.331020 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1083/2152] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:55:39 2022] DELETE /identity/v3/users/01b9673556844d688eaf38803269d4c0 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:39.333187 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17ac4d-08ac-4411-9205-9ee3be2a1c9d None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:39.333643 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17ac4d-08ac-4411-9205-9ee3be2a1c9d None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:39.334458 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17ac4d-08ac-4411-9205-9ee3be2a1c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:39.373987 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-7e17ac4d-08ac-4411-9205-9ee3be2a1c9d None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:39.376146 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-7e17ac4d-08ac-4411-9205-9ee3be2a1c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:39.478825 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1070/2153] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:55:39.488906 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573d0e5-6e79-48f6-b6da-fb3bc1b3e135 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:39.490425 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-4573d0e5-6e79-48f6-b6da-fb3bc1b3e135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:39.556852 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573d0e5-6e79-48f6-b6da-fb3bc1b3e135 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:39.563655 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099280b-0761-47af-9c7e-29fddd61b382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:39.564895 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099280b-0761-47af-9c7e-29fddd61b382 service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:39.565427 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099280b-0761-47af-9c7e-29fddd61b382 service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:39.566111 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099280b-0761-47af-9c7e-29fddd61b382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:39.585059 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0099280b-0761-47af-9c7e-29fddd61b382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:39.586572 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0099280b-0761-47af-9c7e-29fddd61b382 service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:39.596754 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1084/2154] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:55:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:55:40.403157 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17ac4d-08ac-4411-9205-9ee3be2a1c9d None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:40.406155 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-7e17ac4d-08ac-4411-9205-9ee3be2a1c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:40.426029 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17ac4d-08ac-4411-9205-9ee3be2a1c9d None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:40.431232 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b546723-7f63-4011-9ec8-6e6d56a7facf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:40.432270 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b546723-7f63-4011-9ec8-6e6d56a7facf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:40.432642 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b546723-7f63-4011-9ec8-6e6d56a7facf admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:40.433005 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b546723-7f63-4011-9ec8-6e6d56a7facf admin admin] PATH_INFO: `/v3/projects/add910c9648d4accba287620ef72c06f` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:40.434328 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b546723-7f63-4011-9ec8-6e6d56a7facf admin admin] RBAC: Authorizing `identity:delete_project(project_id=add910c9648d4accba287620ef72c06f)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:40.437005 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b546723-7f63-4011-9ec8-6e6d56a7facf admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:40.530595 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-4b546723-7f63-4011-9ec8-6e6d56a7facf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'add910c9648d4accba287620ef72c06f', 'request_id': 'req-4b546723-7f63-4011-9ec8-6e6d56a7facf'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:40.538067 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-4b546723-7f63-4011-9ec8-6e6d56a7facf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'add910c9648d4accba287620ef72c06f', 'request_id': 'req-4b546723-7f63-4011-9ec8-6e6d56a7facf'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:40.552651 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-4b546723-7f63-4011-9ec8-6e6d56a7facf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'add910c9648d4accba287620ef72c06f', 'request_id': 'req-4b546723-7f63-4011-9ec8-6e6d56a7facf'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:40.573952 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-4b546723-7f63-4011-9ec8-6e6d56a7facf admin admin] The token cache is being invalidate because project add910c9648d4accba287620ef72c06f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:55:40.574866 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-4b546723-7f63-4011-9ec8-6e6d56a7facf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:40.575574 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-4b546723-7f63-4011-9ec8-6e6d56a7facf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:40.579820 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1071/2155] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:55:40 2022] DELETE /identity/v3/projects/add910c9648d4accba287620ef72c06f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:40.582473 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099280b-0761-47af-9c7e-29fddd61b382 service neutron] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:40.597492 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099280b-0761-47af-9c7e-29fddd61b382 service neutron] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:40.668916 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee5ded-fb70-43a7-9b21-541e1374f271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:40.669802 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee5ded-fb70-43a7-9b21-541e1374f271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:40.670090 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee5ded-fb70-43a7-9b21-541e1374f271 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:40.670374 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee5ded-fb70-43a7-9b21-541e1374f271 admin admin] PATH_INFO: `/v3/users/f8bcac9f8876439883181f89dc6097c9` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:40.672291 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee5ded-fb70-43a7-9b21-541e1374f271 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8bcac9f8876439883181f89dc6097c9)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:40.674394 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee5ded-fb70-43a7-9b21-541e1374f271 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:40.738426 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-a0ee5ded-fb70-43a7-9b21-541e1374f271 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8bcac9f8876439883181f89dc6097c9'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:40.746820 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-a0ee5ded-fb70-43a7-9b21-541e1374f271 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8bcac9f8876439883181f89dc6097c9'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:40.759793 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-a0ee5ded-fb70-43a7-9b21-541e1374f271 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8bcac9f8876439883181f89dc6097c9'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:40.763641 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-a0ee5ded-fb70-43a7-9b21-541e1374f271 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8bcac9f8876439883181f89dc6097c9'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:40.777117 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-a0ee5ded-fb70-43a7-9b21-541e1374f271 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8bcac9f8876439883181f89dc6097c9'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:40.784987 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1085/2156] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:55:40 2022] DELETE /identity/v3/users/f8bcac9f8876439883181f89dc6097c9 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:41.149624 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b546723-7f63-4011-9ec8-6e6d56a7facf admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:41.151959 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-4b546723-7f63-4011-9ec8-6e6d56a7facf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:41.188157 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b546723-7f63-4011-9ec8-6e6d56a7facf admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:41.332701 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536802f3-a27d-44de-96d4-279fc8c0e9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:41.333987 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536802f3-a27d-44de-96d4-279fc8c0e9b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:41.334489 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536802f3-a27d-44de-96d4-279fc8c0e9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:41.335116 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536802f3-a27d-44de-96d4-279fc8c0e9b1 admin admin] PATH_INFO: `/v3/projects/c3a9391cbbd144aca92630923908efb1` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:41.336824 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536802f3-a27d-44de-96d4-279fc8c0e9b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3a9391cbbd144aca92630923908efb1)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:41.339178 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536802f3-a27d-44de-96d4-279fc8c0e9b1 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:41.435375 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-536802f3-a27d-44de-96d4-279fc8c0e9b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3a9391cbbd144aca92630923908efb1', 'request_id': 'req-536802f3-a27d-44de-96d4-279fc8c0e9b1'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:41.451488 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-536802f3-a27d-44de-96d4-279fc8c0e9b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3a9391cbbd144aca92630923908efb1', 'request_id': 'req-536802f3-a27d-44de-96d4-279fc8c0e9b1'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:41.469785 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-536802f3-a27d-44de-96d4-279fc8c0e9b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3a9391cbbd144aca92630923908efb1', 'request_id': 'req-536802f3-a27d-44de-96d4-279fc8c0e9b1'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:41.503030 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-536802f3-a27d-44de-96d4-279fc8c0e9b1 admin admin] The token cache is being invalidate because project c3a9391cbbd144aca92630923908efb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:55:41.504070 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-536802f3-a27d-44de-96d4-279fc8c0e9b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:41.505565 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-536802f3-a27d-44de-96d4-279fc8c0e9b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:41.511854 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1072/2157] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:55:41 2022] DELETE /identity/v3/projects/c3a9391cbbd144aca92630923908efb1 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:41.522862 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5978b-8e34-4d3e-b891-7a738d9a3601 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:41.523715 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5978b-8e34-4d3e-b891-7a738d9a3601 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:41.524044 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5978b-8e34-4d3e-b891-7a738d9a3601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:41.547285 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-4bd5978b-8e34-4d3e-b891-7a738d9a3601 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:41.548988 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-4bd5978b-8e34-4d3e-b891-7a738d9a3601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:41.771319 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1086/2158] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:55:41.781999 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29eace3-d843-445a-9ebb-26ed034fd397 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:41.782532 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29eace3-d843-445a-9ebb-26ed034fd397 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:41.783010 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29eace3-d843-445a-9ebb-26ed034fd397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:41.803140 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-d29eace3-d843-445a-9ebb-26ed034fd397 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:41.804412 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-d29eace3-d843-445a-9ebb-26ed034fd397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:41.813668 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1073/2159] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:55:41.818150 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5978b-8e34-4d3e-b891-7a738d9a3601 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:41.829386 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5978b-8e34-4d3e-b891-7a738d9a3601 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:41.838648 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a893593-7f1a-4137-99a3-7f1437b3c9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:41.840362 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a893593-7f1a-4137-99a3-7f1437b3c9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:41.840692 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a893593-7f1a-4137-99a3-7f1437b3c9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:41.841062 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a893593-7f1a-4137-99a3-7f1437b3c9b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:41.841925 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a893593-7f1a-4137-99a3-7f1437b3c9b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:55:41.843063 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a893593-7f1a-4137-99a3-7f1437b3c9b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:41.845074 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a893593-7f1a-4137-99a3-7f1437b3c9b5 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:41.859898 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1087/2160] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:55:41.866273 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29eace3-d843-445a-9ebb-26ed034fd397 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:41.884831 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29eace3-d843-445a-9ebb-26ed034fd397 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:41.892363 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e680ef4-a94e-4ddf-b791-14825c2ec2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:41.893337 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e680ef4-a94e-4ddf-b791-14825c2ec2ab admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:41.893876 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e680ef4-a94e-4ddf-b791-14825c2ec2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:41.894333 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e680ef4-a94e-4ddf-b791-14825c2ec2ab admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:41.895669 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e680ef4-a94e-4ddf-b791-14825c2ec2ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:41.899406 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e680ef4-a94e-4ddf-b791-14825c2ec2ab admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:41.946216 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1074/2161] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:55:41 2022] POST /identity/v3/projects => generated 375 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:55:41.951697 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a893593-7f1a-4137-99a3-7f1437b3c9b5 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:41.964035 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a893593-7f1a-4137-99a3-7f1437b3c9b5 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:41.993148 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500515f2-52ed-4c57-9bd0-294cdcc2206c None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:41.993429 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500515f2-52ed-4c57-9bd0-294cdcc2206c None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:41.996097 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500515f2-52ed-4c57-9bd0-294cdcc2206c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:42.033268 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-500515f2-52ed-4c57-9bd0-294cdcc2206c None None] MFA Rules not processed for user `5dec57310b724afa966fd56650707e54`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:42.035166 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-500515f2-52ed-4c57-9bd0-294cdcc2206c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:42.088929 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a843949-ff50-4412-b461-9066b114db17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:42.089722 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a843949-ff50-4412-b461-9066b114db17 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:42.090754 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a843949-ff50-4412-b461-9066b114db17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:42.090754 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a843949-ff50-4412-b461-9066b114db17 admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:42.091420 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a843949-ff50-4412-b461-9066b114db17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:42.094330 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a843949-ff50-4412-b461-9066b114db17 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:42.124505 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1088/2162] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:55:41 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:55:42.125903 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a843949-ff50-4412-b461-9066b114db17 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:42.128619 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-3a843949-ff50-4412-b461-9066b114db17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:42.141753 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a843949-ff50-4412-b461-9066b114db17 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:42.146796 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ded81-c6a6-4d77-8d3d-4e0fe5eaf413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:42.147836 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ded81-c6a6-4d77-8d3d-4e0fe5eaf413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:42.148430 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ded81-c6a6-4d77-8d3d-4e0fe5eaf413 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:42.148776 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ded81-c6a6-4d77-8d3d-4e0fe5eaf413 admin admin] PATH_INFO: `/v3/users/eba377274fcd43cf83722a1cc37dfe48` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:42.150089 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1075/2163] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:55:42.152063 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ded81-c6a6-4d77-8d3d-4e0fe5eaf413 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eba377274fcd43cf83722a1cc37dfe48)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:42.152400 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500515f2-52ed-4c57-9bd0-294cdcc2206c None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:42.155655 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ded81-c6a6-4d77-8d3d-4e0fe5eaf413 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:42.180724 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500515f2-52ed-4c57-9bd0-294cdcc2206c None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:42.197331 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be99c0-60e9-4d15-96dc-0124aa3630f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:42.198690 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be99c0-60e9-4d15-96dc-0124aa3630f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:42.199174 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be99c0-60e9-4d15-96dc-0124aa3630f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:42.199648 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be99c0-60e9-4d15-96dc-0124aa3630f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:42.201158 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be99c0-60e9-4d15-96dc-0124aa3630f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:42.205018 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be99c0-60e9-4d15-96dc-0124aa3630f6 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:42.220454 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-135ded81-c6a6-4d77-8d3d-4e0fe5eaf413 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eba377274fcd43cf83722a1cc37dfe48'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:42.230999 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1076/2164] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:55:42.232448 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be99c0-60e9-4d15-96dc-0124aa3630f6 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:42.233847 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-135ded81-c6a6-4d77-8d3d-4e0fe5eaf413 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eba377274fcd43cf83722a1cc37dfe48'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:42.250402 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-135ded81-c6a6-4d77-8d3d-4e0fe5eaf413 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eba377274fcd43cf83722a1cc37dfe48'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:42.251179 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-135ded81-c6a6-4d77-8d3d-4e0fe5eaf413 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eba377274fcd43cf83722a1cc37dfe48'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:42.253566 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be99c0-60e9-4d15-96dc-0124aa3630f6 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:42.260750 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172d3e5-ad27-4b9d-ab54-fc9fe30fbcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:42.262103 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172d3e5-ad27-4b9d-ab54-fc9fe30fbcbd admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:42.262675 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172d3e5-ad27-4b9d-ab54-fc9fe30fbcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:42.263227 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172d3e5-ad27-4b9d-ab54-fc9fe30fbcbd admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:42.265645 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172d3e5-ad27-4b9d-ab54-fc9fe30fbcbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:42.270164 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172d3e5-ad27-4b9d-ab54-fc9fe30fbcbd admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:42.273980 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-135ded81-c6a6-4d77-8d3d-4e0fe5eaf413 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eba377274fcd43cf83722a1cc37dfe48'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:42.288809 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1077/2166] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:55:42.289263 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1089/2166] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:55:42 2022] DELETE /identity/v3/users/eba377274fcd43cf83722a1cc37dfe48 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:42.293220 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ded81-c6a6-4d77-8d3d-4e0fe5eaf413 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:42.294744 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-135ded81-c6a6-4d77-8d3d-4e0fe5eaf413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:42.297634 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4bc12-d559-43d2-9ff0-2a84c2527319 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:42.298096 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4bc12-d559-43d2-9ff0-2a84c2527319 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:42.298534 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4bc12-d559-43d2-9ff0-2a84c2527319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:42.331633 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-eaf4bc12-d559-43d2-9ff0-2a84c2527319 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:42.332983 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-eaf4bc12-d559-43d2-9ff0-2a84c2527319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:42.396378 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ded81-c6a6-4d77-8d3d-4e0fe5eaf413 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:42.401887 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d32a3f-0a42-4950-8555-8a3f2f36a51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:42.402712 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d32a3f-0a42-4950-8555-8a3f2f36a51c admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:42.403023 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d32a3f-0a42-4950-8555-8a3f2f36a51c admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:42.403300 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d32a3f-0a42-4950-8555-8a3f2f36a51c admin admin] PATH_INFO: `/v3/projects/09e25051d5da44a4b14600f46543c164/users/c6cb42183d614cef9de395c1031b30ed/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:42.419346 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1078/2167] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:55:42.427467 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d32a3f-0a42-4950-8555-8a3f2f36a51c admin admin] RBAC: Authorizing `identity:create_grant(project_id=09e25051d5da44a4b14600f46543c164, user_id=c6cb42183d614cef9de395c1031b30ed, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:42.428503 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4bc12-d559-43d2-9ff0-2a84c2527319 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:42.429960 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-eaf4bc12-d559-43d2-9ff0-2a84c2527319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:42.430646 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d32a3f-0a42-4950-8555-8a3f2f36a51c admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:42.446000 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1090/2168] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:55:42 2022] PUT /identity/v3/projects/09e25051d5da44a4b14600f46543c164/users/c6cb42183d614cef9de395c1031b30ed/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:55:42.460236 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd23393-8288-4533-8499-ab2fee644643 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:42.460418 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd23393-8288-4533-8499-ab2fee644643 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:42.460876 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd23393-8288-4533-8499-ab2fee644643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:42.494524 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-dcd23393-8288-4533-8499-ab2fee644643 None None] MFA Rules not processed for user `c6cb42183d614cef9de395c1031b30ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:42.496133 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-dcd23393-8288-4533-8499-ab2fee644643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:42.527276 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4bc12-d559-43d2-9ff0-2a84c2527319 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:42.587265 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1091/2169] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:55:42.591340 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd23393-8288-4533-8499-ab2fee644643 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:42.591340 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-dcd23393-8288-4533-8499-ab2fee644643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:42.619094 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4554f601-da68-4fd1-a1ba-5a53662a79e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:42.619779 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554f601-da68-4fd1-a1ba-5a53662a79e1 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:42.620120 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554f601-da68-4fd1-a1ba-5a53662a79e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:42.620393 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554f601-da68-4fd1-a1ba-5a53662a79e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:42.689737 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd23393-8288-4533-8499-ab2fee644643 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:42.695504 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf49c68-3a0a-4c1d-a464-215281591463 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '938634e835b94a75af698aef6941958f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:42.696348 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf49c68-3a0a-4c1d-a464-215281591463 service placement] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:42.696731 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf49c68-3a0a-4c1d-a464-215281591463 service placement] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:42.697103 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf49c68-3a0a-4c1d-a464-215281591463 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:42.699522 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-ccf49c68-3a0a-4c1d-a464-215281591463 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:42.714079 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf49c68-3a0a-4c1d-a464-215281591463 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:42.715612 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf49c68-3a0a-4c1d-a464-215281591463 service placement] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:42.729664 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1092/2170] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:55:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:55:42.731542 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf49c68-3a0a-4c1d-a464-215281591463 service placement] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:42.733599 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4554f601-da68-4fd1-a1ba-5a53662a79e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:42.735339 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4554f601-da68-4fd1-a1ba-5a53662a79e1 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:42.745958 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf49c68-3a0a-4c1d-a464-215281591463 service placement] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:42.748167 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1079/2171] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:55:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:55:42.751974 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a0bc0-e490-4b93-b0a3-2b1bdfa00f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:42.752805 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a0bc0-e490-4b93-b0a3-2b1bdfa00f62 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:42.753436 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a0bc0-e490-4b93-b0a3-2b1bdfa00f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:42.753779 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a0bc0-e490-4b93-b0a3-2b1bdfa00f62 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:42.754581 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a0bc0-e490-4b93-b0a3-2b1bdfa00f62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:42.762722 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a0bc0-e490-4b93-b0a3-2b1bdfa00f62 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:42.807034 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1093/2172] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:55:42 2022] POST /identity/v3/projects => generated 375 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:55:42.812055 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4554f601-da68-4fd1-a1ba-5a53662a79e1 service neutron] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:42.828875 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4554f601-da68-4fd1-a1ba-5a53662a79e1 service neutron] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:42.952442 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63f49d-4aaa-4f9b-914b-63ea92274f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:42.953799 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63f49d-4aaa-4f9b-914b-63ea92274f2d admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:42.953799 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63f49d-4aaa-4f9b-914b-63ea92274f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:42.953980 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63f49d-4aaa-4f9b-914b-63ea92274f2d admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:42.955462 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63f49d-4aaa-4f9b-914b-63ea92274f2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:42.969205 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63f49d-4aaa-4f9b-914b-63ea92274f2d admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:43.021775 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1080/2173] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:55:42 2022] POST /identity/v3/users => generated 294 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:55:43.025750 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a0bc0-e490-4b93-b0a3-2b1bdfa00f62 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:43.038921 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a0bc0-e490-4b93-b0a3-2b1bdfa00f62 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:43.046671 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55a8f8-0f7b-4cd1-baa0-20e85daed13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:43.047401 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55a8f8-0f7b-4cd1-baa0-20e85daed13d admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:43.047690 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55a8f8-0f7b-4cd1-baa0-20e85daed13d admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:43.047996 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55a8f8-0f7b-4cd1-baa0-20e85daed13d admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:43.048737 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc55a8f8-0f7b-4cd1-baa0-20e85daed13d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:43.050623 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc55a8f8-0f7b-4cd1-baa0-20e85daed13d admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:43.072475 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1094/2174] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:55:43.077994 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63f49d-4aaa-4f9b-914b-63ea92274f2d admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:43.090133 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63f49d-4aaa-4f9b-914b-63ea92274f2d admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:43.096487 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dfb8fc-01d1-4f88-8a88-26cbecde7de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:43.097358 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfb8fc-01d1-4f88-8a88-26cbecde7de3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:43.097992 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfb8fc-01d1-4f88-8a88-26cbecde7de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:43.098120 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfb8fc-01d1-4f88-8a88-26cbecde7de3 admin admin] PATH_INFO: `/v3/projects/1da7b26c4e6243e88c74ad293dfe7236/users/ce67d328337f4ac199e63436b4d3bc8e/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:43.141901 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dfb8fc-01d1-4f88-8a88-26cbecde7de3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da7b26c4e6243e88c74ad293dfe7236, user_id=ce67d328337f4ac199e63436b4d3bc8e, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:43.145180 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dfb8fc-01d1-4f88-8a88-26cbecde7de3 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:43.183328 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1081/2175] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:55:43 2022] PUT /identity/v3/projects/1da7b26c4e6243e88c74ad293dfe7236/users/ce67d328337f4ac199e63436b4d3bc8e/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:43.185004 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55a8f8-0f7b-4cd1-baa0-20e85daed13d admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:43.201377 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55a8f8-0f7b-4cd1-baa0-20e85daed13d admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:43.239967 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dfb8fc-01d1-4f88-8a88-26cbecde7de3 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:43.242210 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-89dfb8fc-01d1-4f88-8a88-26cbecde7de3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:43.360423 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dfb8fc-01d1-4f88-8a88-26cbecde7de3 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:43.360651 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d400ce8-64fa-4975-87f1-8770c8a344f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:43.361421 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d400ce8-64fa-4975-87f1-8770c8a344f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:43.362512 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d400ce8-64fa-4975-87f1-8770c8a344f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:43.362853 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d400ce8-64fa-4975-87f1-8770c8a344f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:43.363872 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d400ce8-64fa-4975-87f1-8770c8a344f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:43.366207 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d400ce8-64fa-4975-87f1-8770c8a344f7 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:43.367915 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5f6b2-4299-415a-9837-93d3842d561b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:43.368831 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5f6b2-4299-415a-9837-93d3842d561b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:43.369127 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5f6b2-4299-415a-9837-93d3842d561b admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:43.370245 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5f6b2-4299-415a-9837-93d3842d561b admin admin] PATH_INFO: `/v3/projects/59af2e5ed1914affbbc7e86985e9102c` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:43.372437 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5f6b2-4299-415a-9837-93d3842d561b admin admin] RBAC: Authorizing `identity:delete_project(project_id=59af2e5ed1914affbbc7e86985e9102c)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:43.375500 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5f6b2-4299-415a-9837-93d3842d561b admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:43.381096 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1095/2176] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:55:43.390865 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d400ce8-64fa-4975-87f1-8770c8a344f7 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:43.412948 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d400ce8-64fa-4975-87f1-8770c8a344f7 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:43.429254 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e347b11-158c-442a-a866-daaf02814e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:43.430323 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e347b11-158c-442a-a866-daaf02814e54 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:43.430470 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e347b11-158c-442a-a866-daaf02814e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:43.430748 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e347b11-158c-442a-a866-daaf02814e54 admin admin] PATH_INFO: `/v3/projects/1da7b26c4e6243e88c74ad293dfe7236/users/ce67d328337f4ac199e63436b4d3bc8e/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:43.433861 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e347b11-158c-442a-a866-daaf02814e54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da7b26c4e6243e88c74ad293dfe7236, user_id=ce67d328337f4ac199e63436b4d3bc8e, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:43.447795 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e347b11-158c-442a-a866-daaf02814e54 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:43.477626 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1096/2177] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:55:43 2022] PUT /identity/v3/projects/1da7b26c4e6243e88c74ad293dfe7236/users/ce67d328337f4ac199e63436b4d3bc8e/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:43.481275 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39374960-dc06-4a5c-8fca-1e827339002a None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:43.481967 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39374960-dc06-4a5c-8fca-1e827339002a None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:43.486301 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39374960-dc06-4a5c-8fca-1e827339002a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:43.486774 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-c9f5f6b2-4299-415a-9837-93d3842d561b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59af2e5ed1914affbbc7e86985e9102c', 'request_id': 'req-c9f5f6b2-4299-415a-9837-93d3842d561b'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:43.493554 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-c9f5f6b2-4299-415a-9837-93d3842d561b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59af2e5ed1914affbbc7e86985e9102c', 'request_id': 'req-c9f5f6b2-4299-415a-9837-93d3842d561b'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:43.515273 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-c9f5f6b2-4299-415a-9837-93d3842d561b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59af2e5ed1914affbbc7e86985e9102c', 'request_id': 'req-c9f5f6b2-4299-415a-9837-93d3842d561b'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:43.540503 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-c9f5f6b2-4299-415a-9837-93d3842d561b admin admin] The token cache is being invalidate because project 59af2e5ed1914affbbc7e86985e9102c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:55:43.541143 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-c9f5f6b2-4299-415a-9837-93d3842d561b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:43.543772 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-c9f5f6b2-4299-415a-9837-93d3842d561b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:43.548166 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1082/2178] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:55:43 2022] DELETE /identity/v3/projects/59af2e5ed1914affbbc7e86985e9102c => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:43.552070 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5f6b2-4299-415a-9837-93d3842d561b admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:43.554721 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-c9f5f6b2-4299-415a-9837-93d3842d561b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:43.558190 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-39374960-dc06-4a5c-8fca-1e827339002a None None] MFA Rules not processed for user `ce67d328337f4ac199e63436b4d3bc8e`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:43.560139 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-39374960-dc06-4a5c-8fca-1e827339002a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:43.692019 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5f6b2-4299-415a-9837-93d3842d561b admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:43.731707 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1097/2179] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:43 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:55:43.752367 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39374960-dc06-4a5c-8fca-1e827339002a None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:43.757454 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-39374960-dc06-4a5c-8fca-1e827339002a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:43.851434 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cf0a9-6549-478b-ba98-e144f97f9e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:43.852624 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cf0a9-6549-478b-ba98-e144f97f9e5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:43.853144 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cf0a9-6549-478b-ba98-e144f97f9e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:43.853489 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cf0a9-6549-478b-ba98-e144f97f9e5c admin admin] PATH_INFO: `/v3/users/6c020f150f014b87a990e28bc6a05a9a` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:43.855889 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78cf0a9-6549-478b-ba98-e144f97f9e5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c020f150f014b87a990e28bc6a05a9a)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:43.859189 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39374960-dc06-4a5c-8fca-1e827339002a None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:43.859877 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78cf0a9-6549-478b-ba98-e144f97f9e5c admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:43.864842 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc8dbc-1f48-4bc8-a22d-a3f9343a4f21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:43.865583 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc8dbc-1f48-4bc8-a22d-a3f9343a4f21 service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:43.865919 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc8dbc-1f48-4bc8-a22d-a3f9343a4f21 service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:43.866157 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc8dbc-1f48-4bc8-a22d-a3f9343a4f21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:43.870530 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-f0dc8dbc-1f48-4bc8-a22d-a3f9343a4f21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:43.942059 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-c78cf0a9-6549-478b-ba98-e144f97f9e5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c020f150f014b87a990e28bc6a05a9a'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:43.965147 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc8dbc-1f48-4bc8-a22d-a3f9343a4f21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:43.973713 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc8dbc-1f48-4bc8-a22d-a3f9343a4f21 service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:43.977466 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-c78cf0a9-6549-478b-ba98-e144f97f9e5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c020f150f014b87a990e28bc6a05a9a'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:43.978253 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-c78cf0a9-6549-478b-ba98-e144f97f9e5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c020f150f014b87a990e28bc6a05a9a'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:44.000920 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1098/2180] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:55:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:55:44.001885 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-c78cf0a9-6549-478b-ba98-e144f97f9e5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c020f150f014b87a990e28bc6a05a9a'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:44.002664 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-c78cf0a9-6549-478b-ba98-e144f97f9e5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c020f150f014b87a990e28bc6a05a9a'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:44.025576 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1083/2181] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:55:43 2022] DELETE /identity/v3/users/6c020f150f014b87a990e28bc6a05a9a => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:55:44.448532 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc8dbc-1f48-4bc8-a22d-a3f9343a4f21 service cinder] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:44.474092 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc8dbc-1f48-4bc8-a22d-a3f9343a4f21 service cinder] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:44.565135 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a719b36-17fd-4bc9-b2ab-aab57015ed67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:44.568742 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a719b36-17fd-4bc9-b2ab-aab57015ed67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:44.569083 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a719b36-17fd-4bc9-b2ab-aab57015ed67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:44.569354 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a719b36-17fd-4bc9-b2ab-aab57015ed67 admin admin] PATH_INFO: `/v3/projects/296ae9947eb24ad3b60840ffa6a28f3d` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:44.571219 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a719b36-17fd-4bc9-b2ab-aab57015ed67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=296ae9947eb24ad3b60840ffa6a28f3d)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:44.573607 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a719b36-17fd-4bc9-b2ab-aab57015ed67 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:44.665271 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-6a719b36-17fd-4bc9-b2ab-aab57015ed67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '296ae9947eb24ad3b60840ffa6a28f3d', 'request_id': 'req-6a719b36-17fd-4bc9-b2ab-aab57015ed67'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:44.674151 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-6a719b36-17fd-4bc9-b2ab-aab57015ed67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '296ae9947eb24ad3b60840ffa6a28f3d', 'request_id': 'req-6a719b36-17fd-4bc9-b2ab-aab57015ed67'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:44.682846 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-6a719b36-17fd-4bc9-b2ab-aab57015ed67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '296ae9947eb24ad3b60840ffa6a28f3d', 'request_id': 'req-6a719b36-17fd-4bc9-b2ab-aab57015ed67'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:44.698635 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-6a719b36-17fd-4bc9-b2ab-aab57015ed67 admin admin] The token cache is being invalidate because project 296ae9947eb24ad3b60840ffa6a28f3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:55:44.699606 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-6a719b36-17fd-4bc9-b2ab-aab57015ed67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:44.700993 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-6a719b36-17fd-4bc9-b2ab-aab57015ed67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:44.706457 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1099/2182] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:55:44 2022] DELETE /identity/v3/projects/296ae9947eb24ad3b60840ffa6a28f3d => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:44.708723 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cf0a9-6549-478b-ba98-e144f97f9e5c admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:44.713453 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-c78cf0a9-6549-478b-ba98-e144f97f9e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:44.746641 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cf0a9-6549-478b-ba98-e144f97f9e5c admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:44.867692 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c31ea2-d192-49c2-90ca-99afeb53657d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:44.868972 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c31ea2-d192-49c2-90ca-99afeb53657d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:44.869353 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c31ea2-d192-49c2-90ca-99afeb53657d admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:44.869703 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c31ea2-d192-49c2-90ca-99afeb53657d admin admin] PATH_INFO: `/v3/users/0b58b7f329d4476fbcfeaa0243474ca4` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:44.871337 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c31ea2-d192-49c2-90ca-99afeb53657d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b58b7f329d4476fbcfeaa0243474ca4)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:44.873154 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c31ea2-d192-49c2-90ca-99afeb53657d admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:44.959374 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-23c31ea2-d192-49c2-90ca-99afeb53657d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b58b7f329d4476fbcfeaa0243474ca4'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:44.970511 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-23c31ea2-d192-49c2-90ca-99afeb53657d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b58b7f329d4476fbcfeaa0243474ca4'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:44.971402 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-23c31ea2-d192-49c2-90ca-99afeb53657d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b58b7f329d4476fbcfeaa0243474ca4'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:44.989059 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-23c31ea2-d192-49c2-90ca-99afeb53657d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b58b7f329d4476fbcfeaa0243474ca4'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:44.989916 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-23c31ea2-d192-49c2-90ca-99afeb53657d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b58b7f329d4476fbcfeaa0243474ca4'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:45.018396 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1084/2183] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:55:44 2022] DELETE /identity/v3/users/0b58b7f329d4476fbcfeaa0243474ca4 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:45.349483 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a719b36-17fd-4bc9-b2ab-aab57015ed67 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:45.351087 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-6a719b36-17fd-4bc9-b2ab-aab57015ed67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:45.365211 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a719b36-17fd-4bc9-b2ab-aab57015ed67 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:45.450358 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eecac6-fe16-4a68-9576-e4237ea2d437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:45.451792 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eecac6-fe16-4a68-9576-e4237ea2d437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:45.451792 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eecac6-fe16-4a68-9576-e4237ea2d437 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:45.452123 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eecac6-fe16-4a68-9576-e4237ea2d437 admin admin] PATH_INFO: `/v3/projects/8b8f57f0c6ac4cb983796666fd5d4357` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:45.454682 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eecac6-fe16-4a68-9576-e4237ea2d437 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b8f57f0c6ac4cb983796666fd5d4357)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:45.456698 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eecac6-fe16-4a68-9576-e4237ea2d437 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:45.544850 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-a3eecac6-fe16-4a68-9576-e4237ea2d437 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b8f57f0c6ac4cb983796666fd5d4357', 'request_id': 'req-a3eecac6-fe16-4a68-9576-e4237ea2d437'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:45.553342 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-a3eecac6-fe16-4a68-9576-e4237ea2d437 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b8f57f0c6ac4cb983796666fd5d4357', 'request_id': 'req-a3eecac6-fe16-4a68-9576-e4237ea2d437'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:45.565528 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-a3eecac6-fe16-4a68-9576-e4237ea2d437 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b8f57f0c6ac4cb983796666fd5d4357', 'request_id': 'req-a3eecac6-fe16-4a68-9576-e4237ea2d437'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:45.579136 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-a3eecac6-fe16-4a68-9576-e4237ea2d437 admin admin] The token cache is being invalidate because project 8b8f57f0c6ac4cb983796666fd5d4357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:55:45.579413 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-a3eecac6-fe16-4a68-9576-e4237ea2d437 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:45.580445 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-a3eecac6-fe16-4a68-9576-e4237ea2d437 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:45.586434 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1100/2184] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:55:45 2022] DELETE /identity/v3/projects/8b8f57f0c6ac4cb983796666fd5d4357 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:45.594139 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eac662-d2ec-4e97-a7be-3f70497556db None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:45.594400 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eac662-d2ec-4e97-a7be-3f70497556db None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:45.594743 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eac662-d2ec-4e97-a7be-3f70497556db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:45.625068 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-72eac662-d2ec-4e97-a7be-3f70497556db None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:45.626305 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-72eac662-d2ec-4e97-a7be-3f70497556db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:45.706008 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1085/2185] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:55:45.714345 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31154d9e-4f1f-4c02-99a2-92d14b7b3f63 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:45.714631 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31154d9e-4f1f-4c02-99a2-92d14b7b3f63 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:45.714914 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31154d9e-4f1f-4c02-99a2-92d14b7b3f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:45.742871 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-31154d9e-4f1f-4c02-99a2-92d14b7b3f63 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:45.744440 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-31154d9e-4f1f-4c02-99a2-92d14b7b3f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:45.756037 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1101/2186] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:55:45.760035 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eac662-d2ec-4e97-a7be-3f70497556db None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:45.772218 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eac662-d2ec-4e97-a7be-3f70497556db None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:45.780036 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fef6e1-b9a9-4073-b50f-dcb30491d905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:45.780915 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fef6e1-b9a9-4073-b50f-dcb30491d905 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:45.781412 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fef6e1-b9a9-4073-b50f-dcb30491d905 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:45.781747 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fef6e1-b9a9-4073-b50f-dcb30491d905 admin admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:45.782538 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fef6e1-b9a9-4073-b50f-dcb30491d905 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:55:45.783011 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fef6e1-b9a9-4073-b50f-dcb30491d905 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:45.784641 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fef6e1-b9a9-4073-b50f-dcb30491d905 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:45.799032 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1086/2187] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:55:45.803390 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31154d9e-4f1f-4c02-99a2-92d14b7b3f63 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:45.813889 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31154d9e-4f1f-4c02-99a2-92d14b7b3f63 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:45.818773 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac2fd7-8aeb-4cec-9574-6b58acbf6a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:45.819430 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac2fd7-8aeb-4cec-9574-6b58acbf6a77 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:45.819710 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac2fd7-8aeb-4cec-9574-6b58acbf6a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:45.820010 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac2fd7-8aeb-4cec-9574-6b58acbf6a77 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:45.820714 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac2fd7-8aeb-4cec-9574-6b58acbf6a77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:45.822656 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac2fd7-8aeb-4cec-9574-6b58acbf6a77 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:45.862479 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed30e0-c48b-4dc6-a767-9e334839c5e2 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:45.862998 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed30e0-c48b-4dc6-a767-9e334839c5e2 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:45.863339 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed30e0-c48b-4dc6-a767-9e334839c5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:45.863492 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1102/2188] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:55:45 2022] POST /identity/v3/projects => generated 365 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:55:45.870818 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac2fd7-8aeb-4cec-9574-6b58acbf6a77 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:45.995069 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac2fd7-8aeb-4cec-9574-6b58acbf6a77 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:46.017028 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78aa4f-3302-4db0-ac2f-42bb86ef44d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:46.018435 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78aa4f-3302-4db0-ac2f-42bb86ef44d1 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:46.019083 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78aa4f-3302-4db0-ac2f-42bb86ef44d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:46.019701 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78aa4f-3302-4db0-ac2f-42bb86ef44d1 admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:46.021256 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78aa4f-3302-4db0-ac2f-42bb86ef44d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:46.025162 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78aa4f-3302-4db0-ac2f-42bb86ef44d1 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:46.040910 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-07ed30e0-c48b-4dc6-a767-9e334839c5e2 None None] MFA Rules not processed for user `48c87597846e44f186da0c969a2579bf`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:46.043279 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-07ed30e0-c48b-4dc6-a767-9e334839c5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:46.060818 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1103/2189] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:55:45 2022] POST /identity/v3/users => generated 283 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:55:46.062703 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78aa4f-3302-4db0-ac2f-42bb86ef44d1 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:46.077986 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78aa4f-3302-4db0-ac2f-42bb86ef44d1 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:46.084908 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f61dc-475f-438e-920b-e69fa3afe70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:46.086588 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f61dc-475f-438e-920b-e69fa3afe70f admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:46.086885 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f61dc-475f-438e-920b-e69fa3afe70f admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:46.087165 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f61dc-475f-438e-920b-e69fa3afe70f admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:46.087974 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f61dc-475f-438e-920b-e69fa3afe70f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:46.089578 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f61dc-475f-438e-920b-e69fa3afe70f admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:46.102298 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1104/2190] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:55:46.106290 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f61dc-475f-438e-920b-e69fa3afe70f admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:46.122455 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f61dc-475f-438e-920b-e69fa3afe70f admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:46.130275 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06be8e-84dd-46f4-abfa-25f2f97633f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:46.131321 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06be8e-84dd-46f4-abfa-25f2f97633f3 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:46.132189 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06be8e-84dd-46f4-abfa-25f2f97633f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:46.132566 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06be8e-84dd-46f4-abfa-25f2f97633f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:46.133694 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06be8e-84dd-46f4-abfa-25f2f97633f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:46.136970 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06be8e-84dd-46f4-abfa-25f2f97633f3 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:46.155813 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1105/2191] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:55:46.156050 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1087/2192] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:55:46.157471 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06be8e-84dd-46f4-abfa-25f2f97633f3 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:46.167627 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06be8e-84dd-46f4-abfa-25f2f97633f3 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:46.172887 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaee4fb-0947-4636-a10a-14d39cf7269a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:46.174032 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaee4fb-0947-4636-a10a-14d39cf7269a admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:46.174473 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaee4fb-0947-4636-a10a-14d39cf7269a admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:46.174876 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaee4fb-0947-4636-a10a-14d39cf7269a admin admin] PATH_INFO: `/v3/projects/312b1bc4392741b5bc875ca9a7f3507b/users/9bbb8192591049bdb2bb1b6fc7a62036/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:46.191956 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaee4fb-0947-4636-a10a-14d39cf7269a admin admin] RBAC: Authorizing `identity:create_grant(project_id=312b1bc4392741b5bc875ca9a7f3507b, user_id=9bbb8192591049bdb2bb1b6fc7a62036, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:46.195214 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaee4fb-0947-4636-a10a-14d39cf7269a admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:46.211984 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1106/2193] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:55:46 2022] PUT /identity/v3/projects/312b1bc4392741b5bc875ca9a7f3507b/users/9bbb8192591049bdb2bb1b6fc7a62036/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:46.223149 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccd0d8-9e18-4f33-8a99-d8fd7fa11e11 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:46.223678 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccd0d8-9e18-4f33-8a99-d8fd7fa11e11 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:46.224204 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccd0d8-9e18-4f33-8a99-d8fd7fa11e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:46.262110 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-52ccd0d8-9e18-4f33-8a99-d8fd7fa11e11 None None] MFA Rules not processed for user `9bbb8192591049bdb2bb1b6fc7a62036`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:46.263523 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-52ccd0d8-9e18-4f33-8a99-d8fd7fa11e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:46.394860 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1088/2194] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:46 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:55:46.409455 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaee4fb-0947-4636-a10a-14d39cf7269a admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:46.411477 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-faaee4fb-0947-4636-a10a-14d39cf7269a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:46.507101 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaee4fb-0947-4636-a10a-14d39cf7269a admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:46.510714 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bcc390-6894-42df-a53d-ad8e9733e02b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:46.511357 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcc390-6894-42df-a53d-ad8e9733e02b service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:46.511632 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcc390-6894-42df-a53d-ad8e9733e02b service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:46.511925 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcc390-6894-42df-a53d-ad8e9733e02b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:46.521957 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bcc390-6894-42df-a53d-ad8e9733e02b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:46.524106 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bcc390-6894-42df-a53d-ad8e9733e02b service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:46.553597 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1107/2195] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:55:46 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:55:46.812688 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ccd0d8-9e18-4f33-8a99-d8fd7fa11e11 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:46.814299 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-52ccd0d8-9e18-4f33-8a99-d8fd7fa11e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:46.980748 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ccd0d8-9e18-4f33-8a99-d8fd7fa11e11 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:47.003548 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a0b80-f661-418a-94a2-d61723189811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:47.011354 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a0b80-f661-418a-94a2-d61723189811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:47.019139 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a0b80-f661-418a-94a2-d61723189811 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:47.019907 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a0b80-f661-418a-94a2-d61723189811 admin admin] PATH_INFO: `/v3/users/c6cb42183d614cef9de395c1031b30ed` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:47.024365 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a0b80-f661-418a-94a2-d61723189811 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6cb42183d614cef9de395c1031b30ed)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:47.034045 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a0b80-f661-418a-94a2-d61723189811 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:47.171334 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0f9a0b80-f661-418a-94a2-d61723189811 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6cb42183d614cef9de395c1031b30ed'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:47.180001 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0f9a0b80-f661-418a-94a2-d61723189811 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6cb42183d614cef9de395c1031b30ed'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:47.180753 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0f9a0b80-f661-418a-94a2-d61723189811 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6cb42183d614cef9de395c1031b30ed'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:47.200011 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0f9a0b80-f661-418a-94a2-d61723189811 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6cb42183d614cef9de395c1031b30ed'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:47.201087 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0f9a0b80-f661-418a-94a2-d61723189811 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6cb42183d614cef9de395c1031b30ed'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:47.216016 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1089/2196] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:55:46 2022] DELETE /identity/v3/users/c6cb42183d614cef9de395c1031b30ed => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:47.221472 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccf076-af27-41f1-992a-b57232e5a189 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:47.221907 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccf076-af27-41f1-992a-b57232e5a189 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:47.222230 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccf076-af27-41f1-992a-b57232e5a189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:47.243575 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-60ccf076-af27-41f1-992a-b57232e5a189 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:47.244898 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-60ccf076-af27-41f1-992a-b57232e5a189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:47.329844 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1108/2197] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:55:47.341484 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a0b80-f661-418a-94a2-d61723189811 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:47.343664 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-0f9a0b80-f661-418a-94a2-d61723189811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:47.455493 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a0b80-f661-418a-94a2-d61723189811 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:47.461266 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895837e-f51c-4e39-9c20-dee1f8d79d6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:47.462244 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895837e-f51c-4e39-9c20-dee1f8d79d6c service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:47.462720 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895837e-f51c-4e39-9c20-dee1f8d79d6c service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:47.463182 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895837e-f51c-4e39-9c20-dee1f8d79d6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:47.486803 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895837e-f51c-4e39-9c20-dee1f8d79d6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:47.491223 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895837e-f51c-4e39-9c20-dee1f8d79d6c service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:47.506699 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1090/2198] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:55:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:55:47.902388 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccf076-af27-41f1-992a-b57232e5a189 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:47.905779 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-60ccf076-af27-41f1-992a-b57232e5a189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:47.937446 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccf076-af27-41f1-992a-b57232e5a189 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:47.942495 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4609434-3a5c-4f9b-938f-35e2645d45d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:47.943563 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4609434-3a5c-4f9b-938f-35e2645d45d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:47.943806 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4609434-3a5c-4f9b-938f-35e2645d45d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:47.944083 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4609434-3a5c-4f9b-938f-35e2645d45d4 admin admin] PATH_INFO: `/v3/projects/09e25051d5da44a4b14600f46543c164` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:47.945310 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4609434-3a5c-4f9b-938f-35e2645d45d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09e25051d5da44a4b14600f46543c164)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:47.947270 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4609434-3a5c-4f9b-938f-35e2645d45d4 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:48.017475 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-a4609434-3a5c-4f9b-938f-35e2645d45d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09e25051d5da44a4b14600f46543c164', 'request_id': 'req-a4609434-3a5c-4f9b-938f-35e2645d45d4'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:48.031112 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-a4609434-3a5c-4f9b-938f-35e2645d45d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09e25051d5da44a4b14600f46543c164', 'request_id': 'req-a4609434-3a5c-4f9b-938f-35e2645d45d4'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:48.044271 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-a4609434-3a5c-4f9b-938f-35e2645d45d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09e25051d5da44a4b14600f46543c164', 'request_id': 'req-a4609434-3a5c-4f9b-938f-35e2645d45d4'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:48.065630 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-a4609434-3a5c-4f9b-938f-35e2645d45d4 admin admin] The token cache is being invalidate because project 09e25051d5da44a4b14600f46543c164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:55:48.066216 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-a4609434-3a5c-4f9b-938f-35e2645d45d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:48.067239 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-a4609434-3a5c-4f9b-938f-35e2645d45d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:48.070006 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1109/2199] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:55:47 2022] DELETE /identity/v3/projects/09e25051d5da44a4b14600f46543c164 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:48.078863 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895837e-f51c-4e39-9c20-dee1f8d79d6c service neutron] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:48.103074 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895837e-f51c-4e39-9c20-dee1f8d79d6c service neutron] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:48.259163 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197948f-35f1-4b74-8b90-73b4de3499ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:48.261581 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197948f-35f1-4b74-8b90-73b4de3499ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:48.262100 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197948f-35f1-4b74-8b90-73b4de3499ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:48.262665 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197948f-35f1-4b74-8b90-73b4de3499ec admin admin] PATH_INFO: `/v3/users/ce67d328337f4ac199e63436b4d3bc8e` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:48.289982 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1197948f-35f1-4b74-8b90-73b4de3499ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce67d328337f4ac199e63436b4d3bc8e)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:48.293051 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1197948f-35f1-4b74-8b90-73b4de3499ec admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:48.381267 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-1197948f-35f1-4b74-8b90-73b4de3499ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce67d328337f4ac199e63436b4d3bc8e'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:48.395006 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-1197948f-35f1-4b74-8b90-73b4de3499ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce67d328337f4ac199e63436b4d3bc8e'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:48.401851 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-1197948f-35f1-4b74-8b90-73b4de3499ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce67d328337f4ac199e63436b4d3bc8e'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:48.427709 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-1197948f-35f1-4b74-8b90-73b4de3499ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce67d328337f4ac199e63436b4d3bc8e'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:48.428688 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-1197948f-35f1-4b74-8b90-73b4de3499ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce67d328337f4ac199e63436b4d3bc8e'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:48.450999 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1091/2200] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:55:48 2022] DELETE /identity/v3/users/ce67d328337f4ac199e63436b4d3bc8e => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:49.074917 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4609434-3a5c-4f9b-938f-35e2645d45d4 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:49.078679 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-a4609434-3a5c-4f9b-938f-35e2645d45d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:49.139520 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4609434-3a5c-4f9b-938f-35e2645d45d4 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:49.390680 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b875e8b-93eb-47b9-a07a-6d4e8aa75353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:49.391575 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b875e8b-93eb-47b9-a07a-6d4e8aa75353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:49.391884 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b875e8b-93eb-47b9-a07a-6d4e8aa75353 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:49.392154 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b875e8b-93eb-47b9-a07a-6d4e8aa75353 admin admin] PATH_INFO: `/v3/projects/1da7b26c4e6243e88c74ad293dfe7236` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:49.394523 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b875e8b-93eb-47b9-a07a-6d4e8aa75353 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1da7b26c4e6243e88c74ad293dfe7236)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:49.396677 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b875e8b-93eb-47b9-a07a-6d4e8aa75353 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:49.528888 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-6b875e8b-93eb-47b9-a07a-6d4e8aa75353 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1da7b26c4e6243e88c74ad293dfe7236', 'request_id': 'req-6b875e8b-93eb-47b9-a07a-6d4e8aa75353'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:49.549544 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-6b875e8b-93eb-47b9-a07a-6d4e8aa75353 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1da7b26c4e6243e88c74ad293dfe7236', 'request_id': 'req-6b875e8b-93eb-47b9-a07a-6d4e8aa75353'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:49.567657 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-6b875e8b-93eb-47b9-a07a-6d4e8aa75353 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1da7b26c4e6243e88c74ad293dfe7236', 'request_id': 'req-6b875e8b-93eb-47b9-a07a-6d4e8aa75353'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:49.598353 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-6b875e8b-93eb-47b9-a07a-6d4e8aa75353 admin admin] The token cache is being invalidate because project 1da7b26c4e6243e88c74ad293dfe7236 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:55:49.599218 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-6b875e8b-93eb-47b9-a07a-6d4e8aa75353 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:49.600924 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-6b875e8b-93eb-47b9-a07a-6d4e8aa75353 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:49.612282 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6ab64-3d88-4783-b3db-547cdd5f0ccc None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:49.613308 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6ab64-3d88-4783-b3db-547cdd5f0ccc None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:49.613910 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6ab64-3d88-4783-b3db-547cdd5f0ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:49.615397 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1110/2201] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:55:49 2022] DELETE /identity/v3/projects/1da7b26c4e6243e88c74ad293dfe7236 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:49.640604 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-81f6ab64-3d88-4783-b3db-547cdd5f0ccc None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:49.642154 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-81f6ab64-3d88-4783-b3db-547cdd5f0ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:49.737428 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1092/2202] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:55:49.747311 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb40354-14db-4054-b773-83bf843751aa None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:49.747503 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb40354-14db-4054-b773-83bf843751aa None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:49.747852 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb40354-14db-4054-b773-83bf843751aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:49.787534 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-cfb40354-14db-4054-b773-83bf843751aa None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:49.788850 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-cfb40354-14db-4054-b773-83bf843751aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:49.828555 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1111/2203] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:55:49.831078 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6ab64-3d88-4783-b3db-547cdd5f0ccc None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:49.851320 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6ab64-3d88-4783-b3db-547cdd5f0ccc None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:49.862195 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59bb9e-c508-4303-8147-bd07e9e1b99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:49.863370 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59bb9e-c508-4303-8147-bd07e9e1b99b admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:49.863370 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59bb9e-c508-4303-8147-bd07e9e1b99b admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:49.866200 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59bb9e-c508-4303-8147-bd07e9e1b99b admin admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:49.867081 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59bb9e-c508-4303-8147-bd07e9e1b99b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:55:49.867400 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59bb9e-c508-4303-8147-bd07e9e1b99b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:49.869124 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59bb9e-c508-4303-8147-bd07e9e1b99b admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:49.884883 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1093/2204] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:55:49.892958 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb40354-14db-4054-b773-83bf843751aa None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:49.918129 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb40354-14db-4054-b773-83bf843751aa None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:49.929747 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b5414-bfa6-4913-9f02-7c532edce5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:49.930863 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b5414-bfa6-4913-9f02-7c532edce5a4 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:49.931363 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b5414-bfa6-4913-9f02-7c532edce5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:49.931896 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b5414-bfa6-4913-9f02-7c532edce5a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:49.933636 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b5414-bfa6-4913-9f02-7c532edce5a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:49.937484 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b5414-bfa6-4913-9f02-7c532edce5a4 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:49.984024 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1112/2205] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:55:49 2022] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:55:49.984709 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59bb9e-c508-4303-8147-bd07e9e1b99b admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:49.997573 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59bb9e-c508-4303-8147-bd07e9e1b99b admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:50.069647 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bad84-f6a3-43eb-92a8-521a07fd83bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:50.070320 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bad84-f6a3-43eb-92a8-521a07fd83bf admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:50.070681 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bad84-f6a3-43eb-92a8-521a07fd83bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:50.070964 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bad84-f6a3-43eb-92a8-521a07fd83bf admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:50.071778 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329bad84-f6a3-43eb-92a8-521a07fd83bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:50.073985 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329bad84-f6a3-43eb-92a8-521a07fd83bf admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:50.101683 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1094/2206] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:55:49 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:55:50.108577 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b5414-bfa6-4913-9f02-7c532edce5a4 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:50.125232 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b5414-bfa6-4913-9f02-7c532edce5a4 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:50.141938 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08f245-6856-47aa-bc92-65c3889a71ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:50.143154 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08f245-6856-47aa-bc92-65c3889a71ea admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:50.143658 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08f245-6856-47aa-bc92-65c3889a71ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:50.144198 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08f245-6856-47aa-bc92-65c3889a71ea admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:50.146996 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08f245-6856-47aa-bc92-65c3889a71ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:50.150434 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08f245-6856-47aa-bc92-65c3889a71ea admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:50.179991 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1113/2207] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:55:50.188767 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bad84-f6a3-43eb-92a8-521a07fd83bf admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:50.222323 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bad84-f6a3-43eb-92a8-521a07fd83bf admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:50.236042 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa5a34-b530-4f2c-9079-1f8267d0e765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:50.237345 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa5a34-b530-4f2c-9079-1f8267d0e765 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:50.238161 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa5a34-b530-4f2c-9079-1f8267d0e765 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:50.238731 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa5a34-b530-4f2c-9079-1f8267d0e765 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:50.240260 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa5a34-b530-4f2c-9079-1f8267d0e765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:50.243534 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa5a34-b530-4f2c-9079-1f8267d0e765 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:50.281643 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08f245-6856-47aa-bc92-65c3889a71ea admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:50.281949 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1095/2208] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:55:50.294132 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08f245-6856-47aa-bc92-65c3889a71ea admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:50.300515 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08774d-ab12-4419-893a-1a04c9cc1652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:50.301844 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08774d-ab12-4419-893a-1a04c9cc1652 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:50.302281 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08774d-ab12-4419-893a-1a04c9cc1652 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:50.302941 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08774d-ab12-4419-893a-1a04c9cc1652 admin admin] PATH_INFO: `/v3/projects/212a81f1908243dfa26753c3c97b8b86/users/e6894bda036d4f44bbfc88d7b91b162d/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:50.330357 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08774d-ab12-4419-893a-1a04c9cc1652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=212a81f1908243dfa26753c3c97b8b86, user_id=e6894bda036d4f44bbfc88d7b91b162d, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:50.333754 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08774d-ab12-4419-893a-1a04c9cc1652 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:50.359253 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1114/2209] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:55:50 2022] PUT /identity/v3/projects/212a81f1908243dfa26753c3c97b8b86/users/e6894bda036d4f44bbfc88d7b91b162d/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:50.386023 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40166338-d2b8-46f7-9bea-e20cd12e397f None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:50.386446 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40166338-d2b8-46f7-9bea-e20cd12e397f None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:50.388049 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40166338-d2b8-46f7-9bea-e20cd12e397f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:50.485564 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-40166338-d2b8-46f7-9bea-e20cd12e397f None None] MFA Rules not processed for user `e6894bda036d4f44bbfc88d7b91b162d`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:50.486975 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-40166338-d2b8-46f7-9bea-e20cd12e397f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:50.629754 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1096/2210] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:55:50.655363 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08774d-ab12-4419-893a-1a04c9cc1652 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:50.659287 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-8c08774d-ab12-4419-893a-1a04c9cc1652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:51.083498 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08774d-ab12-4419-893a-1a04c9cc1652 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:51.113026 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f15e4-b8dd-445c-99f0-a488497a4f41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:51.115564 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f15e4-b8dd-445c-99f0-a488497a4f41 service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:51.115895 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f15e4-b8dd-445c-99f0-a488497a4f41 service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:51.118611 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f15e4-b8dd-445c-99f0-a488497a4f41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:51.144962 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f15e4-b8dd-445c-99f0-a488497a4f41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:51.150525 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f15e4-b8dd-445c-99f0-a488497a4f41 service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:51.204850 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1115/2211] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:55:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:55:51.327201 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750145c-d90f-4087-9664-10110ad28db6 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:51.327492 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750145c-d90f-4087-9664-10110ad28db6 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:51.327854 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750145c-d90f-4087-9664-10110ad28db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:51.410368 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-c750145c-d90f-4087-9664-10110ad28db6 None None] MFA Rules not processed for user `78cde480dd8b4a85ac30895026bfc406`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:51.412978 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-c750145c-d90f-4087-9664-10110ad28db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:51.555126 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1097/2212] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Oct 28 20:55:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:55:51.558574 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f15e4-b8dd-445c-99f0-a488497a4f41 service cinder] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:51.562449 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-6e1f15e4-b8dd-445c-99f0-a488497a4f41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:51.806130 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f15e4-b8dd-445c-99f0-a488497a4f41 service cinder] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:51.834837 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1083c94-0b88-48eb-a6a0-c83b2c7919e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d70db11d2d4923943bc6479bc49206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:51.838018 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1083c94-0b88-48eb-a6a0-c83b2c7919e3 service swift] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:51.838528 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1083c94-0b88-48eb-a6a0-c83b2c7919e3 service swift] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:51.840143 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1083c94-0b88-48eb-a6a0-c83b2c7919e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:51.872648 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1083c94-0b88-48eb-a6a0-c83b2c7919e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:51.884140 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1083c94-0b88-48eb-a6a0-c83b2c7919e3 service swift] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:51.917554 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1116/2213] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Oct 28 20:55:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 20:55:55.434948 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750145c-d90f-4087-9664-10110ad28db6 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:55.692414 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750145c-d90f-4087-9664-10110ad28db6 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:55.708633 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448ecd9-374c-4880-88f8-55b33b58392a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:55.709534 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448ecd9-374c-4880-88f8-55b33b58392a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:55.709815 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448ecd9-374c-4880-88f8-55b33b58392a admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:55.710089 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448ecd9-374c-4880-88f8-55b33b58392a admin admin] PATH_INFO: `/v3/users/e6894bda036d4f44bbfc88d7b91b162d` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:55.711397 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448ecd9-374c-4880-88f8-55b33b58392a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6894bda036d4f44bbfc88d7b91b162d)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:55.713408 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448ecd9-374c-4880-88f8-55b33b58392a admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:55.803287 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0448ecd9-374c-4880-88f8-55b33b58392a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6894bda036d4f44bbfc88d7b91b162d'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:55.823513 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0448ecd9-374c-4880-88f8-55b33b58392a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6894bda036d4f44bbfc88d7b91b162d'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:55.825637 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0448ecd9-374c-4880-88f8-55b33b58392a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6894bda036d4f44bbfc88d7b91b162d'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:55.856080 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0448ecd9-374c-4880-88f8-55b33b58392a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6894bda036d4f44bbfc88d7b91b162d'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:55.859201 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0448ecd9-374c-4880-88f8-55b33b58392a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6894bda036d4f44bbfc88d7b91b162d'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:55.887106 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1098/2214] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:55:55 2022] DELETE /identity/v3/users/e6894bda036d4f44bbfc88d7b91b162d => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:55.891511 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09326c7d-568a-48b3-826f-81573c089375 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:55.892432 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09326c7d-568a-48b3-826f-81573c089375 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:55.892432 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09326c7d-568a-48b3-826f-81573c089375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:55.942123 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-09326c7d-568a-48b3-826f-81573c089375 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:55.943442 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-09326c7d-568a-48b3-826f-81573c089375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:56.200831 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1117/2215] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:55:56.246663 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448ecd9-374c-4880-88f8-55b33b58392a admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:56.252584 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-0448ecd9-374c-4880-88f8-55b33b58392a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:56.514164 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448ecd9-374c-4880-88f8-55b33b58392a admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:56.519920 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3110aa76-3bb6-41a6-8220-e32fd3e0dcc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:56.521841 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110aa76-3bb6-41a6-8220-e32fd3e0dcc4 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:56.522930 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110aa76-3bb6-41a6-8220-e32fd3e0dcc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:56.523458 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110aa76-3bb6-41a6-8220-e32fd3e0dcc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:56.540187 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3110aa76-3bb6-41a6-8220-e32fd3e0dcc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:56.542524 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3110aa76-3bb6-41a6-8220-e32fd3e0dcc4 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:56.562274 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1099/2216] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:55:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:55:57.239481 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09326c7d-568a-48b3-826f-81573c089375 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:57.241870 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-09326c7d-568a-48b3-826f-81573c089375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:57.267590 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09326c7d-568a-48b3-826f-81573c089375 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:57.286137 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26e7f4-34b6-40b0-bc50-46e732c1f18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:57.291574 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26e7f4-34b6-40b0-bc50-46e732c1f18a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:57.292660 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26e7f4-34b6-40b0-bc50-46e732c1f18a admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:57.294002 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26e7f4-34b6-40b0-bc50-46e732c1f18a admin admin] PATH_INFO: `/v3/projects/212a81f1908243dfa26753c3c97b8b86` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:57.298775 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26e7f4-34b6-40b0-bc50-46e732c1f18a admin admin] RBAC: Authorizing `identity:delete_project(project_id=212a81f1908243dfa26753c3c97b8b86)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:57.301393 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26e7f4-34b6-40b0-bc50-46e732c1f18a admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:57.474234 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ec26e7f4-34b6-40b0-bc50-46e732c1f18a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '212a81f1908243dfa26753c3c97b8b86', 'request_id': 'req-ec26e7f4-34b6-40b0-bc50-46e732c1f18a'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:57.482289 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ec26e7f4-34b6-40b0-bc50-46e732c1f18a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '212a81f1908243dfa26753c3c97b8b86', 'request_id': 'req-ec26e7f4-34b6-40b0-bc50-46e732c1f18a'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:57.504063 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ec26e7f4-34b6-40b0-bc50-46e732c1f18a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '212a81f1908243dfa26753c3c97b8b86', 'request_id': 'req-ec26e7f4-34b6-40b0-bc50-46e732c1f18a'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:57.520128 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ec26e7f4-34b6-40b0-bc50-46e732c1f18a admin admin] The token cache is being invalidate because project 212a81f1908243dfa26753c3c97b8b86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:55:57.520787 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ec26e7f4-34b6-40b0-bc50-46e732c1f18a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:57.521744 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ec26e7f4-34b6-40b0-bc50-46e732c1f18a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:55:57.528028 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1118/2217] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:55:57 2022] DELETE /identity/v3/projects/212a81f1908243dfa26753c3c97b8b86 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:57.530446 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c6603-cddf-41da-9c6f-b9bf6f8a525b None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:57.531884 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c6603-cddf-41da-9c6f-b9bf6f8a525b None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:57.533522 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c6603-cddf-41da-9c6f-b9bf6f8a525b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:57.574638 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-f13c6603-cddf-41da-9c6f-b9bf6f8a525b None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:57.577574 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-f13c6603-cddf-41da-9c6f-b9bf6f8a525b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:57.702218 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1100/2218] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:55:57.705320 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e27a37-e0f2-4bba-a936-89214d0efb59 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:57.705953 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e27a37-e0f2-4bba-a936-89214d0efb59 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:57.706418 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e27a37-e0f2-4bba-a936-89214d0efb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:57.747345 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-84e27a37-e0f2-4bba-a936-89214d0efb59 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:57.749968 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-84e27a37-e0f2-4bba-a936-89214d0efb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:57.777272 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1119/2219] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:55:57.778842 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c6603-cddf-41da-9c6f-b9bf6f8a525b None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:57.796682 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c6603-cddf-41da-9c6f-b9bf6f8a525b None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:57.803094 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33af4c-98c9-4286-98af-a827c8d2941d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:57.804213 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33af4c-98c9-4286-98af-a827c8d2941d admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:57.804753 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33af4c-98c9-4286-98af-a827c8d2941d admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:57.805061 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33af4c-98c9-4286-98af-a827c8d2941d admin admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:57.805848 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b33af4c-98c9-4286-98af-a827c8d2941d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:55:57.806360 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b33af4c-98c9-4286-98af-a827c8d2941d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:57.808341 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b33af4c-98c9-4286-98af-a827c8d2941d admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:57.825659 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1101/2220] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:55:57.833618 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e27a37-e0f2-4bba-a936-89214d0efb59 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:57.879191 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e27a37-e0f2-4bba-a936-89214d0efb59 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:57.892263 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5576b-1494-415d-851b-dc4a18874753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:57.893421 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5576b-1494-415d-851b-dc4a18874753 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:57.893923 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5576b-1494-415d-851b-dc4a18874753 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:57.894410 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5576b-1494-415d-851b-dc4a18874753 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:57.895716 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab5576b-1494-415d-851b-dc4a18874753 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:57.900423 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab5576b-1494-415d-851b-dc4a18874753 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:57.978238 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1120/2221] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:55:57 2022] POST /identity/v3/projects => generated 367 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:55:57.979667 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33af4c-98c9-4286-98af-a827c8d2941d admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:58.000755 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33af4c-98c9-4286-98af-a827c8d2941d admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:58.146285 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac1938-de57-4fe7-a729-cc4bf14f1031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:58.147385 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac1938-de57-4fe7-a729-cc4bf14f1031 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:58.148211 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac1938-de57-4fe7-a729-cc4bf14f1031 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:58.149035 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac1938-de57-4fe7-a729-cc4bf14f1031 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:58.149837 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac1938-de57-4fe7-a729-cc4bf14f1031 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:58.151942 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac1938-de57-4fe7-a729-cc4bf14f1031 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:58.181078 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1102/2222] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:55:57 2022] POST /identity/v3/users => generated 284 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:55:58.186879 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5576b-1494-415d-851b-dc4a18874753 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:58.220414 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5576b-1494-415d-851b-dc4a18874753 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:58.233599 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ad6de-9c4d-47a5-936a-6e6349191b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:58.234661 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ad6de-9c4d-47a5-936a-6e6349191b9a admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:58.235012 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ad6de-9c4d-47a5-936a-6e6349191b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:58.235701 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ad6de-9c4d-47a5-936a-6e6349191b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:58.236826 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ad6de-9c4d-47a5-936a-6e6349191b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:58.239145 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ad6de-9c4d-47a5-936a-6e6349191b9a admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:58.260168 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac1938-de57-4fe7-a729-cc4bf14f1031 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:58.273148 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1121/2223] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:55:58.284431 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac1938-de57-4fe7-a729-cc4bf14f1031 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:58.291325 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ce48e-0ba9-4410-8634-f171b15f8208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:58.291928 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ce48e-0ba9-4410-8634-f171b15f8208 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:58.292306 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ce48e-0ba9-4410-8634-f171b15f8208 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:58.292578 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ce48e-0ba9-4410-8634-f171b15f8208 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:58.293420 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0ce48e-0ba9-4410-8634-f171b15f8208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:58.297133 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0ce48e-0ba9-4410-8634-f171b15f8208 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:58.315077 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1103/2224] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:55:58.318180 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ad6de-9c4d-47a5-936a-6e6349191b9a admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:58.354193 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ad6de-9c4d-47a5-936a-6e6349191b9a admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:58.367102 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f19a83-0203-4748-95e2-434582e55c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:58.369955 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f19a83-0203-4748-95e2-434582e55c68 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:58.371650 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f19a83-0203-4748-95e2-434582e55c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:58.372378 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f19a83-0203-4748-95e2-434582e55c68 admin admin] PATH_INFO: `/v3/projects/57602dbb273d49089487090ccb2d547c/users/a862864ab3fd4951a044225cfd8d5903/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:58.403914 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f19a83-0203-4748-95e2-434582e55c68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57602dbb273d49089487090ccb2d547c, user_id=a862864ab3fd4951a044225cfd8d5903, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:58.415805 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f19a83-0203-4748-95e2-434582e55c68 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:58.441777 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1122/2225] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:55:58 2022] PUT /identity/v3/projects/57602dbb273d49089487090ccb2d547c/users/a862864ab3fd4951a044225cfd8d5903/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:55:58.452673 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58459a-9f60-4fd5-a953-992d210cb4f6 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:58.453908 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58459a-9f60-4fd5-a953-992d210cb4f6 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:58.454402 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58459a-9f60-4fd5-a953-992d210cb4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:58.534035 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-0d58459a-9f60-4fd5-a953-992d210cb4f6 None None] MFA Rules not processed for user `a862864ab3fd4951a044225cfd8d5903`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:55:58.536139 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-0d58459a-9f60-4fd5-a953-992d210cb4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:58.737244 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1104/2226] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:55:58 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:55:58.766152 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f19a83-0203-4748-95e2-434582e55c68 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:55:58.768780 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-b4f19a83-0203-4748-95e2-434582e55c68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:55:58.958149 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f19a83-0203-4748-95e2-434582e55c68 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:55:58.963670 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccce2ea-3c84-4c8b-bb49-3fdcb7876e26 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05029a41bd2b42febfd5ce91a3f28c24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:55:58.965167 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccce2ea-3c84-4c8b-bb49-3fdcb7876e26 service glance] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:55:58.965542 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccce2ea-3c84-4c8b-bb49-3fdcb7876e26 service glance] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:55:58.966097 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccce2ea-3c84-4c8b-bb49-3fdcb7876e26 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:55:58.977365 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccce2ea-3c84-4c8b-bb49-3fdcb7876e26 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:55:58.979039 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccce2ea-3c84-4c8b-bb49-3fdcb7876e26 service glance] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:55:58.995848 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1123/2227] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:55:58 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:56:16.117730 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1a231-1cff-4e2d-95b4-3919618979ae None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:56:16.118280 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1a231-1cff-4e2d-95b4-3919618979ae None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:56:16.118672 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1a231-1cff-4e2d-95b4-3919618979ae None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:56:16.122274 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1105/2228] 10.222.0.49 () {54 vars in 921 bytes} [Fri Oct 28 20:56:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:56:16.132095 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f187679-9f55-4799-8489-bb4ce34f1e3f None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:56:16.132985 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f187679-9f55-4799-8489-bb4ce34f1e3f None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:56:16.132985 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f187679-9f55-4799-8489-bb4ce34f1e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:56:16.193389 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-6f187679-9f55-4799-8489-bb4ce34f1e3f None None] MFA Rules not processed for user `04bc6ee009e34a5f82e2807db51523d3`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:56:16.194741 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-6f187679-9f55-4799-8489-bb4ce34f1e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:56:16.318986 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1124/2229] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Oct 28 20:56:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:56:16.334136 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1a231-1cff-4e2d-95b4-3919618979ae None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:56:16.373836 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1a231-1cff-4e2d-95b4-3919618979ae None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:56:16.377858 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4fefe-32d7-4c2c-9b79-12665332d82a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05029a41bd2b42febfd5ce91a3f28c24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:56:16.378520 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4fefe-32d7-4c2c-9b79-12665332d82a service glance] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:56:16.378794 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4fefe-32d7-4c2c-9b79-12665332d82a service glance] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:56:16.379061 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4fefe-32d7-4c2c-9b79-12665332d82a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:56:16.390879 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f4fefe-32d7-4c2c-9b79-12665332d82a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:56:16.392368 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f4fefe-32d7-4c2c-9b79-12665332d82a service glance] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:56:16.404667 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1106/2230] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:56:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:56:16.481501 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909aa4cd-0002-4cba-92c0-8c8a71e9e4cf None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:56:16.482081 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909aa4cd-0002-4cba-92c0-8c8a71e9e4cf None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:56:16.482605 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909aa4cd-0002-4cba-92c0-8c8a71e9e4cf None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:56:16.485466 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1125/2231] 10.222.0.49 () {54 vars in 921 bytes} [Fri Oct 28 20:56:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:56:16.490979 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d81f87-a429-403b-be3f-f7d130962d5c None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:56:16.491284 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d81f87-a429-403b-be3f-f7d130962d5c None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:56:16.491518 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d81f87-a429-403b-be3f-f7d130962d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:56:16.511083 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-45d81f87-a429-403b-be3f-f7d130962d5c None None] MFA Rules not processed for user `691a2da563a84da48ca8fd75a0bfe787`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:56:16.512324 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-45d81f87-a429-403b-be3f-f7d130962d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:56:16.583549 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1107/2232] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Oct 28 20:56:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:56:16.597689 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909aa4cd-0002-4cba-92c0-8c8a71e9e4cf None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:56:16.599646 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-909aa4cd-0002-4cba-92c0-8c8a71e9e4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:56:16.613948 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909aa4cd-0002-4cba-92c0-8c8a71e9e4cf None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:56:16.617799 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b65401-d04e-4591-b655-d9321edff309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:56:16.618458 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b65401-d04e-4591-b655-d9321edff309 service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:56:16.618886 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b65401-d04e-4591-b655-d9321edff309 service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:56:16.619154 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b65401-d04e-4591-b655-d9321edff309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:56:16.632347 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b65401-d04e-4591-b655-d9321edff309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:56:16.632347 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b65401-d04e-4591-b655-d9321edff309 service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:56:16.646613 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1126/2233] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:56:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:56:16.756779 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d3223-baa8-4b8a-a496-6e879514801b None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:56:16.757088 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d3223-baa8-4b8a-a496-6e879514801b None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:56:16.757325 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d3223-baa8-4b8a-a496-6e879514801b None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:56:16.759152 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1108/2234] 10.222.0.49 () {54 vars in 921 bytes} [Fri Oct 28 20:56:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:56:16.766768 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0db20-6b16-43ce-9b67-934ba82f9417 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:56:16.767167 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0db20-6b16-43ce-9b67-934ba82f9417 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:56:16.767658 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0db20-6b16-43ce-9b67-934ba82f9417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:56:16.788505 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-1ad0db20-6b16-43ce-9b67-934ba82f9417 None None] MFA Rules not processed for user `04bc6ee009e34a5f82e2807db51523d3`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:56:16.792363 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-1ad0db20-6b16-43ce-9b67-934ba82f9417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:56:16.802104 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1127/2235] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Oct 28 20:56:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:56:16.813899 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d3223-baa8-4b8a-a496-6e879514801b None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:56:16.827456 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d3223-baa8-4b8a-a496-6e879514801b None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:56:16.831907 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7345891-d9e4-4a9b-89e8-805e38a53fad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:56:16.832744 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7345891-d9e4-4a9b-89e8-805e38a53fad service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:56:16.833163 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7345891-d9e4-4a9b-89e8-805e38a53fad service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:56:16.833577 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7345891-d9e4-4a9b-89e8-805e38a53fad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:56:16.847965 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7345891-d9e4-4a9b-89e8-805e38a53fad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:56:16.849527 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7345891-d9e4-4a9b-89e8-805e38a53fad service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:56:16.863437 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1109/2236] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:56:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:56:19.856353 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61bb88-e98f-4770-953b-829075036ebe None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:56:19.857669 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61bb88-e98f-4770-953b-829075036ebe None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:56:19.857861 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61bb88-e98f-4770-953b-829075036ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:56:19.956485 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-2f61bb88-e98f-4770-953b-829075036ebe None None] MFA Rules not processed for user `78cde480dd8b4a85ac30895026bfc406`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:56:19.957974 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-2f61bb88-e98f-4770-953b-829075036ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:56:20.081518 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1128/2237] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Oct 28 20:56:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:56:20.104339 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7345891-d9e4-4a9b-89e8-805e38a53fad service neutron] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:56:20.106201 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-f7345891-d9e4-4a9b-89e8-805e38a53fad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:56:20.312140 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7345891-d9e4-4a9b-89e8-805e38a53fad service neutron] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:56:20.318440 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197eef6-fa45-4ba0-a4fe-0b7bff3badd5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d70db11d2d4923943bc6479bc49206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:56:20.319202 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197eef6-fa45-4ba0-a4fe-0b7bff3badd5 service swift] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:56:20.319540 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197eef6-fa45-4ba0-a4fe-0b7bff3badd5 service swift] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:56:20.320001 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197eef6-fa45-4ba0-a4fe-0b7bff3badd5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:56:20.333218 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197eef6-fa45-4ba0-a4fe-0b7bff3badd5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:56:20.337001 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197eef6-fa45-4ba0-a4fe-0b7bff3badd5 service swift] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:56:20.348355 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1110/2238] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Oct 28 20:56:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 20:56:32.605581 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61bb88-e98f-4770-953b-829075036ebe None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:56:32.679275 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61bb88-e98f-4770-953b-829075036ebe None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:56:32.684005 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beffaab-fd59-41d8-b808-6567cd9b755d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:56:32.684917 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beffaab-fd59-41d8-b808-6567cd9b755d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:56:32.685199 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beffaab-fd59-41d8-b808-6567cd9b755d admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:56:32.685468 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beffaab-fd59-41d8-b808-6567cd9b755d admin admin] PATH_INFO: `/v3/users/a862864ab3fd4951a044225cfd8d5903` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:56:32.686701 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beffaab-fd59-41d8-b808-6567cd9b755d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a862864ab3fd4951a044225cfd8d5903)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:56:32.688750 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beffaab-fd59-41d8-b808-6567cd9b755d admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:56:32.742071 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-4beffaab-fd59-41d8-b808-6567cd9b755d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a862864ab3fd4951a044225cfd8d5903'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:56:32.748729 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-4beffaab-fd59-41d8-b808-6567cd9b755d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a862864ab3fd4951a044225cfd8d5903'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:56:32.758396 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-4beffaab-fd59-41d8-b808-6567cd9b755d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a862864ab3fd4951a044225cfd8d5903'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:56:32.759097 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-4beffaab-fd59-41d8-b808-6567cd9b755d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a862864ab3fd4951a044225cfd8d5903'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:56:32.775843 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-4beffaab-fd59-41d8-b808-6567cd9b755d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a862864ab3fd4951a044225cfd8d5903'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:56:32.784018 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1129/2239] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:56:32 2022] DELETE /identity/v3/users/a862864ab3fd4951a044225cfd8d5903 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:56:32.788603 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf3d09-3890-4913-820a-dd2e0aeff0ec None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:56:32.789279 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf3d09-3890-4913-820a-dd2e0aeff0ec None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:56:32.789444 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf3d09-3890-4913-820a-dd2e0aeff0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:56:32.809318 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-9eaf3d09-3890-4913-820a-dd2e0aeff0ec None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:56:32.811152 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-9eaf3d09-3890-4913-820a-dd2e0aeff0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:56:32.896578 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1111/2240] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:56:32.907519 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beffaab-fd59-41d8-b808-6567cd9b755d admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:56:32.909757 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-4beffaab-fd59-41d8-b808-6567cd9b755d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:56:32.989843 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beffaab-fd59-41d8-b808-6567cd9b755d admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:56:33.000178 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97201d2b-a284-47ef-9d02-590593273645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:56:33.000178 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97201d2b-a284-47ef-9d02-590593273645 service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:56:33.000178 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97201d2b-a284-47ef-9d02-590593273645 service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:56:33.000178 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97201d2b-a284-47ef-9d02-590593273645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:56:33.014937 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97201d2b-a284-47ef-9d02-590593273645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:56:33.016645 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97201d2b-a284-47ef-9d02-590593273645 service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:56:33.027864 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1130/2241] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:56:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:56:33.416689 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf3d09-3890-4913-820a-dd2e0aeff0ec None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:56:33.418238 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-9eaf3d09-3890-4913-820a-dd2e0aeff0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:56:33.438553 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf3d09-3890-4913-820a-dd2e0aeff0ec None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:56:33.450995 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51d3d2-e033-4ccc-8641-240f472e334c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:56:33.451949 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51d3d2-e033-4ccc-8641-240f472e334c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:56:33.452233 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51d3d2-e033-4ccc-8641-240f472e334c admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:56:33.452504 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51d3d2-e033-4ccc-8641-240f472e334c admin admin] PATH_INFO: `/v3/projects/57602dbb273d49089487090ccb2d547c` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:56:33.455715 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51d3d2-e033-4ccc-8641-240f472e334c admin admin] RBAC: Authorizing `identity:delete_project(project_id=57602dbb273d49089487090ccb2d547c)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:56:33.460221 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51d3d2-e033-4ccc-8641-240f472e334c admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:56:33.557756 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-6d51d3d2-e033-4ccc-8641-240f472e334c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57602dbb273d49089487090ccb2d547c', 'request_id': 'req-6d51d3d2-e033-4ccc-8641-240f472e334c'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:56:33.565449 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-6d51d3d2-e033-4ccc-8641-240f472e334c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57602dbb273d49089487090ccb2d547c', 'request_id': 'req-6d51d3d2-e033-4ccc-8641-240f472e334c'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:56:33.574513 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-6d51d3d2-e033-4ccc-8641-240f472e334c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57602dbb273d49089487090ccb2d547c', 'request_id': 'req-6d51d3d2-e033-4ccc-8641-240f472e334c'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:56:33.593080 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-6d51d3d2-e033-4ccc-8641-240f472e334c admin admin] The token cache is being invalidate because project 57602dbb273d49089487090ccb2d547c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:56:33.593381 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-6d51d3d2-e033-4ccc-8641-240f472e334c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:56:33.596473 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-6d51d3d2-e033-4ccc-8641-240f472e334c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:56:33.599144 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1112/2242] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:56:33 2022] DELETE /identity/v3/projects/57602dbb273d49089487090ccb2d547c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:56:33.605252 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d33453-d8ee-4e4a-8af2-cb205c33f9e5 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:56:33.605252 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d33453-d8ee-4e4a-8af2-cb205c33f9e5 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:56:33.605524 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d33453-d8ee-4e4a-8af2-cb205c33f9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:56:33.633051 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-a7d33453-d8ee-4e4a-8af2-cb205c33f9e5 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:56:33.634289 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-a7d33453-d8ee-4e4a-8af2-cb205c33f9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:56:33.728122 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1131/2243] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:56:33.741405 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43689261-2c5c-42d3-8f01-ae8459cd21a7 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:56:33.741879 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43689261-2c5c-42d3-8f01-ae8459cd21a7 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:56:33.742342 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43689261-2c5c-42d3-8f01-ae8459cd21a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:56:33.761737 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-43689261-2c5c-42d3-8f01-ae8459cd21a7 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:56:33.763122 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-43689261-2c5c-42d3-8f01-ae8459cd21a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:56:33.773079 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1113/2244] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:56:33.777970 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d33453-d8ee-4e4a-8af2-cb205c33f9e5 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:56:33.788727 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d33453-d8ee-4e4a-8af2-cb205c33f9e5 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:56:33.795994 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c3d01-1fb2-487a-bdd3-3f7737ee34a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:56:33.796801 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c3d01-1fb2-487a-bdd3-3f7737ee34a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:56:33.797128 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c3d01-1fb2-487a-bdd3-3f7737ee34a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:56:33.797500 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c3d01-1fb2-487a-bdd3-3f7737ee34a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:56:33.798208 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c3d01-1fb2-487a-bdd3-3f7737ee34a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:56:33.798561 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c3d01-1fb2-487a-bdd3-3f7737ee34a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:56:33.800285 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c3d01-1fb2-487a-bdd3-3f7737ee34a1 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:56:33.815087 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1132/2245] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:56:33.823972 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43689261-2c5c-42d3-8f01-ae8459cd21a7 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:56:33.835326 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43689261-2c5c-42d3-8f01-ae8459cd21a7 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:56:33.842993 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056bf27-f6af-4223-8a1a-6a4a6b146500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:56:33.843682 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056bf27-f6af-4223-8a1a-6a4a6b146500 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:56:33.844141 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056bf27-f6af-4223-8a1a-6a4a6b146500 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:56:33.844449 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056bf27-f6af-4223-8a1a-6a4a6b146500 admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:56:33.845175 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056bf27-f6af-4223-8a1a-6a4a6b146500 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:56:33.847359 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056bf27-f6af-4223-8a1a-6a4a6b146500 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:56:33.848871 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c3d01-1fb2-487a-bdd3-3f7737ee34a1 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:56:33.850965 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-e54c3d01-1fb2-487a-bdd3-3f7737ee34a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:56:33.881779 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1114/2246] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:56:33 2022] POST /identity/v3/projects => generated 399 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:56:33.886569 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056bf27-f6af-4223-8a1a-6a4a6b146500 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:56:33.935454 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c3d01-1fb2-487a-bdd3-3f7737ee34a1 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:56:33.961478 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056bf27-f6af-4223-8a1a-6a4a6b146500 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:56:33.969930 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb48e8-6573-4974-952e-924a95453357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:56:33.970941 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb48e8-6573-4974-952e-924a95453357 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:56:33.971243 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb48e8-6573-4974-952e-924a95453357 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:56:33.971516 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb48e8-6573-4974-952e-924a95453357 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:56:33.972263 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb48e8-6573-4974-952e-924a95453357 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:56:33.974224 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb48e8-6573-4974-952e-924a95453357 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:56:33.995354 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd51938-d981-4b8e-b714-a3c4a67f1a16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:56:33.996058 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd51938-d981-4b8e-b714-a3c4a67f1a16 service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:56:33.996361 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd51938-d981-4b8e-b714-a3c4a67f1a16 service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:56:33.996623 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd51938-d981-4b8e-b714-a3c4a67f1a16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:56:33.999979 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-9dd51938-d981-4b8e-b714-a3c4a67f1a16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:56:34.007470 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1115/2247] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:56:33 2022] POST /identity/v3/users => generated 300 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:56:34.011707 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb48e8-6573-4974-952e-924a95453357 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:56:34.023057 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb48e8-6573-4974-952e-924a95453357 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:56:34.030833 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a59e2-6c3c-4b52-9681-0946c0c849f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:56:34.031566 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a59e2-6c3c-4b52-9681-0946c0c849f9 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:56:34.031882 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a59e2-6c3c-4b52-9681-0946c0c849f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:56:34.032256 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a59e2-6c3c-4b52-9681-0946c0c849f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:56:34.032944 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a59e2-6c3c-4b52-9681-0946c0c849f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:56:34.034599 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a59e2-6c3c-4b52-9681-0946c0c849f9 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:56:34.054131 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1116/2248] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:56:34.058422 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a59e2-6c3c-4b52-9681-0946c0c849f9 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:56:34.071789 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a59e2-6c3c-4b52-9681-0946c0c849f9 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:56:34.077032 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406221aa-bd74-46a7-8664-453056076acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:56:34.077937 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406221aa-bd74-46a7-8664-453056076acd admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:56:34.078358 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406221aa-bd74-46a7-8664-453056076acd admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:56:34.078767 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406221aa-bd74-46a7-8664-453056076acd admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:56:34.079655 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406221aa-bd74-46a7-8664-453056076acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:56:34.081152 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd51938-d981-4b8e-b714-a3c4a67f1a16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:56:34.081810 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406221aa-bd74-46a7-8664-453056076acd admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:56:34.082611 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd51938-d981-4b8e-b714-a3c4a67f1a16 service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:56:34.094577 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1133/2249] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:56:33 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:56:34.094994 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1117/2250] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:56:34.100907 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd51938-d981-4b8e-b714-a3c4a67f1a16 service neutron] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:56:34.119842 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd51938-d981-4b8e-b714-a3c4a67f1a16 service neutron] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:56:34.128691 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a2767-411c-4491-8adb-1fab9242e908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:56:34.131001 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a2767-411c-4491-8adb-1fab9242e908 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:56:34.131504 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a2767-411c-4491-8adb-1fab9242e908 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:56:34.132728 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a2767-411c-4491-8adb-1fab9242e908 admin admin] PATH_INFO: `/v3/projects/6604959a0b904ed983e3ec1a26c362ba/users/018f4605f5104c59a786b6655130ec1f/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:56:34.155520 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a2767-411c-4491-8adb-1fab9242e908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6604959a0b904ed983e3ec1a26c362ba, user_id=018f4605f5104c59a786b6655130ec1f, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:56:34.158574 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a2767-411c-4491-8adb-1fab9242e908 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:56:34.178468 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1134/2251] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:56:34 2022] PUT /identity/v3/projects/6604959a0b904ed983e3ec1a26c362ba/users/018f4605f5104c59a786b6655130ec1f/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:56:34.199181 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fae4f6-f9c5-4769-a51f-5e7ef8e2cbd5 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:56:34.199472 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fae4f6-f9c5-4769-a51f-5e7ef8e2cbd5 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:56:34.199723 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fae4f6-f9c5-4769-a51f-5e7ef8e2cbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:56:34.236808 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-e9fae4f6-f9c5-4769-a51f-5e7ef8e2cbd5 None None] MFA Rules not processed for user `018f4605f5104c59a786b6655130ec1f`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:56:34.238203 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-e9fae4f6-f9c5-4769-a51f-5e7ef8e2cbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:56:34.341413 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1118/2252] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:56:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:56:34.357651 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a2767-411c-4491-8adb-1fab9242e908 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:56:34.360796 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-a94a2767-411c-4491-8adb-1fab9242e908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:56:34.448443 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a2767-411c-4491-8adb-1fab9242e908 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:56:34.454913 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fd1a9-351c-438c-a66d-48b03bc155b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:56:34.456086 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fd1a9-351c-438c-a66d-48b03bc155b3 service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:56:34.456590 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fd1a9-351c-438c-a66d-48b03bc155b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:56:34.457084 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fd1a9-351c-438c-a66d-48b03bc155b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:56:34.473750 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5fd1a9-351c-438c-a66d-48b03bc155b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:56:34.476447 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5fd1a9-351c-438c-a66d-48b03bc155b3 service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:56:34.493844 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1135/2253] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:56:34 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:56:40.342833 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fae4f6-f9c5-4769-a51f-5e7ef8e2cbd5 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:56:40.344404 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-e9fae4f6-f9c5-4769-a51f-5e7ef8e2cbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:56:40.416444 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fae4f6-f9c5-4769-a51f-5e7ef8e2cbd5 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:56:40.421015 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6816f-3a66-4ade-9278-782adabd597f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:56:40.421874 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6816f-3a66-4ade-9278-782adabd597f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:56:40.422148 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6816f-3a66-4ade-9278-782adabd597f admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:56:40.422437 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6816f-3a66-4ade-9278-782adabd597f admin admin] PATH_INFO: `/v3/users/9bbb8192591049bdb2bb1b6fc7a62036` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:56:40.423660 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a6816f-3a66-4ade-9278-782adabd597f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bbb8192591049bdb2bb1b6fc7a62036)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:56:40.425643 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a6816f-3a66-4ade-9278-782adabd597f admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:56:40.474293 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-05a6816f-3a66-4ade-9278-782adabd597f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bbb8192591049bdb2bb1b6fc7a62036'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:56:40.481263 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-05a6816f-3a66-4ade-9278-782adabd597f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bbb8192591049bdb2bb1b6fc7a62036'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:56:40.481976 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-05a6816f-3a66-4ade-9278-782adabd597f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bbb8192591049bdb2bb1b6fc7a62036'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:56:40.493451 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-05a6816f-3a66-4ade-9278-782adabd597f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bbb8192591049bdb2bb1b6fc7a62036'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:56:40.494074 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-05a6816f-3a66-4ade-9278-782adabd597f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bbb8192591049bdb2bb1b6fc7a62036'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:56:40.506877 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1119/2254] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:56:40 2022] DELETE /identity/v3/users/9bbb8192591049bdb2bb1b6fc7a62036 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:56:40.511484 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf36c9-864e-4f7e-abdd-f0fdc1599ecb None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:56:40.512024 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf36c9-864e-4f7e-abdd-f0fdc1599ecb None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:56:40.512504 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf36c9-864e-4f7e-abdd-f0fdc1599ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:56:40.531798 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-40bf36c9-864e-4f7e-abdd-f0fdc1599ecb None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:56:40.533044 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-40bf36c9-864e-4f7e-abdd-f0fdc1599ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:56:40.594688 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1136/2255] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:56:40.604351 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6816f-3a66-4ade-9278-782adabd597f admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:56:40.605654 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-05a6816f-3a66-4ade-9278-782adabd597f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:56:40.671985 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6816f-3a66-4ade-9278-782adabd597f admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:56:40.675698 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b5edc-e2ef-45a7-ad1a-857214ddd301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:56:40.676383 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b5edc-e2ef-45a7-ad1a-857214ddd301 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:56:40.676662 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b5edc-e2ef-45a7-ad1a-857214ddd301 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:56:40.676928 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b5edc-e2ef-45a7-ad1a-857214ddd301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:56:40.688932 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b5edc-e2ef-45a7-ad1a-857214ddd301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:56:40.690470 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b5edc-e2ef-45a7-ad1a-857214ddd301 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:56:40.702302 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1120/2256] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:56:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:56:41.045764 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf36c9-864e-4f7e-abdd-f0fdc1599ecb None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:56:41.047329 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-40bf36c9-864e-4f7e-abdd-f0fdc1599ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:56:41.061624 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf36c9-864e-4f7e-abdd-f0fdc1599ecb None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:56:41.067034 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d05af3-d31f-416f-9f78-915884f8f442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:56:41.067937 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d05af3-d31f-416f-9f78-915884f8f442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:56:41.068214 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d05af3-d31f-416f-9f78-915884f8f442 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:56:41.069122 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d05af3-d31f-416f-9f78-915884f8f442 admin admin] PATH_INFO: `/v3/projects/312b1bc4392741b5bc875ca9a7f3507b` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:56:41.070555 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d05af3-d31f-416f-9f78-915884f8f442 admin admin] RBAC: Authorizing `identity:delete_project(project_id=312b1bc4392741b5bc875ca9a7f3507b)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:56:41.072507 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d05af3-d31f-416f-9f78-915884f8f442 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:56:41.122589 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-b6d05af3-d31f-416f-9f78-915884f8f442 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '312b1bc4392741b5bc875ca9a7f3507b', 'request_id': 'req-b6d05af3-d31f-416f-9f78-915884f8f442'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:56:41.128449 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-b6d05af3-d31f-416f-9f78-915884f8f442 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '312b1bc4392741b5bc875ca9a7f3507b', 'request_id': 'req-b6d05af3-d31f-416f-9f78-915884f8f442'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:56:41.137208 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-b6d05af3-d31f-416f-9f78-915884f8f442 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '312b1bc4392741b5bc875ca9a7f3507b', 'request_id': 'req-b6d05af3-d31f-416f-9f78-915884f8f442'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:56:41.149859 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-b6d05af3-d31f-416f-9f78-915884f8f442 admin admin] The token cache is being invalidate because project 312b1bc4392741b5bc875ca9a7f3507b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:56:41.150211 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-b6d05af3-d31f-416f-9f78-915884f8f442 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:56:41.150930 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-b6d05af3-d31f-416f-9f78-915884f8f442 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:56:41.153609 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1137/2257] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:56:41 2022] DELETE /identity/v3/projects/312b1bc4392741b5bc875ca9a7f3507b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:56:42.966839 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b5edc-e2ef-45a7-ad1a-857214ddd301 service neutron] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:56:42.968347 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-468b5edc-e2ef-45a7-ad1a-857214ddd301 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:56:42.980767 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b5edc-e2ef-45a7-ad1a-857214ddd301 service neutron] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:56:43.047468 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ceab30-ae09-4604-9f24-6803a734fd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:56:43.048378 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ceab30-ae09-4604-9f24-6803a734fd02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:56:43.048645 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ceab30-ae09-4604-9f24-6803a734fd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:56:43.048913 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ceab30-ae09-4604-9f24-6803a734fd02 admin admin] PATH_INFO: `/v3/users/018f4605f5104c59a786b6655130ec1f` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:56:43.050130 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ceab30-ae09-4604-9f24-6803a734fd02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=018f4605f5104c59a786b6655130ec1f)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:56:43.052094 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ceab30-ae09-4604-9f24-6803a734fd02 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:56:43.101703 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-52ceab30-ae09-4604-9f24-6803a734fd02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '018f4605f5104c59a786b6655130ec1f'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:56:43.110322 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-52ceab30-ae09-4604-9f24-6803a734fd02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '018f4605f5104c59a786b6655130ec1f'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:56:43.111056 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-52ceab30-ae09-4604-9f24-6803a734fd02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '018f4605f5104c59a786b6655130ec1f'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:56:43.124049 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-52ceab30-ae09-4604-9f24-6803a734fd02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '018f4605f5104c59a786b6655130ec1f'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:56:43.124806 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-52ceab30-ae09-4604-9f24-6803a734fd02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '018f4605f5104c59a786b6655130ec1f'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:56:43.139513 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1121/2258] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:56:42 2022] DELETE /identity/v3/users/018f4605f5104c59a786b6655130ec1f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:56:43.144179 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc60e6-b447-4f66-9302-768798887668 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:56:43.144706 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc60e6-b447-4f66-9302-768798887668 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:56:43.144828 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc60e6-b447-4f66-9302-768798887668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:56:43.165800 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-dffc60e6-b447-4f66-9302-768798887668 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:56:43.167841 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-dffc60e6-b447-4f66-9302-768798887668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:56:43.249864 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1138/2259] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:56:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:56:43.261425 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ceab30-ae09-4604-9f24-6803a734fd02 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:56:43.265253 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-52ceab30-ae09-4604-9f24-6803a734fd02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:56:43.335336 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ceab30-ae09-4604-9f24-6803a734fd02 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:56:43.339110 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafb6b2-ba7b-4f82-a42b-596a851bbd52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:56:43.339779 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafb6b2-ba7b-4f82-a42b-596a851bbd52 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:56:43.340065 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafb6b2-ba7b-4f82-a42b-596a851bbd52 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:56:43.340337 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafb6b2-ba7b-4f82-a42b-596a851bbd52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:56:43.350840 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafb6b2-ba7b-4f82-a42b-596a851bbd52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:56:43.352344 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafb6b2-ba7b-4f82-a42b-596a851bbd52 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:56:43.363197 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1122/2260] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:56:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:56:43.654946 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc60e6-b447-4f66-9302-768798887668 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:56:43.656620 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-dffc60e6-b447-4f66-9302-768798887668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:56:43.671666 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc60e6-b447-4f66-9302-768798887668 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:56:43.676707 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b41334-534a-4f92-a1ac-a453184e2a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:56:43.677578 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b41334-534a-4f92-a1ac-a453184e2a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:56:43.677852 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b41334-534a-4f92-a1ac-a453184e2a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:56:43.678117 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b41334-534a-4f92-a1ac-a453184e2a93 admin admin] PATH_INFO: `/v3/projects/6604959a0b904ed983e3ec1a26c362ba` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:56:43.679356 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b41334-534a-4f92-a1ac-a453184e2a93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6604959a0b904ed983e3ec1a26c362ba)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:56:43.681360 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b41334-534a-4f92-a1ac-a453184e2a93 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:56:43.729975 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-c9b41334-534a-4f92-a1ac-a453184e2a93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6604959a0b904ed983e3ec1a26c362ba', 'request_id': 'req-c9b41334-534a-4f92-a1ac-a453184e2a93'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:56:43.737233 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-c9b41334-534a-4f92-a1ac-a453184e2a93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6604959a0b904ed983e3ec1a26c362ba', 'request_id': 'req-c9b41334-534a-4f92-a1ac-a453184e2a93'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:56:43.745580 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-c9b41334-534a-4f92-a1ac-a453184e2a93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6604959a0b904ed983e3ec1a26c362ba', 'request_id': 'req-c9b41334-534a-4f92-a1ac-a453184e2a93'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:56:43.757445 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-c9b41334-534a-4f92-a1ac-a453184e2a93 admin admin] The token cache is being invalidate because project 6604959a0b904ed983e3ec1a26c362ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:56:43.757700 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-c9b41334-534a-4f92-a1ac-a453184e2a93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:56:43.758368 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-c9b41334-534a-4f92-a1ac-a453184e2a93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:56:43.760137 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1139/2261] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:56:43 2022] DELETE /identity/v3/projects/6604959a0b904ed983e3ec1a26c362ba => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:56:52.408176 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce3a1c-e686-447a-a99e-2cc42b38ddfc None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:56:52.409027 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce3a1c-e686-447a-a99e-2cc42b38ddfc None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:56:52.409180 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce3a1c-e686-447a-a99e-2cc42b38ddfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:56:52.432798 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-adce3a1c-e686-447a-a99e-2cc42b38ddfc None None] MFA Rules not processed for user `78cde480dd8b4a85ac30895026bfc406`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:56:52.434612 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-adce3a1c-e686-447a-a99e-2cc42b38ddfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:56:52.530379 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1123/2262] 10.222.0.49 () {58 vars in 967 bytes} [Fri Oct 28 20:56:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:56:52.544385 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b41334-534a-4f92-a1ac-a453184e2a93 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:56:52.546160 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-c9b41334-534a-4f92-a1ac-a453184e2a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:56:52.621900 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b41334-534a-4f92-a1ac-a453184e2a93 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:56:52.627580 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29c5a2-33f6-486a-b9c9-8f721c4d1bba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d70db11d2d4923943bc6479bc49206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:56:52.628261 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29c5a2-33f6-486a-b9c9-8f721c4d1bba service swift] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:56:52.628543 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29c5a2-33f6-486a-b9c9-8f721c4d1bba service swift] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:56:52.628813 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29c5a2-33f6-486a-b9c9-8f721c4d1bba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:56:52.639203 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29c5a2-33f6-486a-b9c9-8f721c4d1bba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:56:52.641306 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29c5a2-33f6-486a-b9c9-8f721c4d1bba service swift] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:56:52.650000 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1140/2263] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Oct 28 20:56:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 20:57:17.614537 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f435a46-c597-41c1-b555-c1f705d0278b None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:57:17.615073 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f435a46-c597-41c1-b555-c1f705d0278b None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:57:17.615073 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f435a46-c597-41c1-b555-c1f705d0278b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:57:17.633368 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-9f435a46-c597-41c1-b555-c1f705d0278b None None] MFA Rules not processed for user `5dec57310b724afa966fd56650707e54`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:57:17.634581 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-9f435a46-c597-41c1-b555-c1f705d0278b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:57:17.689115 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1124/2264] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:57:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:57:25.874070 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0aabe-2717-4343-8d96-eaee41a6c9b3 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:57:25.874676 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0aabe-2717-4343-8d96-eaee41a6c9b3 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:57:25.874676 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0aabe-2717-4343-8d96-eaee41a6c9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:57:25.893697 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-d3b0aabe-2717-4343-8d96-eaee41a6c9b3 None None] MFA Rules not processed for user `48c87597846e44f186da0c969a2579bf`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:57:25.895280 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-d3b0aabe-2717-4343-8d96-eaee41a6c9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:57:25.951144 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1141/2265] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:57:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:57:42.958543 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3deec7e-67a2-48cd-811a-0a223bd7433f None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:57:42.959137 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3deec7e-67a2-48cd-811a-0a223bd7433f None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:57:42.959137 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3deec7e-67a2-48cd-811a-0a223bd7433f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:57:42.979066 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-e3deec7e-67a2-48cd-811a-0a223bd7433f None None] MFA Rules not processed for user `7781cf44c6cb47a8adac1e187e9a8dac`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:57:42.980378 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-e3deec7e-67a2-48cd-811a-0a223bd7433f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:57:43.056089 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1125/2266] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:57:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:57:58.866139 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377ffd6-8fb3-49cc-8fd1-d0947c64408d None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:57:58.866984 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377ffd6-8fb3-49cc-8fd1-d0947c64408d None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:57:58.866984 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377ffd6-8fb3-49cc-8fd1-d0947c64408d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:57:58.886089 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-9377ffd6-8fb3-49cc-8fd1-d0947c64408d None None] MFA Rules not processed for user `a9a00ca081c24dde98c89e398267133f`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:57:58.887897 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-9377ffd6-8fb3-49cc-8fd1-d0947c64408d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:57:58.943509 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1142/2267] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:57:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:58:24.772622 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74485d-443d-4dd7-b591-87a2734f5a55 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:24.773176 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74485d-443d-4dd7-b591-87a2734f5a55 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:24.773176 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74485d-443d-4dd7-b591-87a2734f5a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:24.790957 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-1a74485d-443d-4dd7-b591-87a2734f5a55 None None] MFA Rules not processed for user `5dec57310b724afa966fd56650707e54`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:58:24.792269 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-1a74485d-443d-4dd7-b591-87a2734f5a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:24.799706 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1126/2268] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:58:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:58:26.341501 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377ffd6-8fb3-49cc-8fd1-d0947c64408d None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:26.343283 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-9377ffd6-8fb3-49cc-8fd1-d0947c64408d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:26.407883 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377ffd6-8fb3-49cc-8fd1-d0947c64408d None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:26.411859 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201dfe6-1e54-406a-ad57-2871516da33e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:26.412502 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201dfe6-1e54-406a-ad57-2871516da33e service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:26.412780 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201dfe6-1e54-406a-ad57-2871516da33e service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:26.413050 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201dfe6-1e54-406a-ad57-2871516da33e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:26.414854 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-d201dfe6-1e54-406a-ad57-2871516da33e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:26.427192 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d201dfe6-1e54-406a-ad57-2871516da33e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:26.428685 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d201dfe6-1e54-406a-ad57-2871516da33e service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:26.439410 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1143/2269] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:58:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:58:26.568393 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74485d-443d-4dd7-b591-87a2734f5a55 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:26.570461 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-1a74485d-443d-4dd7-b591-87a2734f5a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:26.583971 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74485d-443d-4dd7-b591-87a2734f5a55 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:26.587717 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e560ecd-69ee-49ef-b380-0fdd124aa927 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:26.588407 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e560ecd-69ee-49ef-b380-0fdd124aa927 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:26.588684 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e560ecd-69ee-49ef-b380-0fdd124aa927 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:26.588956 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e560ecd-69ee-49ef-b380-0fdd124aa927 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:26.590902 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-0e560ecd-69ee-49ef-b380-0fdd124aa927 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:26.675227 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e560ecd-69ee-49ef-b380-0fdd124aa927 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:26.676732 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e560ecd-69ee-49ef-b380-0fdd124aa927 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:26.689005 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1127/2270] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:58:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:58:29.504440 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201dfe6-1e54-406a-ad57-2871516da33e service neutron] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:29.513220 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201dfe6-1e54-406a-ad57-2871516da33e service neutron] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:29.516903 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86b37a-12c8-48e6-a452-99d20803cdf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:29.517522 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86b37a-12c8-48e6-a452-99d20803cdf3 service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:29.517794 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86b37a-12c8-48e6-a452-99d20803cdf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:29.518061 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86b37a-12c8-48e6-a452-99d20803cdf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:29.519840 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-0c86b37a-12c8-48e6-a452-99d20803cdf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:29.580362 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86b37a-12c8-48e6-a452-99d20803cdf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:29.581789 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86b37a-12c8-48e6-a452-99d20803cdf3 service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:29.591309 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1144/2271] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:58:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:58:33.159682 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e560ecd-69ee-49ef-b380-0fdd124aa927 service neutron] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:33.163394 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-0e560ecd-69ee-49ef-b380-0fdd124aa927 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:33.180377 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e560ecd-69ee-49ef-b380-0fdd124aa927 service neutron] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:33.185313 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d6ff1-8a30-4fd3-b662-587a3caa4702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:33.186387 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d6ff1-8a30-4fd3-b662-587a3caa4702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:33.186812 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d6ff1-8a30-4fd3-b662-587a3caa4702 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:33.187186 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d6ff1-8a30-4fd3-b662-587a3caa4702 admin admin] PATH_INFO: `/v3/users/48c87597846e44f186da0c969a2579bf` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:33.188526 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d6ff1-8a30-4fd3-b662-587a3caa4702 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48c87597846e44f186da0c969a2579bf)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:33.190451 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d6ff1-8a30-4fd3-b662-587a3caa4702 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:33.242491 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-519d6ff1-8a30-4fd3-b662-587a3caa4702 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48c87597846e44f186da0c969a2579bf'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:33.249879 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-519d6ff1-8a30-4fd3-b662-587a3caa4702 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48c87597846e44f186da0c969a2579bf'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:33.250620 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-519d6ff1-8a30-4fd3-b662-587a3caa4702 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48c87597846e44f186da0c969a2579bf'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:33.264781 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-519d6ff1-8a30-4fd3-b662-587a3caa4702 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48c87597846e44f186da0c969a2579bf'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:33.265435 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-519d6ff1-8a30-4fd3-b662-587a3caa4702 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48c87597846e44f186da0c969a2579bf'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:33.282509 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1128/2272] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:58:33 2022] DELETE /identity/v3/users/48c87597846e44f186da0c969a2579bf => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:58:33.477767 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86b37a-12c8-48e6-a452-99d20803cdf3 service neutron] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:33.488182 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86b37a-12c8-48e6-a452-99d20803cdf3 service neutron] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:33.571246 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff33042-dc28-411e-af96-0ca6f4c92d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:33.572772 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff33042-dc28-411e-af96-0ca6f4c92d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:33.573260 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff33042-dc28-411e-af96-0ca6f4c92d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:33.573754 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff33042-dc28-411e-af96-0ca6f4c92d98 admin admin] PATH_INFO: `/v3/projects/99fe5983d1c6464796b4c24984ceb0c4` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:33.576606 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff33042-dc28-411e-af96-0ca6f4c92d98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99fe5983d1c6464796b4c24984ceb0c4)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:33.580436 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff33042-dc28-411e-af96-0ca6f4c92d98 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:33.640559 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-0ff33042-dc28-411e-af96-0ca6f4c92d98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99fe5983d1c6464796b4c24984ceb0c4', 'request_id': 'req-0ff33042-dc28-411e-af96-0ca6f4c92d98'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:33.646951 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-0ff33042-dc28-411e-af96-0ca6f4c92d98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99fe5983d1c6464796b4c24984ceb0c4', 'request_id': 'req-0ff33042-dc28-411e-af96-0ca6f4c92d98'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:33.657542 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-0ff33042-dc28-411e-af96-0ca6f4c92d98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99fe5983d1c6464796b4c24984ceb0c4', 'request_id': 'req-0ff33042-dc28-411e-af96-0ca6f4c92d98'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:33.675464 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-0ff33042-dc28-411e-af96-0ca6f4c92d98 admin admin] The token cache is being invalidate because project 99fe5983d1c6464796b4c24984ceb0c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:58:33.675773 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-0ff33042-dc28-411e-af96-0ca6f4c92d98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:33.676446 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-0ff33042-dc28-411e-af96-0ca6f4c92d98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:33.678044 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1145/2273] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:58:33 2022] DELETE /identity/v3/projects/99fe5983d1c6464796b4c24984ceb0c4 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:58:33.683046 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb58d2-5168-4760-bf83-65ef6dfbcfe6 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:33.683326 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb58d2-5168-4760-bf83-65ef6dfbcfe6 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:33.683592 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb58d2-5168-4760-bf83-65ef6dfbcfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:33.703547 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-c3eb58d2-5168-4760-bf83-65ef6dfbcfe6 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:58:33.704790 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-c3eb58d2-5168-4760-bf83-65ef6dfbcfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:33.767839 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1129/2274] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:58:33.775933 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc139a-e4b6-4feb-9f61-1f381c557685 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:33.776146 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc139a-e4b6-4feb-9f61-1f381c557685 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:33.776418 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc139a-e4b6-4feb-9f61-1f381c557685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:33.928744 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-6cfc139a-e4b6-4feb-9f61-1f381c557685 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:58:33.929953 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-6cfc139a-e4b6-4feb-9f61-1f381c557685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:33.939516 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1146/2275] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:58:33.944088 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb58d2-5168-4760-bf83-65ef6dfbcfe6 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:33.953970 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb58d2-5168-4760-bf83-65ef6dfbcfe6 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:33.958571 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd0be2-9ac3-4017-8584-f06c66c479ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:33.959218 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd0be2-9ac3-4017-8584-f06c66c479ee admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:33.959491 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd0be2-9ac3-4017-8584-f06c66c479ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:33.959775 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd0be2-9ac3-4017-8584-f06c66c479ee admin admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:33.960495 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd0be2-9ac3-4017-8584-f06c66c479ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:58:33.960793 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd0be2-9ac3-4017-8584-f06c66c479ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:33.962396 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd0be2-9ac3-4017-8584-f06c66c479ee admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:33.974302 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1130/2276] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:58:33.978902 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc139a-e4b6-4feb-9f61-1f381c557685 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:33.989421 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc139a-e4b6-4feb-9f61-1f381c557685 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:33.994094 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d4af7-d371-47d6-a5cd-a77fd2dd82d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:33.994747 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d4af7-d371-47d6-a5cd-a77fd2dd82d7 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:33.995022 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d4af7-d371-47d6-a5cd-a77fd2dd82d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:33.995290 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d4af7-d371-47d6-a5cd-a77fd2dd82d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:33.996022 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d4af7-d371-47d6-a5cd-a77fd2dd82d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:33.998674 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d4af7-d371-47d6-a5cd-a77fd2dd82d7 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:34.026375 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1147/2277] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:58:33 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:58:34.030909 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd0be2-9ac3-4017-8584-f06c66c479ee admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:34.040772 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd0be2-9ac3-4017-8584-f06c66c479ee admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:34.102713 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6261ba44-35aa-40e8-a8a9-5548ce3675d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:34.103392 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261ba44-35aa-40e8-a8a9-5548ce3675d0 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:34.103660 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261ba44-35aa-40e8-a8a9-5548ce3675d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:34.103962 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261ba44-35aa-40e8-a8a9-5548ce3675d0 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:34.104697 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6261ba44-35aa-40e8-a8a9-5548ce3675d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:34.107434 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6261ba44-35aa-40e8-a8a9-5548ce3675d0 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:34.128632 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1131/2278] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:58:34 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:58:34.132965 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d4af7-d371-47d6-a5cd-a77fd2dd82d7 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:34.144246 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d4af7-d371-47d6-a5cd-a77fd2dd82d7 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:34.149806 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164c9f8-17bd-432e-813c-3bbb6050b516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:34.150506 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164c9f8-17bd-432e-813c-3bbb6050b516 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:34.150781 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164c9f8-17bd-432e-813c-3bbb6050b516 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:34.151054 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164c9f8-17bd-432e-813c-3bbb6050b516 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:34.151839 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164c9f8-17bd-432e-813c-3bbb6050b516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:34.153520 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164c9f8-17bd-432e-813c-3bbb6050b516 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:34.164893 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1148/2279] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:58:34.169886 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6261ba44-35aa-40e8-a8a9-5548ce3675d0 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:34.181477 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6261ba44-35aa-40e8-a8a9-5548ce3675d0 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:34.188753 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03009c2c-6c69-44f3-832a-77b2312eebb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:34.189732 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03009c2c-6c69-44f3-832a-77b2312eebb6 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:34.190310 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03009c2c-6c69-44f3-832a-77b2312eebb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:34.190789 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03009c2c-6c69-44f3-832a-77b2312eebb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:34.191722 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03009c2c-6c69-44f3-832a-77b2312eebb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:34.193774 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03009c2c-6c69-44f3-832a-77b2312eebb6 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:34.206364 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1132/2280] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:58:34.213566 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164c9f8-17bd-432e-813c-3bbb6050b516 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:34.224501 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164c9f8-17bd-432e-813c-3bbb6050b516 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:34.229581 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03dba59-073b-4551-be45-81a7ba2850cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:34.230464 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03dba59-073b-4551-be45-81a7ba2850cc admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:34.230731 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03dba59-073b-4551-be45-81a7ba2850cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:34.231017 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03dba59-073b-4551-be45-81a7ba2850cc admin admin] PATH_INFO: `/v3/projects/ddfaeff4fd1c42f4896626ecb7f503e8/users/545dfa2886cc489d819018d15b29ce55/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:34.246658 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03009c2c-6c69-44f3-832a-77b2312eebb6 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:34.249095 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-03009c2c-6c69-44f3-832a-77b2312eebb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:34.252265 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03dba59-073b-4551-be45-81a7ba2850cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddfaeff4fd1c42f4896626ecb7f503e8, user_id=545dfa2886cc489d819018d15b29ce55, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:34.255187 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03dba59-073b-4551-be45-81a7ba2850cc admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:34.281023 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1149/2281] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:58:34 2022] PUT /identity/v3/projects/ddfaeff4fd1c42f4896626ecb7f503e8/users/545dfa2886cc489d819018d15b29ce55/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:58:34.291204 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99a57d-57cc-4d24-b673-f645a479094c None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:34.291467 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99a57d-57cc-4d24-b673-f645a479094c None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:34.291784 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99a57d-57cc-4d24-b673-f645a479094c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:34.313278 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03009c2c-6c69-44f3-832a-77b2312eebb6 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:34.319759 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-da99a57d-57cc-4d24-b673-f645a479094c None None] MFA Rules not processed for user `545dfa2886cc489d819018d15b29ce55`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:58:34.321002 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-da99a57d-57cc-4d24-b673-f645a479094c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:34.378129 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0627286-02f6-460c-919b-ff36dc8ffbf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:34.379055 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0627286-02f6-460c-919b-ff36dc8ffbf4 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:34.379490 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0627286-02f6-460c-919b-ff36dc8ffbf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:34.379991 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0627286-02f6-460c-919b-ff36dc8ffbf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:34.382689 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-b0627286-02f6-460c-919b-ff36dc8ffbf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:34.407554 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1150/2282] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:58:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:58:34.410159 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99a57d-57cc-4d24-b673-f645a479094c None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:34.473037 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0627286-02f6-460c-919b-ff36dc8ffbf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:34.474512 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0627286-02f6-460c-919b-ff36dc8ffbf4 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:34.485865 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99a57d-57cc-4d24-b673-f645a479094c None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:34.487218 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1133/2283] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:58:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:58:34.491274 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb99c9f-9ee5-49e3-9ada-241212c97a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:34.491973 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb99c9f-9ee5-49e3-9ada-241212c97a5d admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:34.492250 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb99c9f-9ee5-49e3-9ada-241212c97a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:34.492520 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb99c9f-9ee5-49e3-9ada-241212c97a5d admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:34.493256 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb99c9f-9ee5-49e3-9ada-241212c97a5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:34.495172 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb99c9f-9ee5-49e3-9ada-241212c97a5d admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:34.529270 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1151/2284] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:58:34 2022] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:58:34.534504 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0627286-02f6-460c-919b-ff36dc8ffbf4 service neutron] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:34.559451 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0627286-02f6-460c-919b-ff36dc8ffbf4 service neutron] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:34.629144 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aac0f9-6068-4b88-a6c4-533ba464c482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:34.629824 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aac0f9-6068-4b88-a6c4-533ba464c482 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:34.630104 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aac0f9-6068-4b88-a6c4-533ba464c482 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:34.630376 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aac0f9-6068-4b88-a6c4-533ba464c482 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:34.631070 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aac0f9-6068-4b88-a6c4-533ba464c482 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:34.633037 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aac0f9-6068-4b88-a6c4-533ba464c482 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:34.654706 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1134/2285] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:58:34 2022] POST /identity/v3/users => generated 296 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:58:34.659009 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb99c9f-9ee5-49e3-9ada-241212c97a5d admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:34.669321 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb99c9f-9ee5-49e3-9ada-241212c97a5d admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:34.674209 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76003d8a-b52f-465c-bc2b-289aec035612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:34.674871 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76003d8a-b52f-465c-bc2b-289aec035612 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:34.675147 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76003d8a-b52f-465c-bc2b-289aec035612 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:34.675450 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76003d8a-b52f-465c-bc2b-289aec035612 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:34.676224 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76003d8a-b52f-465c-bc2b-289aec035612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:34.677825 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76003d8a-b52f-465c-bc2b-289aec035612 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:34.688769 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1152/2286] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:58:34.693229 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aac0f9-6068-4b88-a6c4-533ba464c482 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:34.704348 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aac0f9-6068-4b88-a6c4-533ba464c482 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:34.709063 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9dc42-f5df-4436-bd5e-b3f1ff1319f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:34.709943 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9dc42-f5df-4436-bd5e-b3f1ff1319f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:34.710221 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9dc42-f5df-4436-bd5e-b3f1ff1319f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:34.710491 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9dc42-f5df-4436-bd5e-b3f1ff1319f2 admin admin] PATH_INFO: `/v3/projects/00f7e95a44e44ea2adb66b726ac187d4/users/c241b8a4d3c54c478f5bf36e6d5b1934/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:34.726740 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9dc42-f5df-4436-bd5e-b3f1ff1319f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00f7e95a44e44ea2adb66b726ac187d4, user_id=c241b8a4d3c54c478f5bf36e6d5b1934, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:34.729477 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9dc42-f5df-4436-bd5e-b3f1ff1319f2 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:34.744029 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1135/2287] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:58:34 2022] PUT /identity/v3/projects/00f7e95a44e44ea2adb66b726ac187d4/users/c241b8a4d3c54c478f5bf36e6d5b1934/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:58:34.748313 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76003d8a-b52f-465c-bc2b-289aec035612 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:34.758336 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76003d8a-b52f-465c-bc2b-289aec035612 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:34.816188 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fde52-bb77-465b-855a-632fb8bc9394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:34.816750 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fde52-bb77-465b-855a-632fb8bc9394 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:34.817025 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fde52-bb77-465b-855a-632fb8bc9394 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:34.817299 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fde52-bb77-465b-855a-632fb8bc9394 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:34.818006 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171fde52-bb77-465b-855a-632fb8bc9394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:34.819610 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171fde52-bb77-465b-855a-632fb8bc9394 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:34.829775 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1153/2288] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:58:34.833993 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9dc42-f5df-4436-bd5e-b3f1ff1319f2 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:34.844893 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9dc42-f5df-4436-bd5e-b3f1ff1319f2 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:34.849908 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535fb8f-fc38-4dfb-9fd2-3b12c19c83e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:34.850774 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535fb8f-fc38-4dfb-9fd2-3b12c19c83e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:34.851303 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535fb8f-fc38-4dfb-9fd2-3b12c19c83e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:34.851729 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535fb8f-fc38-4dfb-9fd2-3b12c19c83e5 admin admin] PATH_INFO: `/v3/projects/00f7e95a44e44ea2adb66b726ac187d4/users/c241b8a4d3c54c478f5bf36e6d5b1934/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:34.853851 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0535fb8f-fc38-4dfb-9fd2-3b12c19c83e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00f7e95a44e44ea2adb66b726ac187d4, user_id=c241b8a4d3c54c478f5bf36e6d5b1934, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:34.856591 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0535fb8f-fc38-4dfb-9fd2-3b12c19c83e5 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:34.867340 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1136/2289] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:58:34 2022] PUT /identity/v3/projects/00f7e95a44e44ea2adb66b726ac187d4/users/c241b8a4d3c54c478f5bf36e6d5b1934/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:58:34.877671 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc618ee7-3df3-4f26-8b4f-308bc7fb27a8 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:34.877961 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc618ee7-3df3-4f26-8b4f-308bc7fb27a8 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:34.878243 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc618ee7-3df3-4f26-8b4f-308bc7fb27a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:34.905992 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-dc618ee7-3df3-4f26-8b4f-308bc7fb27a8 None None] MFA Rules not processed for user `c241b8a4d3c54c478f5bf36e6d5b1934`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:58:34.907229 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-dc618ee7-3df3-4f26-8b4f-308bc7fb27a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:34.973588 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1154/2290] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:58:34 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:58:34.985520 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535fb8f-fc38-4dfb-9fd2-3b12c19c83e5 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:34.987245 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-0535fb8f-fc38-4dfb-9fd2-3b12c19c83e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:35.045167 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535fb8f-fc38-4dfb-9fd2-3b12c19c83e5 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:35.048843 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8875da3-6225-47ff-8848-8bb34bfc3382 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:35.049487 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8875da3-6225-47ff-8848-8bb34bfc3382 service cinder] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:35.049764 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8875da3-6225-47ff-8848-8bb34bfc3382 service cinder] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:35.050034 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8875da3-6225-47ff-8848-8bb34bfc3382 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:35.060238 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8875da3-6225-47ff-8848-8bb34bfc3382 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:35.061697 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8875da3-6225-47ff-8848-8bb34bfc3382 service cinder] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:35.071832 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1137/2291] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:58:34 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:58:35.160769 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc618ee7-3df3-4f26-8b4f-308bc7fb27a8 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:35.170415 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc618ee7-3df3-4f26-8b4f-308bc7fb27a8 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:35.174054 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8fc85-bc2c-4777-824d-7d543a2fc8be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:35.174678 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8fc85-bc2c-4777-824d-7d543a2fc8be service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:35.174958 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8fc85-bc2c-4777-824d-7d543a2fc8be service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:35.175231 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8fc85-bc2c-4777-824d-7d543a2fc8be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:35.230314 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8fc85-bc2c-4777-824d-7d543a2fc8be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:35.231893 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8fc85-bc2c-4777-824d-7d543a2fc8be service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:35.240712 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1155/2292] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:58:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:58:40.912295 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8875da3-6225-47ff-8848-8bb34bfc3382 service cinder] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:40.913706 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-a8875da3-6225-47ff-8848-8bb34bfc3382 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:40.999337 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8875da3-6225-47ff-8848-8bb34bfc3382 service cinder] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:41.005378 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71bb71-3eeb-4dc3-bc62-1003b898fca9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:41.006028 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71bb71-3eeb-4dc3-bc62-1003b898fca9 service nova] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:41.006304 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71bb71-3eeb-4dc3-bc62-1003b898fca9 service nova] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:41.006595 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71bb71-3eeb-4dc3-bc62-1003b898fca9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:41.008430 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-cd71bb71-3eeb-4dc3-bc62-1003b898fca9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:41.066649 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71bb71-3eeb-4dc3-bc62-1003b898fca9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:41.068265 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71bb71-3eeb-4dc3-bc62-1003b898fca9 service nova] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:41.077117 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1138/2293] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:58:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:58:44.278807 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8fc85-bc2c-4777-824d-7d543a2fc8be service cinder] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:44.340667 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8fc85-bc2c-4777-824d-7d543a2fc8be service cinder] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:44.345371 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361e3cb-5b9b-4ecb-8baa-99da14201f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:44.346234 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361e3cb-5b9b-4ecb-8baa-99da14201f96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:44.346517 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361e3cb-5b9b-4ecb-8baa-99da14201f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:44.346789 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361e3cb-5b9b-4ecb-8baa-99da14201f96 admin admin] PATH_INFO: `/v3/users/545dfa2886cc489d819018d15b29ce55` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:44.348002 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0361e3cb-5b9b-4ecb-8baa-99da14201f96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=545dfa2886cc489d819018d15b29ce55)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:44.349915 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0361e3cb-5b9b-4ecb-8baa-99da14201f96 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:44.398058 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-0361e3cb-5b9b-4ecb-8baa-99da14201f96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '545dfa2886cc489d819018d15b29ce55'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:44.404420 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-0361e3cb-5b9b-4ecb-8baa-99da14201f96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '545dfa2886cc489d819018d15b29ce55'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:44.411890 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-0361e3cb-5b9b-4ecb-8baa-99da14201f96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '545dfa2886cc489d819018d15b29ce55'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:44.412491 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-0361e3cb-5b9b-4ecb-8baa-99da14201f96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '545dfa2886cc489d819018d15b29ce55'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:44.424653 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-0361e3cb-5b9b-4ecb-8baa-99da14201f96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '545dfa2886cc489d819018d15b29ce55'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:44.430291 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1156/2294] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:58:44 2022] DELETE /identity/v3/users/545dfa2886cc489d819018d15b29ce55 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:58:44.434933 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934625e-2e08-443b-b604-6fb485cec164 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:44.435424 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934625e-2e08-443b-b604-6fb485cec164 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:44.435553 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934625e-2e08-443b-b604-6fb485cec164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:44.453248 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-8934625e-2e08-443b-b604-6fb485cec164 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:58:44.454437 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-8934625e-2e08-443b-b604-6fb485cec164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:44.515267 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1139/2295] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:58:44.529651 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361e3cb-5b9b-4ecb-8baa-99da14201f96 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:44.531134 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-0361e3cb-5b9b-4ecb-8baa-99da14201f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:44.588068 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361e3cb-5b9b-4ecb-8baa-99da14201f96 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:44.591724 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310effc-ccec-4a61-9484-f29abca4c71b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:44.592399 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310effc-ccec-4a61-9484-f29abca4c71b service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:44.592681 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310effc-ccec-4a61-9484-f29abca4c71b service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:44.592952 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310effc-ccec-4a61-9484-f29abca4c71b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:44.602531 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b310effc-ccec-4a61-9484-f29abca4c71b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:44.604005 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b310effc-ccec-4a61-9484-f29abca4c71b service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:44.614679 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1157/2296] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:58:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:58:44.889374 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934625e-2e08-443b-b604-6fb485cec164 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:44.891432 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-8934625e-2e08-443b-b604-6fb485cec164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:44.904469 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934625e-2e08-443b-b604-6fb485cec164 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:44.910121 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d5335-8219-4572-a22a-d7d4b6b22176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:44.911095 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d5335-8219-4572-a22a-d7d4b6b22176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:44.911632 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d5335-8219-4572-a22a-d7d4b6b22176 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:44.912152 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d5335-8219-4572-a22a-d7d4b6b22176 admin admin] PATH_INFO: `/v3/projects/ddfaeff4fd1c42f4896626ecb7f503e8` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:44.913599 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d5335-8219-4572-a22a-d7d4b6b22176 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddfaeff4fd1c42f4896626ecb7f503e8)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:44.915865 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d5335-8219-4572-a22a-d7d4b6b22176 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:44.965324 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-460d5335-8219-4572-a22a-d7d4b6b22176 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddfaeff4fd1c42f4896626ecb7f503e8', 'request_id': 'req-460d5335-8219-4572-a22a-d7d4b6b22176'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:44.971196 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-460d5335-8219-4572-a22a-d7d4b6b22176 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddfaeff4fd1c42f4896626ecb7f503e8', 'request_id': 'req-460d5335-8219-4572-a22a-d7d4b6b22176'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:44.977496 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-460d5335-8219-4572-a22a-d7d4b6b22176 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddfaeff4fd1c42f4896626ecb7f503e8', 'request_id': 'req-460d5335-8219-4572-a22a-d7d4b6b22176'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:44.992282 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-460d5335-8219-4572-a22a-d7d4b6b22176 admin admin] The token cache is being invalidate because project ddfaeff4fd1c42f4896626ecb7f503e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:58:44.992767 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-460d5335-8219-4572-a22a-d7d4b6b22176 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:44.993567 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-460d5335-8219-4572-a22a-d7d4b6b22176 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:44.998260 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1140/2297] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:58:44 2022] DELETE /identity/v3/projects/ddfaeff4fd1c42f4896626ecb7f503e8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:58:44.999452 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310effc-ccec-4a61-9484-f29abca4c71b service neutron] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:45.009214 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310effc-ccec-4a61-9484-f29abca4c71b service neutron] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:45.065327 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93733255-5dbd-45c6-b6b9-54b59f4cf926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:45.066180 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93733255-5dbd-45c6-b6b9-54b59f4cf926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:45.066455 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93733255-5dbd-45c6-b6b9-54b59f4cf926 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:45.066725 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93733255-5dbd-45c6-b6b9-54b59f4cf926 admin admin] PATH_INFO: `/v3/users/c241b8a4d3c54c478f5bf36e6d5b1934` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:45.067917 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93733255-5dbd-45c6-b6b9-54b59f4cf926 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c241b8a4d3c54c478f5bf36e6d5b1934)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:45.069798 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93733255-5dbd-45c6-b6b9-54b59f4cf926 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:45.114227 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-93733255-5dbd-45c6-b6b9-54b59f4cf926 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c241b8a4d3c54c478f5bf36e6d5b1934'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:45.120868 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-93733255-5dbd-45c6-b6b9-54b59f4cf926 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c241b8a4d3c54c478f5bf36e6d5b1934'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:45.128372 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-93733255-5dbd-45c6-b6b9-54b59f4cf926 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c241b8a4d3c54c478f5bf36e6d5b1934'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:45.129054 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-93733255-5dbd-45c6-b6b9-54b59f4cf926 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c241b8a4d3c54c478f5bf36e6d5b1934'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:45.141430 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-93733255-5dbd-45c6-b6b9-54b59f4cf926 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c241b8a4d3c54c478f5bf36e6d5b1934'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:45.147531 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1158/2298] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:58:44 2022] DELETE /identity/v3/users/c241b8a4d3c54c478f5bf36e6d5b1934 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:58:45.432818 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d5335-8219-4572-a22a-d7d4b6b22176 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:45.434551 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-460d5335-8219-4572-a22a-d7d4b6b22176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:45.455254 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d5335-8219-4572-a22a-d7d4b6b22176 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:45.517111 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ddb7b-5a1c-4ade-b76f-bfdb8f0e1b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:45.518106 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ddb7b-5a1c-4ade-b76f-bfdb8f0e1b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:45.518481 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ddb7b-5a1c-4ade-b76f-bfdb8f0e1b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:45.518845 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ddb7b-5a1c-4ade-b76f-bfdb8f0e1b7c admin admin] PATH_INFO: `/v3/projects/00f7e95a44e44ea2adb66b726ac187d4` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:45.520228 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ddb7b-5a1c-4ade-b76f-bfdb8f0e1b7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=00f7e95a44e44ea2adb66b726ac187d4)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:45.522616 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ddb7b-5a1c-4ade-b76f-bfdb8f0e1b7c admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:45.567220 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-fd1ddb7b-5a1c-4ade-b76f-bfdb8f0e1b7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00f7e95a44e44ea2adb66b726ac187d4', 'request_id': 'req-fd1ddb7b-5a1c-4ade-b76f-bfdb8f0e1b7c'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:45.572859 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-fd1ddb7b-5a1c-4ade-b76f-bfdb8f0e1b7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00f7e95a44e44ea2adb66b726ac187d4', 'request_id': 'req-fd1ddb7b-5a1c-4ade-b76f-bfdb8f0e1b7c'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:45.580072 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-fd1ddb7b-5a1c-4ade-b76f-bfdb8f0e1b7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00f7e95a44e44ea2adb66b726ac187d4', 'request_id': 'req-fd1ddb7b-5a1c-4ade-b76f-bfdb8f0e1b7c'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:45.593566 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-fd1ddb7b-5a1c-4ade-b76f-bfdb8f0e1b7c admin admin] The token cache is being invalidate because project 00f7e95a44e44ea2adb66b726ac187d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:58:45.593860 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-fd1ddb7b-5a1c-4ade-b76f-bfdb8f0e1b7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:45.594457 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-fd1ddb7b-5a1c-4ade-b76f-bfdb8f0e1b7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:45.596222 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1141/2299] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:58:45 2022] DELETE /identity/v3/projects/00f7e95a44e44ea2adb66b726ac187d4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:58:45.601109 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73dd6e-4f2b-4e91-9aeb-bd4d9d4e002c None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:45.601589 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73dd6e-4f2b-4e91-9aeb-bd4d9d4e002c None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:45.601703 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73dd6e-4f2b-4e91-9aeb-bd4d9d4e002c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:45.619770 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-9b73dd6e-4f2b-4e91-9aeb-bd4d9d4e002c None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:58:45.620973 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-9b73dd6e-4f2b-4e91-9aeb-bd4d9d4e002c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:45.681705 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1159/2300] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:58:45.692722 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a766851-84d4-4438-9334-22b06eab58b8 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:45.692722 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a766851-84d4-4438-9334-22b06eab58b8 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:45.692962 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a766851-84d4-4438-9334-22b06eab58b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:45.717152 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-6a766851-84d4-4438-9334-22b06eab58b8 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:58:45.718536 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-6a766851-84d4-4438-9334-22b06eab58b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:45.727946 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1142/2301] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:58:45.732115 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73dd6e-4f2b-4e91-9aeb-bd4d9d4e002c None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:45.741930 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73dd6e-4f2b-4e91-9aeb-bd4d9d4e002c None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:45.748364 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3a6ca-7809-495f-9e23-0123d661efa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:45.749038 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3a6ca-7809-495f-9e23-0123d661efa3 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:45.749316 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3a6ca-7809-495f-9e23-0123d661efa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:45.750197 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3a6ca-7809-495f-9e23-0123d661efa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:45.750838 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3a6ca-7809-495f-9e23-0123d661efa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:58:45.751150 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3a6ca-7809-495f-9e23-0123d661efa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:45.752895 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3a6ca-7809-495f-9e23-0123d661efa3 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:45.765910 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1160/2302] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:58:45.770924 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a766851-84d4-4438-9334-22b06eab58b8 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:45.786794 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a766851-84d4-4438-9334-22b06eab58b8 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:45.792333 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97cb3d6-125c-4e66-b6a2-91bfd8aaa0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:45.794377 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97cb3d6-125c-4e66-b6a2-91bfd8aaa0ce admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:45.794891 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97cb3d6-125c-4e66-b6a2-91bfd8aaa0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:45.795392 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97cb3d6-125c-4e66-b6a2-91bfd8aaa0ce admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:45.797258 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97cb3d6-125c-4e66-b6a2-91bfd8aaa0ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:45.800685 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97cb3d6-125c-4e66-b6a2-91bfd8aaa0ce admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:45.838422 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1143/2303] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:58:45 2022] POST /identity/v3/projects => generated 407 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:58:45.842496 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3a6ca-7809-495f-9e23-0123d661efa3 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:45.853747 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3a6ca-7809-495f-9e23-0123d661efa3 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:45.911077 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb443c5-ee44-40a2-b2ea-696aea36836e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:45.911779 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb443c5-ee44-40a2-b2ea-696aea36836e admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:45.912055 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb443c5-ee44-40a2-b2ea-696aea36836e admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:45.912327 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb443c5-ee44-40a2-b2ea-696aea36836e admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:45.913019 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb443c5-ee44-40a2-b2ea-696aea36836e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:45.914974 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb443c5-ee44-40a2-b2ea-696aea36836e admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:45.935192 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1161/2304] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:58:45 2022] POST /identity/v3/users => generated 304 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:58:45.940317 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97cb3d6-125c-4e66-b6a2-91bfd8aaa0ce admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:45.950746 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97cb3d6-125c-4e66-b6a2-91bfd8aaa0ce admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:45.955364 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30877556-9ae3-4acc-911a-999171a7717f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:45.956095 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30877556-9ae3-4acc-911a-999171a7717f admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:45.956370 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30877556-9ae3-4acc-911a-999171a7717f admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:45.956636 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30877556-9ae3-4acc-911a-999171a7717f admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:45.957351 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30877556-9ae3-4acc-911a-999171a7717f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:45.958926 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30877556-9ae3-4acc-911a-999171a7717f admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:45.969233 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1144/2305] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:58:45.973194 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb443c5-ee44-40a2-b2ea-696aea36836e admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:45.983436 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb443c5-ee44-40a2-b2ea-696aea36836e admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:45.989384 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e0b0b-2734-4721-9008-be9a5e8b7426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:45.990423 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e0b0b-2734-4721-9008-be9a5e8b7426 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:45.990853 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e0b0b-2734-4721-9008-be9a5e8b7426 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:45.991163 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e0b0b-2734-4721-9008-be9a5e8b7426 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:45.991942 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e0b0b-2734-4721-9008-be9a5e8b7426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:45.993616 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e0b0b-2734-4721-9008-be9a5e8b7426 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:46.004778 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1162/2306] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:58:46.009011 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30877556-9ae3-4acc-911a-999171a7717f admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:46.019281 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30877556-9ae3-4acc-911a-999171a7717f admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:46.024193 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82937f2-7322-40b0-b67d-de54d63b8df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:46.025099 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82937f2-7322-40b0-b67d-de54d63b8df4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:46.025380 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82937f2-7322-40b0-b67d-de54d63b8df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:46.025654 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82937f2-7322-40b0-b67d-de54d63b8df4 admin admin] PATH_INFO: `/v3/projects/37d4d54ad58844578c8cfad9b05d3209/users/0ac8efc8309e4e7e8d9d136359346406/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:46.040057 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82937f2-7322-40b0-b67d-de54d63b8df4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37d4d54ad58844578c8cfad9b05d3209, user_id=0ac8efc8309e4e7e8d9d136359346406, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:46.042723 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82937f2-7322-40b0-b67d-de54d63b8df4 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:46.060182 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1145/2307] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:58:46 2022] PUT /identity/v3/projects/37d4d54ad58844578c8cfad9b05d3209/users/0ac8efc8309e4e7e8d9d136359346406/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:58:46.078427 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269df57-12fa-4036-b8a6-a1b11c67b322 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:46.078788 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269df57-12fa-4036-b8a6-a1b11c67b322 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:46.079133 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269df57-12fa-4036-b8a6-a1b11c67b322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:46.106095 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-4269df57-12fa-4036-b8a6-a1b11c67b322 None None] MFA Rules not processed for user `0ac8efc8309e4e7e8d9d136359346406`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:58:46.107294 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-4269df57-12fa-4036-b8a6-a1b11c67b322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:46.177157 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1163/2308] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:58:46 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:58:46.181582 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82937f2-7322-40b0-b67d-de54d63b8df4 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:46.242703 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82937f2-7322-40b0-b67d-de54d63b8df4 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:46.247375 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ef071-604f-4dab-a74f-393e7a150d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:46.248054 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ef071-604f-4dab-a74f-393e7a150d9f admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:46.248334 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ef071-604f-4dab-a74f-393e7a150d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:46.248605 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ef071-604f-4dab-a74f-393e7a150d9f admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:46.249302 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ef071-604f-4dab-a74f-393e7a150d9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:46.251309 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ef071-604f-4dab-a74f-393e7a150d9f admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:46.277243 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1146/2309] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:58:46 2022] POST /identity/v3/projects => generated 409 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:58:46.281652 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269df57-12fa-4036-b8a6-a1b11c67b322 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:46.293063 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269df57-12fa-4036-b8a6-a1b11c67b322 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:46.346920 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbcc53-e9d6-4e76-bb01-d65e63d6fc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:46.347569 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbcc53-e9d6-4e76-bb01-d65e63d6fc38 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:46.347877 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbcc53-e9d6-4e76-bb01-d65e63d6fc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:46.348147 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbcc53-e9d6-4e76-bb01-d65e63d6fc38 admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:46.348832 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bbcc53-e9d6-4e76-bb01-d65e63d6fc38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:46.350716 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bbcc53-e9d6-4e76-bb01-d65e63d6fc38 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:46.371493 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1164/2310] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:58:46 2022] POST /identity/v3/users => generated 311 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:58:46.375808 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ef071-604f-4dab-a74f-393e7a150d9f admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:46.385922 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ef071-604f-4dab-a74f-393e7a150d9f admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:46.391122 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7080879-875e-45ab-847f-5f1665e2f578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:46.392260 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7080879-875e-45ab-847f-5f1665e2f578 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:46.392750 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7080879-875e-45ab-847f-5f1665e2f578 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:46.393240 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7080879-875e-45ab-847f-5f1665e2f578 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:46.394605 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7080879-875e-45ab-847f-5f1665e2f578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:46.397890 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7080879-875e-45ab-847f-5f1665e2f578 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:46.411115 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1147/2311] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:58:46.415644 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbcc53-e9d6-4e76-bb01-d65e63d6fc38 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:46.426523 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbcc53-e9d6-4e76-bb01-d65e63d6fc38 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:46.431070 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b85a4-6c38-40d8-b5e6-60834eb65018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:46.432036 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b85a4-6c38-40d8-b5e6-60834eb65018 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:46.432322 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b85a4-6c38-40d8-b5e6-60834eb65018 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:46.432594 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b85a4-6c38-40d8-b5e6-60834eb65018 admin admin] PATH_INFO: `/v3/projects/27f3b892fd3b45f7aea9be3e5d5bf56f/users/713f7c4c88354fc3a7649a695aceb761/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:46.447081 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b85a4-6c38-40d8-b5e6-60834eb65018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f3b892fd3b45f7aea9be3e5d5bf56f, user_id=713f7c4c88354fc3a7649a695aceb761, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:46.449764 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b85a4-6c38-40d8-b5e6-60834eb65018 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:46.462614 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1165/2312] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:58:46 2022] PUT /identity/v3/projects/27f3b892fd3b45f7aea9be3e5d5bf56f/users/713f7c4c88354fc3a7649a695aceb761/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:58:46.466932 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7080879-875e-45ab-847f-5f1665e2f578 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:46.477677 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7080879-875e-45ab-847f-5f1665e2f578 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:46.533205 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab8a2fd-b11f-44a8-ad7a-c5ce79cc7560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:46.533765 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8a2fd-b11f-44a8-ad7a-c5ce79cc7560 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:46.534039 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8a2fd-b11f-44a8-ad7a-c5ce79cc7560 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:46.534332 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8a2fd-b11f-44a8-ad7a-c5ce79cc7560 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:46.535032 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab8a2fd-b11f-44a8-ad7a-c5ce79cc7560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:46.536682 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab8a2fd-b11f-44a8-ad7a-c5ce79cc7560 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:46.547404 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1148/2313] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:58:46.551871 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b85a4-6c38-40d8-b5e6-60834eb65018 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:46.562165 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b85a4-6c38-40d8-b5e6-60834eb65018 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:46.566929 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd935f1-2554-45da-9db3-b2b9a0a301c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:46.567838 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd935f1-2554-45da-9db3-b2b9a0a301c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:46.568116 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd935f1-2554-45da-9db3-b2b9a0a301c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:46.568385 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd935f1-2554-45da-9db3-b2b9a0a301c8 admin admin] PATH_INFO: `/v3/projects/27f3b892fd3b45f7aea9be3e5d5bf56f/users/713f7c4c88354fc3a7649a695aceb761/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:46.570367 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd935f1-2554-45da-9db3-b2b9a0a301c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f3b892fd3b45f7aea9be3e5d5bf56f, user_id=713f7c4c88354fc3a7649a695aceb761, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:46.573037 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd935f1-2554-45da-9db3-b2b9a0a301c8 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:46.584518 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1166/2314] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:58:46 2022] PUT /identity/v3/projects/27f3b892fd3b45f7aea9be3e5d5bf56f/users/713f7c4c88354fc3a7649a695aceb761/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:58:46.596791 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d6a74-dc41-4609-921b-08f6fbb765d0 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:46.597076 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d6a74-dc41-4609-921b-08f6fbb765d0 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:46.597343 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d6a74-dc41-4609-921b-08f6fbb765d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:46.625929 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-4d2d6a74-dc41-4609-921b-08f6fbb765d0 None None] MFA Rules not processed for user `713f7c4c88354fc3a7649a695aceb761`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:58:46.627155 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-4d2d6a74-dc41-4609-921b-08f6fbb765d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:46.700639 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1149/2315] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:58:46 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:58:46.712568 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd935f1-2554-45da-9db3-b2b9a0a301c8 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:46.714312 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-5bd935f1-2554-45da-9db3-b2b9a0a301c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:46.772978 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd935f1-2554-45da-9db3-b2b9a0a301c8 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:46.776646 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b52097-80be-4a6d-bc99-78447ec414c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:46.777277 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b52097-80be-4a6d-bc99-78447ec414c2 service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:46.777556 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b52097-80be-4a6d-bc99-78447ec414c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:46.777828 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b52097-80be-4a6d-bc99-78447ec414c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:46.787637 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b52097-80be-4a6d-bc99-78447ec414c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:46.789027 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b52097-80be-4a6d-bc99-78447ec414c2 service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:46.798294 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1167/2316] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:58:46 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:58:46.963102 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d6a74-dc41-4609-921b-08f6fbb765d0 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:46.979471 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d6a74-dc41-4609-921b-08f6fbb765d0 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:46.985645 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be821d9f-fd2f-4399-89ba-d1ee552561fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:46.986811 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be821d9f-fd2f-4399-89ba-d1ee552561fa service cinder] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:46.987320 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be821d9f-fd2f-4399-89ba-d1ee552561fa service cinder] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:46.987851 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be821d9f-fd2f-4399-89ba-d1ee552561fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:47.060354 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be821d9f-fd2f-4399-89ba-d1ee552561fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:47.061727 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be821d9f-fd2f-4399-89ba-d1ee552561fa service cinder] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:47.079262 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1150/2317] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:58:46 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:58:53.951251 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b52097-80be-4a6d-bc99-78447ec414c2 service cinder] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:53.952862 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-20b52097-80be-4a6d-bc99-78447ec414c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:54.029390 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b52097-80be-4a6d-bc99-78447ec414c2 service cinder] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:54.036261 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42095bd-aee4-43c3-804a-86c8410f5176 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:54.036915 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42095bd-aee4-43c3-804a-86c8410f5176 service nova] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:54.037195 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42095bd-aee4-43c3-804a-86c8410f5176 service nova] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:54.037468 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42095bd-aee4-43c3-804a-86c8410f5176 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:54.039277 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-b42095bd-aee4-43c3-804a-86c8410f5176 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:54.098355 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42095bd-aee4-43c3-804a-86c8410f5176 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:54.100017 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42095bd-aee4-43c3-804a-86c8410f5176 service nova] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:54.110025 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1168/2318] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:58:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:58:54.552140 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be821d9f-fd2f-4399-89ba-d1ee552561fa service cinder] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:54.617794 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be821d9f-fd2f-4399-89ba-d1ee552561fa service cinder] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:54.623963 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887826e-5186-4235-a3a1-1464050e29fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:54.624919 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887826e-5186-4235-a3a1-1464050e29fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:54.625204 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887826e-5186-4235-a3a1-1464050e29fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:54.625475 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887826e-5186-4235-a3a1-1464050e29fa admin admin] PATH_INFO: `/v3/users/0ac8efc8309e4e7e8d9d136359346406` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:54.626961 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887826e-5186-4235-a3a1-1464050e29fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ac8efc8309e4e7e8d9d136359346406)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:54.628943 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887826e-5186-4235-a3a1-1464050e29fa admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:54.681627 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-3887826e-5186-4235-a3a1-1464050e29fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ac8efc8309e4e7e8d9d136359346406'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:54.690109 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-3887826e-5186-4235-a3a1-1464050e29fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ac8efc8309e4e7e8d9d136359346406'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:54.690934 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-3887826e-5186-4235-a3a1-1464050e29fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ac8efc8309e4e7e8d9d136359346406'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:54.705706 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-3887826e-5186-4235-a3a1-1464050e29fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ac8efc8309e4e7e8d9d136359346406'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:54.706451 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-3887826e-5186-4235-a3a1-1464050e29fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ac8efc8309e4e7e8d9d136359346406'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:54.722102 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1151/2319] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:58:54 2022] DELETE /identity/v3/users/0ac8efc8309e4e7e8d9d136359346406 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:58:54.726813 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9f5d2-d26b-42f0-a40f-b6b792678cd3 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:54.727110 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9f5d2-d26b-42f0-a40f-b6b792678cd3 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:54.727381 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9f5d2-d26b-42f0-a40f-b6b792678cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:54.747187 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-e7a9f5d2-d26b-42f0-a40f-b6b792678cd3 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:58:54.748516 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-e7a9f5d2-d26b-42f0-a40f-b6b792678cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:54.809968 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1169/2320] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:58:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:58:54.820333 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887826e-5186-4235-a3a1-1464050e29fa admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:54.821744 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-3887826e-5186-4235-a3a1-1464050e29fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:54.889153 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887826e-5186-4235-a3a1-1464050e29fa admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:54.893375 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742eebb-905a-431a-9846-0bca3970fe75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:54.894032 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742eebb-905a-431a-9846-0bca3970fe75 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:54.894309 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742eebb-905a-431a-9846-0bca3970fe75 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:54.894580 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742eebb-905a-431a-9846-0bca3970fe75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:54.905326 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a742eebb-905a-431a-9846-0bca3970fe75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:54.906953 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a742eebb-905a-431a-9846-0bca3970fe75 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:54.919412 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1152/2321] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:58:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:58:55.237467 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9f5d2-d26b-42f0-a40f-b6b792678cd3 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:55.239168 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-e7a9f5d2-d26b-42f0-a40f-b6b792678cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:55.254230 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9f5d2-d26b-42f0-a40f-b6b792678cd3 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:55.259282 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aed56e-ce7f-46e5-877e-02abaeab4452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:55.260362 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aed56e-ce7f-46e5-877e-02abaeab4452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:55.260655 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aed56e-ce7f-46e5-877e-02abaeab4452 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:55.260914 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aed56e-ce7f-46e5-877e-02abaeab4452 admin admin] PATH_INFO: `/v3/projects/37d4d54ad58844578c8cfad9b05d3209` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:55.262178 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aed56e-ce7f-46e5-877e-02abaeab4452 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37d4d54ad58844578c8cfad9b05d3209)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:55.265054 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aed56e-ce7f-46e5-877e-02abaeab4452 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:55.322446 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-55aed56e-ce7f-46e5-877e-02abaeab4452 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37d4d54ad58844578c8cfad9b05d3209', 'request_id': 'req-55aed56e-ce7f-46e5-877e-02abaeab4452'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:55.328941 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-55aed56e-ce7f-46e5-877e-02abaeab4452 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37d4d54ad58844578c8cfad9b05d3209', 'request_id': 'req-55aed56e-ce7f-46e5-877e-02abaeab4452'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:55.336691 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-55aed56e-ce7f-46e5-877e-02abaeab4452 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37d4d54ad58844578c8cfad9b05d3209', 'request_id': 'req-55aed56e-ce7f-46e5-877e-02abaeab4452'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:55.349614 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-55aed56e-ce7f-46e5-877e-02abaeab4452 admin admin] The token cache is being invalidate because project 37d4d54ad58844578c8cfad9b05d3209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:58:55.350046 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-55aed56e-ce7f-46e5-877e-02abaeab4452 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:55.350713 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-55aed56e-ce7f-46e5-877e-02abaeab4452 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:55.353946 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1170/2322] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:58:55 2022] DELETE /identity/v3/projects/37d4d54ad58844578c8cfad9b05d3209 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:58:55.356589 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742eebb-905a-431a-9846-0bca3970fe75 service neutron] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:55.367885 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742eebb-905a-431a-9846-0bca3970fe75 service neutron] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:55.427379 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff2a3a-a10a-4e35-86d3-0bdedff84cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:55.428245 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff2a3a-a10a-4e35-86d3-0bdedff84cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:55.428520 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff2a3a-a10a-4e35-86d3-0bdedff84cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:55.428783 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff2a3a-a10a-4e35-86d3-0bdedff84cbb admin admin] PATH_INFO: `/v3/users/713f7c4c88354fc3a7649a695aceb761` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:55.430087 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff2a3a-a10a-4e35-86d3-0bdedff84cbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=713f7c4c88354fc3a7649a695aceb761)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:55.432037 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff2a3a-a10a-4e35-86d3-0bdedff84cbb admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:55.484467 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-9dff2a3a-a10a-4e35-86d3-0bdedff84cbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '713f7c4c88354fc3a7649a695aceb761'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:55.493084 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-9dff2a3a-a10a-4e35-86d3-0bdedff84cbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '713f7c4c88354fc3a7649a695aceb761'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:55.493806 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-9dff2a3a-a10a-4e35-86d3-0bdedff84cbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '713f7c4c88354fc3a7649a695aceb761'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:55.506479 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-9dff2a3a-a10a-4e35-86d3-0bdedff84cbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '713f7c4c88354fc3a7649a695aceb761'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:55.507152 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-9dff2a3a-a10a-4e35-86d3-0bdedff84cbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '713f7c4c88354fc3a7649a695aceb761'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:55.523467 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1153/2323] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:58:55 2022] DELETE /identity/v3/users/713f7c4c88354fc3a7649a695aceb761 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:58:55.882524 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aed56e-ce7f-46e5-877e-02abaeab4452 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:55.884063 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-55aed56e-ce7f-46e5-877e-02abaeab4452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:55.899963 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aed56e-ce7f-46e5-877e-02abaeab4452 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:55.973209 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f129ab8-d6ce-4419-b561-f2847a77b83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:55.974097 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f129ab8-d6ce-4419-b561-f2847a77b83c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:55.974374 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f129ab8-d6ce-4419-b561-f2847a77b83c admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:55.974633 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f129ab8-d6ce-4419-b561-f2847a77b83c admin admin] PATH_INFO: `/v3/projects/27f3b892fd3b45f7aea9be3e5d5bf56f` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:55.976052 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f129ab8-d6ce-4419-b561-f2847a77b83c admin admin] RBAC: Authorizing `identity:delete_project(project_id=27f3b892fd3b45f7aea9be3e5d5bf56f)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:55.977954 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f129ab8-d6ce-4419-b561-f2847a77b83c admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:56.025511 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-8f129ab8-d6ce-4419-b561-f2847a77b83c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27f3b892fd3b45f7aea9be3e5d5bf56f', 'request_id': 'req-8f129ab8-d6ce-4419-b561-f2847a77b83c'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:56.031734 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-8f129ab8-d6ce-4419-b561-f2847a77b83c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27f3b892fd3b45f7aea9be3e5d5bf56f', 'request_id': 'req-8f129ab8-d6ce-4419-b561-f2847a77b83c'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:56.040781 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-8f129ab8-d6ce-4419-b561-f2847a77b83c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27f3b892fd3b45f7aea9be3e5d5bf56f', 'request_id': 'req-8f129ab8-d6ce-4419-b561-f2847a77b83c'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:56.058878 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-8f129ab8-d6ce-4419-b561-f2847a77b83c admin admin] The token cache is being invalidate because project 27f3b892fd3b45f7aea9be3e5d5bf56f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:58:56.059433 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-8f129ab8-d6ce-4419-b561-f2847a77b83c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:56.060551 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-8f129ab8-d6ce-4419-b561-f2847a77b83c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:56.063189 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1171/2324] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:58:55 2022] DELETE /identity/v3/projects/27f3b892fd3b45f7aea9be3e5d5bf56f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:58:56.070117 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7794e2-8e80-462e-b93d-760a6f0f73d5 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:56.070916 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7794e2-8e80-462e-b93d-760a6f0f73d5 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:56.071106 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7794e2-8e80-462e-b93d-760a6f0f73d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:56.102054 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-9a7794e2-8e80-462e-b93d-760a6f0f73d5 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:58:56.103451 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-9a7794e2-8e80-462e-b93d-760a6f0f73d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:56.178442 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1154/2325] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:58:56.187419 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba87c2b-afe5-45df-81c9-1ac9a3871c60 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:56.187688 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba87c2b-afe5-45df-81c9-1ac9a3871c60 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:56.187994 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba87c2b-afe5-45df-81c9-1ac9a3871c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:56.214438 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-2ba87c2b-afe5-45df-81c9-1ac9a3871c60 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:58:56.216462 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-2ba87c2b-afe5-45df-81c9-1ac9a3871c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:56.230143 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1172/2326] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:58:56.236958 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7794e2-8e80-462e-b93d-760a6f0f73d5 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:56.247782 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7794e2-8e80-462e-b93d-760a6f0f73d5 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:56.253212 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f57fc-18d4-4bf0-aa95-75191e871029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:56.254256 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f57fc-18d4-4bf0-aa95-75191e871029 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:56.254703 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f57fc-18d4-4bf0-aa95-75191e871029 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:56.255189 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f57fc-18d4-4bf0-aa95-75191e871029 admin admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:56.256369 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f57fc-18d4-4bf0-aa95-75191e871029 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:58:56.256865 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f57fc-18d4-4bf0-aa95-75191e871029 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:56.259336 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f57fc-18d4-4bf0-aa95-75191e871029 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:56.276241 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1155/2327] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:58:56.280530 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba87c2b-afe5-45df-81c9-1ac9a3871c60 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:56.291342 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba87c2b-afe5-45df-81c9-1ac9a3871c60 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:56.296160 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f364be-423c-44d4-bb08-bd1a6474fb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:56.296827 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f364be-423c-44d4-bb08-bd1a6474fb6b admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:56.297131 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f364be-423c-44d4-bb08-bd1a6474fb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:56.297402 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f364be-423c-44d4-bb08-bd1a6474fb6b admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:56.298185 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f364be-423c-44d4-bb08-bd1a6474fb6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:56.300268 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f364be-423c-44d4-bb08-bd1a6474fb6b admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:56.327432 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1173/2328] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:58:56 2022] POST /identity/v3/projects => generated 359 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:58:56.333032 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f57fc-18d4-4bf0-aa95-75191e871029 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:56.343407 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f57fc-18d4-4bf0-aa95-75191e871029 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:56.418890 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702dff5-4220-4a3f-8991-79f6bf0ee565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:56.423574 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702dff5-4220-4a3f-8991-79f6bf0ee565 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:56.423574 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702dff5-4220-4a3f-8991-79f6bf0ee565 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:56.423574 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702dff5-4220-4a3f-8991-79f6bf0ee565 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:56.423574 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702dff5-4220-4a3f-8991-79f6bf0ee565 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:56.423574 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702dff5-4220-4a3f-8991-79f6bf0ee565 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:56.445567 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1156/2329] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:58:56 2022] POST /identity/v3/users => generated 280 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:58:56.456049 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f364be-423c-44d4-bb08-bd1a6474fb6b admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:56.466666 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f364be-423c-44d4-bb08-bd1a6474fb6b admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:56.472592 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81366243-5853-4787-aa90-1d0ef9eabf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:56.473261 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81366243-5853-4787-aa90-1d0ef9eabf05 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:56.473540 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81366243-5853-4787-aa90-1d0ef9eabf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:56.473864 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81366243-5853-4787-aa90-1d0ef9eabf05 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:56.474594 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81366243-5853-4787-aa90-1d0ef9eabf05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:56.476257 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81366243-5853-4787-aa90-1d0ef9eabf05 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:56.487975 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1174/2330] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:58:56.492266 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702dff5-4220-4a3f-8991-79f6bf0ee565 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:56.509000 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702dff5-4220-4a3f-8991-79f6bf0ee565 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:56.518168 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e4b56-fa07-4b4d-af85-ffa85b315e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:56.519219 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e4b56-fa07-4b4d-af85-ffa85b315e92 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:56.519762 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e4b56-fa07-4b4d-af85-ffa85b315e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:56.520501 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e4b56-fa07-4b4d-af85-ffa85b315e92 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:56.521923 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e4b56-fa07-4b4d-af85-ffa85b315e92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:56.523876 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e4b56-fa07-4b4d-af85-ffa85b315e92 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:56.537656 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1157/2331] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:58:56.540653 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81366243-5853-4787-aa90-1d0ef9eabf05 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:56.552675 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81366243-5853-4787-aa90-1d0ef9eabf05 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:56.557751 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab15bf-10d1-4a87-820a-adaceef5df66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:56.558674 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab15bf-10d1-4a87-820a-adaceef5df66 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:56.558977 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab15bf-10d1-4a87-820a-adaceef5df66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:56.559249 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab15bf-10d1-4a87-820a-adaceef5df66 admin admin] PATH_INFO: `/v3/projects/3dc6d6e3657f4e10824a1f5738988f86/users/3acf59820ddc429bb274a8d93324a6b8/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:56.577158 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab15bf-10d1-4a87-820a-adaceef5df66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dc6d6e3657f4e10824a1f5738988f86, user_id=3acf59820ddc429bb274a8d93324a6b8, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:56.580820 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab15bf-10d1-4a87-820a-adaceef5df66 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:56.597293 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1175/2332] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:58:56 2022] PUT /identity/v3/projects/3dc6d6e3657f4e10824a1f5738988f86/users/3acf59820ddc429bb274a8d93324a6b8/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:58:56.608347 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b31d2c-52a9-44a5-9588-f2421560845b None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:56.608763 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b31d2c-52a9-44a5-9588-f2421560845b None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:56.609068 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b31d2c-52a9-44a5-9588-f2421560845b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:56.637987 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-e6b31d2c-52a9-44a5-9588-f2421560845b None None] MFA Rules not processed for user `3acf59820ddc429bb274a8d93324a6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:58:56.639192 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-e6b31d2c-52a9-44a5-9588-f2421560845b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:56.711033 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1158/2333] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:58:56 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:58:56.746274 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab15bf-10d1-4a87-820a-adaceef5df66 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:56.748080 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-90ab15bf-10d1-4a87-820a-adaceef5df66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:56.806475 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab15bf-10d1-4a87-820a-adaceef5df66 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:56.810474 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24967b95-01de-47b8-ac73-98b522c37930 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:56.811114 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24967b95-01de-47b8-ac73-98b522c37930 service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:56.811395 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24967b95-01de-47b8-ac73-98b522c37930 service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:56.811668 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24967b95-01de-47b8-ac73-98b522c37930 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:56.820965 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24967b95-01de-47b8-ac73-98b522c37930 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:56.822382 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24967b95-01de-47b8-ac73-98b522c37930 service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:56.832230 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1176/2334] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:58:56 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:58:56.848125 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b31d2c-52a9-44a5-9588-f2421560845b None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:56.913390 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b31d2c-52a9-44a5-9588-f2421560845b None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:56.917900 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64cc5b-d2a0-492d-9765-902df4a47bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:56.918750 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64cc5b-d2a0-492d-9765-902df4a47bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:56.919021 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64cc5b-d2a0-492d-9765-902df4a47bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:56.919284 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64cc5b-d2a0-492d-9765-902df4a47bf4 admin admin] PATH_INFO: `/v3/users/3acf59820ddc429bb274a8d93324a6b8` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:56.920488 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64cc5b-d2a0-492d-9765-902df4a47bf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3acf59820ddc429bb274a8d93324a6b8)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:56.922413 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64cc5b-d2a0-492d-9765-902df4a47bf4 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:56.977985 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-2b64cc5b-d2a0-492d-9765-902df4a47bf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3acf59820ddc429bb274a8d93324a6b8'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:56.986308 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-2b64cc5b-d2a0-492d-9765-902df4a47bf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3acf59820ddc429bb274a8d93324a6b8'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:56.987018 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-2b64cc5b-d2a0-492d-9765-902df4a47bf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3acf59820ddc429bb274a8d93324a6b8'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:56.998916 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-2b64cc5b-d2a0-492d-9765-902df4a47bf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3acf59820ddc429bb274a8d93324a6b8'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:56.999613 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-2b64cc5b-d2a0-492d-9765-902df4a47bf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3acf59820ddc429bb274a8d93324a6b8'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:57.013505 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1159/2335] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:58:56 2022] DELETE /identity/v3/users/3acf59820ddc429bb274a8d93324a6b8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:58:57.018600 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff6b92-7a0e-42c7-9c4e-9108ec76760f None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:57.018876 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff6b92-7a0e-42c7-9c4e-9108ec76760f None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:57.019148 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff6b92-7a0e-42c7-9c4e-9108ec76760f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:57.038295 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-11ff6b92-7a0e-42c7-9c4e-9108ec76760f None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:58:57.039500 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-11ff6b92-7a0e-42c7-9c4e-9108ec76760f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:57.100871 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1177/2336] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:58:57.110761 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64cc5b-d2a0-492d-9765-902df4a47bf4 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:57.112447 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-2b64cc5b-d2a0-492d-9765-902df4a47bf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:57.171417 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64cc5b-d2a0-492d-9765-902df4a47bf4 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:57.175304 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c5a34-f006-46db-9a68-0a2e8eb2938b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:57.175984 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c5a34-f006-46db-9a68-0a2e8eb2938b service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:57.176277 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c5a34-f006-46db-9a68-0a2e8eb2938b service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:57.176507 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c5a34-f006-46db-9a68-0a2e8eb2938b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:57.185411 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c5a34-f006-46db-9a68-0a2e8eb2938b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:57.186834 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c5a34-f006-46db-9a68-0a2e8eb2938b service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:57.196454 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1160/2337] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:58:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:58:57.478620 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff6b92-7a0e-42c7-9c4e-9108ec76760f None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:57.480642 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-11ff6b92-7a0e-42c7-9c4e-9108ec76760f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:57.496540 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff6b92-7a0e-42c7-9c4e-9108ec76760f None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:57.504524 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cd7ba-33d5-43b0-a17e-069411a7a1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:57.506038 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cd7ba-33d5-43b0-a17e-069411a7a1ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:57.506529 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cd7ba-33d5-43b0-a17e-069411a7a1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:57.507006 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cd7ba-33d5-43b0-a17e-069411a7a1ed admin admin] PATH_INFO: `/v3/projects/3dc6d6e3657f4e10824a1f5738988f86` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:57.510546 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210cd7ba-33d5-43b0-a17e-069411a7a1ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dc6d6e3657f4e10824a1f5738988f86)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:57.511633 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210cd7ba-33d5-43b0-a17e-069411a7a1ed admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:57.581451 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-210cd7ba-33d5-43b0-a17e-069411a7a1ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dc6d6e3657f4e10824a1f5738988f86', 'request_id': 'req-210cd7ba-33d5-43b0-a17e-069411a7a1ed'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:57.587239 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-210cd7ba-33d5-43b0-a17e-069411a7a1ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dc6d6e3657f4e10824a1f5738988f86', 'request_id': 'req-210cd7ba-33d5-43b0-a17e-069411a7a1ed'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:57.597550 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-210cd7ba-33d5-43b0-a17e-069411a7a1ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dc6d6e3657f4e10824a1f5738988f86', 'request_id': 'req-210cd7ba-33d5-43b0-a17e-069411a7a1ed'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:57.618871 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-210cd7ba-33d5-43b0-a17e-069411a7a1ed admin admin] The token cache is being invalidate because project 3dc6d6e3657f4e10824a1f5738988f86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:58:57.619416 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-210cd7ba-33d5-43b0-a17e-069411a7a1ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:57.620530 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-210cd7ba-33d5-43b0-a17e-069411a7a1ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:58:57.623226 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1178/2338] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:58:57 2022] DELETE /identity/v3/projects/3dc6d6e3657f4e10824a1f5738988f86 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:58:57.630123 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c80eee-ac0e-445d-ad24-8b106e923296 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:57.630612 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c80eee-ac0e-445d-ad24-8b106e923296 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:57.631110 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c80eee-ac0e-445d-ad24-8b106e923296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:57.661515 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-46c80eee-ac0e-445d-ad24-8b106e923296 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:58:57.663159 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-46c80eee-ac0e-445d-ad24-8b106e923296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:57.730395 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1161/2339] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:58:57.740530 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1940c22-718b-4463-973b-2c7d6aee09aa None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:57.740817 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1940c22-718b-4463-973b-2c7d6aee09aa None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:57.741090 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1940c22-718b-4463-973b-2c7d6aee09aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:57.761506 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-b1940c22-718b-4463-973b-2c7d6aee09aa None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:58:57.762745 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-b1940c22-718b-4463-973b-2c7d6aee09aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:57.772285 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1179/2340] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:58:57.777696 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c80eee-ac0e-445d-ad24-8b106e923296 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:57.789437 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c80eee-ac0e-445d-ad24-8b106e923296 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:57.794496 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f269bd-bd95-4dfa-9606-81b234619807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:57.795160 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f269bd-bd95-4dfa-9606-81b234619807 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:57.795445 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f269bd-bd95-4dfa-9606-81b234619807 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:57.795716 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f269bd-bd95-4dfa-9606-81b234619807 admin admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:57.796574 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f269bd-bd95-4dfa-9606-81b234619807 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:58:57.796882 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f269bd-bd95-4dfa-9606-81b234619807 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:57.798680 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f269bd-bd95-4dfa-9606-81b234619807 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:57.814092 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1162/2341] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:58:57.818683 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1940c22-718b-4463-973b-2c7d6aee09aa None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:57.828167 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1940c22-718b-4463-973b-2c7d6aee09aa None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:57.833715 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5edb8-6525-4357-936e-0b8c28d3aed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:57.834377 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5edb8-6525-4357-936e-0b8c28d3aed1 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:57.834653 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5edb8-6525-4357-936e-0b8c28d3aed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:57.834922 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5edb8-6525-4357-936e-0b8c28d3aed1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:57.835616 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc5edb8-6525-4357-936e-0b8c28d3aed1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:57.837751 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc5edb8-6525-4357-936e-0b8c28d3aed1 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:57.866335 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1180/2342] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:58:57 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:58:57.870410 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f269bd-bd95-4dfa-9606-81b234619807 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:57.880557 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f269bd-bd95-4dfa-9606-81b234619807 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:57.941490 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131ca45-99fc-471c-a3b8-394ae0b78af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:57.942334 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131ca45-99fc-471c-a3b8-394ae0b78af3 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:57.942607 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131ca45-99fc-471c-a3b8-394ae0b78af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:57.942955 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131ca45-99fc-471c-a3b8-394ae0b78af3 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:57.944193 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131ca45-99fc-471c-a3b8-394ae0b78af3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:57.946352 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131ca45-99fc-471c-a3b8-394ae0b78af3 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:57.971467 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1163/2343] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:58:57 2022] POST /identity/v3/users => generated 284 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:58:57.975947 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5edb8-6525-4357-936e-0b8c28d3aed1 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:57.986413 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5edb8-6525-4357-936e-0b8c28d3aed1 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:57.990949 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7da77-59c9-42df-8627-849bf8c53828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:57.991601 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7da77-59c9-42df-8627-849bf8c53828 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:57.991902 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7da77-59c9-42df-8627-849bf8c53828 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:57.992175 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7da77-59c9-42df-8627-849bf8c53828 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:57.992902 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d7da77-59c9-42df-8627-849bf8c53828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:57.994476 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d7da77-59c9-42df-8627-849bf8c53828 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:58.005521 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1181/2344] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:58:58.009721 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131ca45-99fc-471c-a3b8-394ae0b78af3 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:58.020869 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131ca45-99fc-471c-a3b8-394ae0b78af3 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:58.026960 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40095947-9dab-47e5-972b-bb8ced0204de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:58.027545 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40095947-9dab-47e5-972b-bb8ced0204de admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:58.027826 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40095947-9dab-47e5-972b-bb8ced0204de admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:58.028048 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40095947-9dab-47e5-972b-bb8ced0204de admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:58.028870 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40095947-9dab-47e5-972b-bb8ced0204de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:58.030760 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40095947-9dab-47e5-972b-bb8ced0204de admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:58.042474 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1164/2345] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:58:58.046819 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7da77-59c9-42df-8627-849bf8c53828 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:58.056930 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7da77-59c9-42df-8627-849bf8c53828 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:58.061571 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298e9fd-4980-4a60-98cf-2c915fa0191c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:58.062455 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298e9fd-4980-4a60-98cf-2c915fa0191c admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:58.062732 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298e9fd-4980-4a60-98cf-2c915fa0191c admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:58.063006 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298e9fd-4980-4a60-98cf-2c915fa0191c admin admin] PATH_INFO: `/v3/projects/ea5496dc24e142b187d42932c2a24842/users/b10c059b1d8a4920a650f10abcab318a/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:58.077600 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298e9fd-4980-4a60-98cf-2c915fa0191c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea5496dc24e142b187d42932c2a24842, user_id=b10c059b1d8a4920a650f10abcab318a, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:58.080818 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298e9fd-4980-4a60-98cf-2c915fa0191c admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:58.093793 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1182/2346] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:58:58 2022] PUT /identity/v3/projects/ea5496dc24e142b187d42932c2a24842/users/b10c059b1d8a4920a650f10abcab318a/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:58:58.104510 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20d2f9-e48a-450e-b1e8-201ad8357655 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:58.104792 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20d2f9-e48a-450e-b1e8-201ad8357655 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:58.105062 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20d2f9-e48a-450e-b1e8-201ad8357655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:58.132340 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-8f20d2f9-e48a-450e-b1e8-201ad8357655 None None] MFA Rules not processed for user `b10c059b1d8a4920a650f10abcab318a`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:58:58.133526 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-8f20d2f9-e48a-450e-b1e8-201ad8357655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:58.199585 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1165/2347] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:58:58 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:58:58.211664 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298e9fd-4980-4a60-98cf-2c915fa0191c admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:58:58.213501 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-0298e9fd-4980-4a60-98cf-2c915fa0191c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:58:58.274244 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298e9fd-4980-4a60-98cf-2c915fa0191c admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:58:58.278076 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc9d94-270c-4db0-aeff-9554392e9d09 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05029a41bd2b42febfd5ce91a3f28c24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:58:58.278723 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc9d94-270c-4db0-aeff-9554392e9d09 service glance] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:58:58.279001 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc9d94-270c-4db0-aeff-9554392e9d09 service glance] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:58:58.279272 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc9d94-270c-4db0-aeff-9554392e9d09 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:58:58.288457 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc9d94-270c-4db0-aeff-9554392e9d09 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:58:58.289883 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc9d94-270c-4db0-aeff-9554392e9d09 service glance] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:58:58.299101 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1183/2348] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:58:58 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:59:00.996387 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20d2f9-e48a-450e-b1e8-201ad8357655 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:00.998149 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-8f20d2f9-e48a-450e-b1e8-201ad8357655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:01.084533 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20d2f9-e48a-450e-b1e8-201ad8357655 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:01.091195 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115939cf-8d39-4672-b61b-a813bf156f59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:01.092335 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115939cf-8d39-4672-b61b-a813bf156f59 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:01.092825 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115939cf-8d39-4672-b61b-a813bf156f59 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:01.093908 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115939cf-8d39-4672-b61b-a813bf156f59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:01.096885 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-115939cf-8d39-4672-b61b-a813bf156f59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:01.110765 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115939cf-8d39-4672-b61b-a813bf156f59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:01.112678 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115939cf-8d39-4672-b61b-a813bf156f59 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:01.123091 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1166/2349] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:59:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:59:01.690628 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63115b9-34c6-49dd-9876-bb46aaefe201 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:01.690628 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63115b9-34c6-49dd-9876-bb46aaefe201 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:01.690628 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63115b9-34c6-49dd-9876-bb46aaefe201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:01.714342 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-d63115b9-34c6-49dd-9876-bb46aaefe201 None None] MFA Rules not processed for user `78cde480dd8b4a85ac30895026bfc406`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:59:01.716505 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-d63115b9-34c6-49dd-9876-bb46aaefe201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:01.807075 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1184/2350] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Oct 28 20:59:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:59:01.915127 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115939cf-8d39-4672-b61b-a813bf156f59 service neutron] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:01.917141 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-115939cf-8d39-4672-b61b-a813bf156f59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:02.086231 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115939cf-8d39-4672-b61b-a813bf156f59 service neutron] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:02.096283 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f49217-19e7-4ee9-9d5f-5d7026cd55d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d70db11d2d4923943bc6479bc49206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:02.097416 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f49217-19e7-4ee9-9d5f-5d7026cd55d4 service swift] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:02.097816 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f49217-19e7-4ee9-9d5f-5d7026cd55d4 service swift] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:02.098198 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f49217-19e7-4ee9-9d5f-5d7026cd55d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:02.108311 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f49217-19e7-4ee9-9d5f-5d7026cd55d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:02.112626 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f49217-19e7-4ee9-9d5f-5d7026cd55d4 service swift] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:02.123310 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1167/2351] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Oct 28 20:59:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 20:59:05.959368 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed92db-ab9a-43b2-8d73-c941dab78c76 None None] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:05.961060 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed92db-ab9a-43b2-8d73-c941dab78c76 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:05.961646 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed92db-ab9a-43b2-8d73-c941dab78c76 None None] PATH_INFO: `/` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:05.964269 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1185/2352] 10.222.0.49 () {54 vars in 921 bytes} [Fri Oct 28 20:59:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:59:05.977271 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb0824-992f-498d-b3b7-82c3fae7e307 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:05.980485 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb0824-992f-498d-b3b7-82c3fae7e307 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:05.980728 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb0824-992f-498d-b3b7-82c3fae7e307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:06.017278 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-cedb0824-992f-498d-b3b7-82c3fae7e307 None None] MFA Rules not processed for user `691a2da563a84da48ca8fd75a0bfe787`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:59:06.019324 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-cedb0824-992f-498d-b3b7-82c3fae7e307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:06.049640 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1168/2353] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Oct 28 20:59:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:59:06.057125 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed92db-ab9a-43b2-8d73-c941dab78c76 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:06.073101 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed92db-ab9a-43b2-8d73-c941dab78c76 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:06.086008 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9cf3e-05ab-44d6-ad83-1d1fc85ed391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:06.088909 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9cf3e-05ab-44d6-ad83-1d1fc85ed391 service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:06.090080 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9cf3e-05ab-44d6-ad83-1d1fc85ed391 service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:06.091391 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9cf3e-05ab-44d6-ad83-1d1fc85ed391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:06.147637 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9cf3e-05ab-44d6-ad83-1d1fc85ed391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:06.156390 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9cf3e-05ab-44d6-ad83-1d1fc85ed391 service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:06.244023 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1186/2354] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:59:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:59:06.506800 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b91a02-1c9a-4a4c-9a3d-d7ff3560e415 None None] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:06.507128 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b91a02-1c9a-4a4c-9a3d-d7ff3560e415 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:06.507370 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b91a02-1c9a-4a4c-9a3d-d7ff3560e415 None None] PATH_INFO: `/` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:06.510107 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1169/2355] 10.222.0.49 () {54 vars in 921 bytes} [Fri Oct 28 20:59:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 20:59:06.524427 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02207878-d239-4656-9885-ffd1edffbb10 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:06.525317 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02207878-d239-4656-9885-ffd1edffbb10 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:06.525823 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02207878-d239-4656-9885-ffd1edffbb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:06.578351 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-02207878-d239-4656-9885-ffd1edffbb10 None None] MFA Rules not processed for user `04bc6ee009e34a5f82e2807db51523d3`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:59:06.586161 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-02207878-d239-4656-9885-ffd1edffbb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:06.742874 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1187/2356] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Oct 28 20:59:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:59:06.770521 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b91a02-1c9a-4a4c-9a3d-d7ff3560e415 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:06.790678 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b91a02-1c9a-4a4c-9a3d-d7ff3560e415 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:06.797677 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954b58a-b72b-4b81-9224-5f97090556a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:06.800846 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954b58a-b72b-4b81-9224-5f97090556a8 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:06.801921 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954b58a-b72b-4b81-9224-5f97090556a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:06.804630 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954b58a-b72b-4b81-9224-5f97090556a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:06.833327 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9954b58a-b72b-4b81-9224-5f97090556a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:06.835912 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9954b58a-b72b-4b81-9224-5f97090556a8 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:06.868829 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1170/2357] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:59:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:59:06.957176 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02207878-d239-4656-9885-ffd1edffbb10 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:06.959290 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-02207878-d239-4656-9885-ffd1edffbb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:07.001803 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02207878-d239-4656-9885-ffd1edffbb10 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:07.011940 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aefb58-2916-44e3-a7cc-76108ccc71bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:07.012869 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aefb58-2916-44e3-a7cc-76108ccc71bc service nova] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:07.013404 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aefb58-2916-44e3-a7cc-76108ccc71bc service nova] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:07.013896 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aefb58-2916-44e3-a7cc-76108ccc71bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:07.017851 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-30aefb58-2916-44e3-a7cc-76108ccc71bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:07.038860 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954b58a-b72b-4b81-9224-5f97090556a8 service neutron] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:07.043825 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-9954b58a-b72b-4b81-9224-5f97090556a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:07.046910 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aefb58-2916-44e3-a7cc-76108ccc71bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:07.076085 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aefb58-2916-44e3-a7cc-76108ccc71bc service nova] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:07.101837 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1188/2358] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:59:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:59:07.207928 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954b58a-b72b-4b81-9224-5f97090556a8 service neutron] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:07.215103 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b011f-806b-4801-9fca-c560d6c3bc14 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '938634e835b94a75af698aef6941958f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:07.215817 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b011f-806b-4801-9fca-c560d6c3bc14 service placement] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:07.216100 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b011f-806b-4801-9fca-c560d6c3bc14 service placement] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:07.216364 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b011f-806b-4801-9fca-c560d6c3bc14 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:07.221786 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-1e9b011f-806b-4801-9fca-c560d6c3bc14 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:07.242062 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b011f-806b-4801-9fca-c560d6c3bc14 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:07.245445 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b011f-806b-4801-9fca-c560d6c3bc14 service placement] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:07.284103 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1171/2359] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:59:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:59:27.706848 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671f52d-316c-436a-b0f7-7e8d6d4425a7 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:27.707520 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671f52d-316c-436a-b0f7-7e8d6d4425a7 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:27.707858 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671f52d-316c-436a-b0f7-7e8d6d4425a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:27.731246 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-2671f52d-316c-436a-b0f7-7e8d6d4425a7 None None] MFA Rules not processed for user `78cde480dd8b4a85ac30895026bfc406`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:59:27.732532 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-2671f52d-316c-436a-b0f7-7e8d6d4425a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:27.743265 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1189/2360] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Oct 28 20:59:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:59:27.758390 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b011f-806b-4801-9fca-c560d6c3bc14 service placement] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:27.773437 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b011f-806b-4801-9fca-c560d6c3bc14 service placement] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:27.781045 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea75019-d3f7-4150-8bfd-7f07eab42e92 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d70db11d2d4923943bc6479bc49206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:27.781761 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea75019-d3f7-4150-8bfd-7f07eab42e92 service swift] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:27.782044 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea75019-d3f7-4150-8bfd-7f07eab42e92 service swift] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:27.782534 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea75019-d3f7-4150-8bfd-7f07eab42e92 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:27.798335 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea75019-d3f7-4150-8bfd-7f07eab42e92 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:27.800131 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea75019-d3f7-4150-8bfd-7f07eab42e92 service swift] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:27.810300 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1172/2361] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Oct 28 20:59:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 20:59:29.940797 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671f52d-316c-436a-b0f7-7e8d6d4425a7 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:29.973357 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671f52d-316c-436a-b0f7-7e8d6d4425a7 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:29.986748 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5334843b-ecbc-4f84-a4a7-0871926b0674 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:29.987836 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334843b-ecbc-4f84-a4a7-0871926b0674 service nova] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:29.988489 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334843b-ecbc-4f84-a4a7-0871926b0674 service nova] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:29.988969 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334843b-ecbc-4f84-a4a7-0871926b0674 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:29.991543 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-5334843b-ecbc-4f84-a4a7-0871926b0674 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:30.010171 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5334843b-ecbc-4f84-a4a7-0871926b0674 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:30.012789 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5334843b-ecbc-4f84-a4a7-0871926b0674 service nova] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:30.046409 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1190/2362] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:59:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:59:32.255896 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea75019-d3f7-4150-8bfd-7f07eab42e92 service swift] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:32.360852 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea75019-d3f7-4150-8bfd-7f07eab42e92 service swift] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:32.369899 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3281499-7351-4408-bbdf-fa5e67e70758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:32.371994 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3281499-7351-4408-bbdf-fa5e67e70758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:32.372466 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3281499-7351-4408-bbdf-fa5e67e70758 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:32.373030 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3281499-7351-4408-bbdf-fa5e67e70758 admin admin] PATH_INFO: `/v3/users/b10c059b1d8a4920a650f10abcab318a` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:32.375635 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3281499-7351-4408-bbdf-fa5e67e70758 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b10c059b1d8a4920a650f10abcab318a)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:32.377946 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3281499-7351-4408-bbdf-fa5e67e70758 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:32.466245 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-a3281499-7351-4408-bbdf-fa5e67e70758 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b10c059b1d8a4920a650f10abcab318a'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:32.483430 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-a3281499-7351-4408-bbdf-fa5e67e70758 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b10c059b1d8a4920a650f10abcab318a'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:32.484730 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-a3281499-7351-4408-bbdf-fa5e67e70758 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b10c059b1d8a4920a650f10abcab318a'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:32.498870 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-a3281499-7351-4408-bbdf-fa5e67e70758 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b10c059b1d8a4920a650f10abcab318a'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:32.499697 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-a3281499-7351-4408-bbdf-fa5e67e70758 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b10c059b1d8a4920a650f10abcab318a'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:32.519225 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1173/2363] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:59:32 2022] DELETE /identity/v3/users/b10c059b1d8a4920a650f10abcab318a => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:59:32.524586 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530b623-78ea-429a-9900-c8a3f77e2f69 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:32.525542 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530b623-78ea-429a-9900-c8a3f77e2f69 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:32.525886 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530b623-78ea-429a-9900-c8a3f77e2f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:32.555363 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-6530b623-78ea-429a-9900-c8a3f77e2f69 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:59:32.557900 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-6530b623-78ea-429a-9900-c8a3f77e2f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:32.698383 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1191/2364] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:59:32.727821 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3281499-7351-4408-bbdf-fa5e67e70758 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:32.731185 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-a3281499-7351-4408-bbdf-fa5e67e70758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:32.841467 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3281499-7351-4408-bbdf-fa5e67e70758 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:32.846780 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9826a-4fd7-48ea-945c-d4033d6f6f88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:32.847477 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9826a-4fd7-48ea-945c-d4033d6f6f88 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:32.847787 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9826a-4fd7-48ea-945c-d4033d6f6f88 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:32.848118 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9826a-4fd7-48ea-945c-d4033d6f6f88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:32.858704 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9826a-4fd7-48ea-945c-d4033d6f6f88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:32.860628 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9826a-4fd7-48ea-945c-d4033d6f6f88 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:32.895414 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1174/2365] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:59:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:59:33.316816 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530b623-78ea-429a-9900-c8a3f77e2f69 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:33.319177 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-6530b623-78ea-429a-9900-c8a3f77e2f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:33.339573 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530b623-78ea-429a-9900-c8a3f77e2f69 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:33.346060 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556d5e6-ddd2-4ba7-a36c-bba34a3b503e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:33.354634 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556d5e6-ddd2-4ba7-a36c-bba34a3b503e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:33.355120 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556d5e6-ddd2-4ba7-a36c-bba34a3b503e admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:33.355542 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556d5e6-ddd2-4ba7-a36c-bba34a3b503e admin admin] PATH_INFO: `/v3/projects/ea5496dc24e142b187d42932c2a24842` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:33.357695 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556d5e6-ddd2-4ba7-a36c-bba34a3b503e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea5496dc24e142b187d42932c2a24842)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:33.362034 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556d5e6-ddd2-4ba7-a36c-bba34a3b503e admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:33.443301 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-b556d5e6-ddd2-4ba7-a36c-bba34a3b503e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea5496dc24e142b187d42932c2a24842', 'request_id': 'req-b556d5e6-ddd2-4ba7-a36c-bba34a3b503e'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:33.450957 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-b556d5e6-ddd2-4ba7-a36c-bba34a3b503e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea5496dc24e142b187d42932c2a24842', 'request_id': 'req-b556d5e6-ddd2-4ba7-a36c-bba34a3b503e'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:33.466767 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-b556d5e6-ddd2-4ba7-a36c-bba34a3b503e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea5496dc24e142b187d42932c2a24842', 'request_id': 'req-b556d5e6-ddd2-4ba7-a36c-bba34a3b503e'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:33.498693 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-b556d5e6-ddd2-4ba7-a36c-bba34a3b503e admin admin] The token cache is being invalidate because project ea5496dc24e142b187d42932c2a24842 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:59:33.499063 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-b556d5e6-ddd2-4ba7-a36c-bba34a3b503e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:33.501236 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-b556d5e6-ddd2-4ba7-a36c-bba34a3b503e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:33.502668 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1192/2366] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:59:33 2022] DELETE /identity/v3/projects/ea5496dc24e142b187d42932c2a24842 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:59:33.507726 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb6918-1e69-437d-aba9-3b23264e3d2c None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:33.508347 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb6918-1e69-437d-aba9-3b23264e3d2c None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:33.508470 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb6918-1e69-437d-aba9-3b23264e3d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:33.540315 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-d7fb6918-1e69-437d-aba9-3b23264e3d2c None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:59:33.541841 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-d7fb6918-1e69-437d-aba9-3b23264e3d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:33.651817 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1175/2367] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:59:33.655152 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0836d1f-7262-485e-88b1-2024f9f5e4ea None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:33.655691 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0836d1f-7262-485e-88b1-2024f9f5e4ea None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:33.656072 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0836d1f-7262-485e-88b1-2024f9f5e4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:33.692296 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-f0836d1f-7262-485e-88b1-2024f9f5e4ea None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:59:33.693955 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-f0836d1f-7262-485e-88b1-2024f9f5e4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:33.705729 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1193/2368] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:59:33.710375 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb6918-1e69-437d-aba9-3b23264e3d2c None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:33.728135 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb6918-1e69-437d-aba9-3b23264e3d2c None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:33.737745 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada88df-369c-4db6-97a8-fd3d0ba80856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:33.739352 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada88df-369c-4db6-97a8-fd3d0ba80856 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:33.739643 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada88df-369c-4db6-97a8-fd3d0ba80856 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:33.739953 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada88df-369c-4db6-97a8-fd3d0ba80856 admin admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:33.740703 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada88df-369c-4db6-97a8-fd3d0ba80856 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:59:33.741014 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada88df-369c-4db6-97a8-fd3d0ba80856 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:33.758686 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada88df-369c-4db6-97a8-fd3d0ba80856 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:33.817615 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0836d1f-7262-485e-88b1-2024f9f5e4ea None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:33.817980 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1176/2369] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:59:33.851281 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0836d1f-7262-485e-88b1-2024f9f5e4ea None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:33.889024 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1fb7b0-3611-42be-aff3-fd4f13ce7a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:33.891349 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1fb7b0-3611-42be-aff3-fd4f13ce7a9b admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:33.896028 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1fb7b0-3611-42be-aff3-fd4f13ce7a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:33.896491 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1fb7b0-3611-42be-aff3-fd4f13ce7a9b admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:33.897255 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1fb7b0-3611-42be-aff3-fd4f13ce7a9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:33.899644 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1fb7b0-3611-42be-aff3-fd4f13ce7a9b admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:34.006578 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1194/2370] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:59:33 2022] POST /identity/v3/projects => generated 369 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:59:34.010595 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada88df-369c-4db6-97a8-fd3d0ba80856 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:34.023627 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada88df-369c-4db6-97a8-fd3d0ba80856 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:34.107098 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebc477-19bd-431a-9ba8-4f92f9f029c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:34.108154 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebc477-19bd-431a-9ba8-4f92f9f029c5 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:34.108594 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebc477-19bd-431a-9ba8-4f92f9f029c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:34.109144 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebc477-19bd-431a-9ba8-4f92f9f029c5 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:34.110238 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ebc477-19bd-431a-9ba8-4f92f9f029c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:34.113594 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ebc477-19bd-431a-9ba8-4f92f9f029c5 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:34.152961 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1177/2371] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:59:34 2022] POST /identity/v3/users => generated 285 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:59:34.158628 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1fb7b0-3611-42be-aff3-fd4f13ce7a9b admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:34.170596 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1fb7b0-3611-42be-aff3-fd4f13ce7a9b admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:34.176242 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f79db-19ad-4e2f-ac6b-b97cc0117dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:34.177336 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f79db-19ad-4e2f-ac6b-b97cc0117dfb admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:34.177612 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f79db-19ad-4e2f-ac6b-b97cc0117dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:34.177914 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f79db-19ad-4e2f-ac6b-b97cc0117dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:34.178682 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f79db-19ad-4e2f-ac6b-b97cc0117dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:34.184829 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f79db-19ad-4e2f-ac6b-b97cc0117dfb admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:34.204631 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1195/2372] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:59:34.205254 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebc477-19bd-431a-9ba8-4f92f9f029c5 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:34.218827 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebc477-19bd-431a-9ba8-4f92f9f029c5 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:34.234845 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d21c0-8edc-49f3-90b1-be3d944caf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:34.236486 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d21c0-8edc-49f3-90b1-be3d944caf86 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:34.237364 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d21c0-8edc-49f3-90b1-be3d944caf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:34.238630 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d21c0-8edc-49f3-90b1-be3d944caf86 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:34.240711 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d21c0-8edc-49f3-90b1-be3d944caf86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:34.244263 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d21c0-8edc-49f3-90b1-be3d944caf86 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:34.267247 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1178/2373] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:59:34.269386 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f79db-19ad-4e2f-ac6b-b97cc0117dfb admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:34.303767 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f79db-19ad-4e2f-ac6b-b97cc0117dfb admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:34.311593 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0bb64-73bd-4363-8f52-097b1c65601d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:34.313627 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0bb64-73bd-4363-8f52-097b1c65601d admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:34.313998 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0bb64-73bd-4363-8f52-097b1c65601d admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:34.314383 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0bb64-73bd-4363-8f52-097b1c65601d admin admin] PATH_INFO: `/v3/projects/ac7ae36dbe3b437893ebc000587f5e7d/users/99049c736a7742c1ae8f6f7093db9f65/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:34.333264 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0bb64-73bd-4363-8f52-097b1c65601d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac7ae36dbe3b437893ebc000587f5e7d, user_id=99049c736a7742c1ae8f6f7093db9f65, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:34.336399 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0bb64-73bd-4363-8f52-097b1c65601d admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:34.366799 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1196/2374] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:59:34 2022] PUT /identity/v3/projects/ac7ae36dbe3b437893ebc000587f5e7d/users/99049c736a7742c1ae8f6f7093db9f65/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:59:34.385854 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06cb76-2e61-4c64-84e5-0cdc32cc6fe9 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:34.386356 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06cb76-2e61-4c64-84e5-0cdc32cc6fe9 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:34.386834 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06cb76-2e61-4c64-84e5-0cdc32cc6fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:34.435983 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-fa06cb76-2e61-4c64-84e5-0cdc32cc6fe9 None None] MFA Rules not processed for user `99049c736a7742c1ae8f6f7093db9f65`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:59:34.438881 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-fa06cb76-2e61-4c64-84e5-0cdc32cc6fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:34.530186 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1179/2375] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:59:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:59:34.544261 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0bb64-73bd-4363-8f52-097b1c65601d admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:34.547253 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-12d0bb64-73bd-4363-8f52-097b1c65601d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:34.627845 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0bb64-73bd-4363-8f52-097b1c65601d admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:34.643788 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cd80a-6aed-4fde-9a72-cf4b6f614a16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:34.643788 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cd80a-6aed-4fde-9a72-cf4b6f614a16 service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:34.643788 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cd80a-6aed-4fde-9a72-cf4b6f614a16 service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:34.643788 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cd80a-6aed-4fde-9a72-cf4b6f614a16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:34.658368 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5cd80a-6aed-4fde-9a72-cf4b6f614a16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:34.660372 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5cd80a-6aed-4fde-9a72-cf4b6f614a16 service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:34.683915 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1197/2376] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:59:34 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:59:34.717058 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06cb76-2e61-4c64-84e5-0cdc32cc6fe9 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:34.852160 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06cb76-2e61-4c64-84e5-0cdc32cc6fe9 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:34.858124 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdce80b-f5ef-480e-9cc2-817b9239688f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:34.859672 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdce80b-f5ef-480e-9cc2-817b9239688f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:34.860245 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdce80b-f5ef-480e-9cc2-817b9239688f admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:34.860679 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdce80b-f5ef-480e-9cc2-817b9239688f admin admin] PATH_INFO: `/v3/users/99049c736a7742c1ae8f6f7093db9f65` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:34.862716 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdce80b-f5ef-480e-9cc2-817b9239688f admin admin] RBAC: Authorizing `identity:delete_user(user_id=99049c736a7742c1ae8f6f7093db9f65)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:34.865379 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdce80b-f5ef-480e-9cc2-817b9239688f admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:34.972907 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-dfdce80b-f5ef-480e-9cc2-817b9239688f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99049c736a7742c1ae8f6f7093db9f65'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:34.982209 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-dfdce80b-f5ef-480e-9cc2-817b9239688f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99049c736a7742c1ae8f6f7093db9f65'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:34.983567 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-dfdce80b-f5ef-480e-9cc2-817b9239688f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99049c736a7742c1ae8f6f7093db9f65'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:35.004888 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-dfdce80b-f5ef-480e-9cc2-817b9239688f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99049c736a7742c1ae8f6f7093db9f65'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:35.005699 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-dfdce80b-f5ef-480e-9cc2-817b9239688f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99049c736a7742c1ae8f6f7093db9f65'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:35.025198 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1180/2377] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:59:34 2022] DELETE /identity/v3/users/99049c736a7742c1ae8f6f7093db9f65 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:59:35.030200 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb618f2d-1463-4393-8858-7050f4fb5cb6 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:35.030490 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb618f2d-1463-4393-8858-7050f4fb5cb6 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:35.030996 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb618f2d-1463-4393-8858-7050f4fb5cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:35.073595 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-eb618f2d-1463-4393-8858-7050f4fb5cb6 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:59:35.074849 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-eb618f2d-1463-4393-8858-7050f4fb5cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:35.168320 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1198/2378] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:59:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:59:35.179459 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdce80b-f5ef-480e-9cc2-817b9239688f admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:35.181466 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-dfdce80b-f5ef-480e-9cc2-817b9239688f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:35.270496 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdce80b-f5ef-480e-9cc2-817b9239688f admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:35.275206 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9aba2-dd57-4ea2-bd89-4c09c0d7aa37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:35.275926 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9aba2-dd57-4ea2-bd89-4c09c0d7aa37 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:35.276204 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9aba2-dd57-4ea2-bd89-4c09c0d7aa37 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:35.276477 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9aba2-dd57-4ea2-bd89-4c09c0d7aa37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:35.287622 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9aba2-dd57-4ea2-bd89-4c09c0d7aa37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:35.289160 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9aba2-dd57-4ea2-bd89-4c09c0d7aa37 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:35.302008 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1181/2379] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:59:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:59:35.714034 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb618f2d-1463-4393-8858-7050f4fb5cb6 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:35.717273 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-eb618f2d-1463-4393-8858-7050f4fb5cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:35.776041 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb618f2d-1463-4393-8858-7050f4fb5cb6 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:35.784042 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eaa940-2369-4db0-971a-28ebe4241818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:35.786106 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eaa940-2369-4db0-971a-28ebe4241818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:35.786687 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eaa940-2369-4db0-971a-28ebe4241818 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:35.788230 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eaa940-2369-4db0-971a-28ebe4241818 admin admin] PATH_INFO: `/v3/projects/ac7ae36dbe3b437893ebc000587f5e7d` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:35.790428 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eaa940-2369-4db0-971a-28ebe4241818 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac7ae36dbe3b437893ebc000587f5e7d)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:35.792921 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eaa940-2369-4db0-971a-28ebe4241818 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:35.869714 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-d7eaa940-2369-4db0-971a-28ebe4241818 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac7ae36dbe3b437893ebc000587f5e7d', 'request_id': 'req-d7eaa940-2369-4db0-971a-28ebe4241818'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:35.893027 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-d7eaa940-2369-4db0-971a-28ebe4241818 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac7ae36dbe3b437893ebc000587f5e7d', 'request_id': 'req-d7eaa940-2369-4db0-971a-28ebe4241818'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:35.909489 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-d7eaa940-2369-4db0-971a-28ebe4241818 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac7ae36dbe3b437893ebc000587f5e7d', 'request_id': 'req-d7eaa940-2369-4db0-971a-28ebe4241818'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:35.934479 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-d7eaa940-2369-4db0-971a-28ebe4241818 admin admin] The token cache is being invalidate because project ac7ae36dbe3b437893ebc000587f5e7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:59:35.934795 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-d7eaa940-2369-4db0-971a-28ebe4241818 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:35.939014 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-d7eaa940-2369-4db0-971a-28ebe4241818 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:35.941053 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1199/2380] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:59:35 2022] DELETE /identity/v3/projects/ac7ae36dbe3b437893ebc000587f5e7d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:59:35.950557 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a288f0-4eb3-4ccc-b958-b78255b55f73 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:35.951209 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a288f0-4eb3-4ccc-b958-b78255b55f73 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:35.951889 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a288f0-4eb3-4ccc-b958-b78255b55f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:35.998950 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-83a288f0-4eb3-4ccc-b958-b78255b55f73 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:59:36.002314 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-83a288f0-4eb3-4ccc-b958-b78255b55f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:36.176183 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fc5b8-250c-46eb-a2c4-a8ba65798e87 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:36.176579 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fc5b8-250c-46eb-a2c4-a8ba65798e87 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:36.177142 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fc5b8-250c-46eb-a2c4-a8ba65798e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:36.181239 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1182/2381] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:59:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:59:36.210105 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-1c1fc5b8-250c-46eb-a2c4-a8ba65798e87 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:59:36.212271 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-1c1fc5b8-250c-46eb-a2c4-a8ba65798e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:36.240498 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a288f0-4eb3-4ccc-b958-b78255b55f73 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:36.242232 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1200/2382] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:59:36.267514 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a288f0-4eb3-4ccc-b958-b78255b55f73 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:36.293998 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f380e1d-f962-40fb-bb26-48474ac3fbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:36.295215 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f380e1d-f962-40fb-bb26-48474ac3fbed admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:36.296000 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f380e1d-f962-40fb-bb26-48474ac3fbed admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:36.296664 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f380e1d-f962-40fb-bb26-48474ac3fbed admin admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:36.298323 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f380e1d-f962-40fb-bb26-48474ac3fbed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:59:36.298958 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f380e1d-f962-40fb-bb26-48474ac3fbed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:36.301409 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f380e1d-f962-40fb-bb26-48474ac3fbed admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:36.331453 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1183/2383] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:59:36.333080 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fc5b8-250c-46eb-a2c4-a8ba65798e87 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:36.354219 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fc5b8-250c-46eb-a2c4-a8ba65798e87 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:36.369934 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc2822-e566-458b-b274-48908fb23dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:36.370610 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc2822-e566-458b-b274-48908fb23dee admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:36.370884 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc2822-e566-458b-b274-48908fb23dee admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:36.371152 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc2822-e566-458b-b274-48908fb23dee admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:36.371879 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc2822-e566-458b-b274-48908fb23dee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:36.373810 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc2822-e566-458b-b274-48908fb23dee admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:36.448279 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1201/2384] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:59:36 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:59:36.452218 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f380e1d-f962-40fb-bb26-48474ac3fbed admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:36.464060 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f380e1d-f962-40fb-bb26-48474ac3fbed admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:36.535275 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a199929-a7e3-4499-a92b-c104275c8887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:36.535988 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a199929-a7e3-4499-a92b-c104275c8887 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:36.536302 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a199929-a7e3-4499-a92b-c104275c8887 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:36.536574 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a199929-a7e3-4499-a92b-c104275c8887 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:36.537276 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a199929-a7e3-4499-a92b-c104275c8887 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:36.539257 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a199929-a7e3-4499-a92b-c104275c8887 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:36.562930 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1184/2385] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:59:36 2022] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:59:36.569592 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc2822-e566-458b-b274-48908fb23dee admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:36.587753 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc2822-e566-458b-b274-48908fb23dee admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:36.595253 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92977fdd-3e0a-489d-9f62-e5f52e407bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:36.595965 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92977fdd-3e0a-489d-9f62-e5f52e407bbf admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:36.596238 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92977fdd-3e0a-489d-9f62-e5f52e407bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:36.596505 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92977fdd-3e0a-489d-9f62-e5f52e407bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:36.597240 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92977fdd-3e0a-489d-9f62-e5f52e407bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:36.598865 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92977fdd-3e0a-489d-9f62-e5f52e407bbf admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:36.610716 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1202/2386] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:59:36.615066 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a199929-a7e3-4499-a92b-c104275c8887 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:36.627262 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a199929-a7e3-4499-a92b-c104275c8887 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:36.632761 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772bdf2-5c08-4d32-9b0d-3f30d74738a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:36.633612 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772bdf2-5c08-4d32-9b0d-3f30d74738a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:36.633893 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772bdf2-5c08-4d32-9b0d-3f30d74738a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:36.634163 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772bdf2-5c08-4d32-9b0d-3f30d74738a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:36.634898 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772bdf2-5c08-4d32-9b0d-3f30d74738a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:36.636573 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772bdf2-5c08-4d32-9b0d-3f30d74738a3 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:36.648622 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1185/2387] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:59:36.652922 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92977fdd-3e0a-489d-9f62-e5f52e407bbf admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:36.666293 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92977fdd-3e0a-489d-9f62-e5f52e407bbf admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:36.674273 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadd9df-e321-49cd-991c-c3239750e531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:36.675176 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadd9df-e321-49cd-991c-c3239750e531 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:36.675481 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadd9df-e321-49cd-991c-c3239750e531 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:36.675786 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadd9df-e321-49cd-991c-c3239750e531 admin admin] PATH_INFO: `/v3/projects/207d5290631147d19d8928fefcb16fdf/users/60cd03402c7040b09bdb03ec9e68b64b/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:36.696611 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddadd9df-e321-49cd-991c-c3239750e531 admin admin] RBAC: Authorizing `identity:create_grant(project_id=207d5290631147d19d8928fefcb16fdf, user_id=60cd03402c7040b09bdb03ec9e68b64b, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:36.699566 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddadd9df-e321-49cd-991c-c3239750e531 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:36.716610 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1203/2388] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:59:36 2022] PUT /identity/v3/projects/207d5290631147d19d8928fefcb16fdf/users/60cd03402c7040b09bdb03ec9e68b64b/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:59:36.730605 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ced4e-3380-4ef8-aa32-2e556ffabbbc None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:36.735224 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ced4e-3380-4ef8-aa32-2e556ffabbbc None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:36.735553 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ced4e-3380-4ef8-aa32-2e556ffabbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:36.767151 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-a82ced4e-3380-4ef8-aa32-2e556ffabbbc None None] MFA Rules not processed for user `60cd03402c7040b09bdb03ec9e68b64b`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:59:36.768455 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-a82ced4e-3380-4ef8-aa32-2e556ffabbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:36.843529 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1186/2389] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:59:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:59:36.856290 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadd9df-e321-49cd-991c-c3239750e531 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:36.858083 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-ddadd9df-e321-49cd-991c-c3239750e531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:36.920074 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadd9df-e321-49cd-991c-c3239750e531 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:36.928995 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645254f1-6124-4f36-8b85-1aa4a5b6f1f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:36.930119 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645254f1-6124-4f36-8b85-1aa4a5b6f1f1 service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:36.931375 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645254f1-6124-4f36-8b85-1aa4a5b6f1f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:36.931820 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645254f1-6124-4f36-8b85-1aa4a5b6f1f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:36.943544 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645254f1-6124-4f36-8b85-1aa4a5b6f1f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:36.945217 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645254f1-6124-4f36-8b85-1aa4a5b6f1f1 service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:36.958574 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1204/2390] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:59:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:59:42.667212 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8e757-843a-4463-819d-37e5e6858f0e None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:42.667733 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8e757-843a-4463-819d-37e5e6858f0e None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:42.668003 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8e757-843a-4463-819d-37e5e6858f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:42.697921 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-56d8e757-843a-4463-819d-37e5e6858f0e None None] MFA Rules not processed for user `78cde480dd8b4a85ac30895026bfc406`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:59:42.705135 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-56d8e757-843a-4463-819d-37e5e6858f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:42.841969 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1187/2391] 10.222.0.49 () {58 vars in 967 bytes} [Fri Oct 28 20:59:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:59:42.864717 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645254f1-6124-4f36-8b85-1aa4a5b6f1f1 service cinder] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:42.866793 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-645254f1-6124-4f36-8b85-1aa4a5b6f1f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:42.966018 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645254f1-6124-4f36-8b85-1aa4a5b6f1f1 service cinder] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:42.978689 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a66f38-e3e9-466a-bb8b-ea9b70d260ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d70db11d2d4923943bc6479bc49206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:42.979507 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a66f38-e3e9-466a-bb8b-ea9b70d260ac service swift] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:42.979813 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a66f38-e3e9-466a-bb8b-ea9b70d260ac service swift] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:42.980091 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a66f38-e3e9-466a-bb8b-ea9b70d260ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:42.994064 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a66f38-e3e9-466a-bb8b-ea9b70d260ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:42.996445 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a66f38-e3e9-466a-bb8b-ea9b70d260ac service swift] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:43.013087 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1205/2392] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Oct 28 20:59:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 20:59:43.648580 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8e757-843a-4463-819d-37e5e6858f0e None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:43.650622 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-56d8e757-843a-4463-819d-37e5e6858f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:43.731946 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8e757-843a-4463-819d-37e5e6858f0e None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:43.738254 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d0119-7392-4d3d-a20d-7821dc4e442f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:43.738903 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d0119-7392-4d3d-a20d-7821dc4e442f service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:43.739375 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d0119-7392-4d3d-a20d-7821dc4e442f service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:43.739820 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d0119-7392-4d3d-a20d-7821dc4e442f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:43.743403 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-602d0119-7392-4d3d-a20d-7821dc4e442f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:43.865004 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d0119-7392-4d3d-a20d-7821dc4e442f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:43.867228 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d0119-7392-4d3d-a20d-7821dc4e442f service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:43.879967 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1188/2393] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:59:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:59:43.910539 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a66f38-e3e9-466a-bb8b-ea9b70d260ac service swift] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:43.913535 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-f1a66f38-e3e9-466a-bb8b-ea9b70d260ac service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:44.048176 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a66f38-e3e9-466a-bb8b-ea9b70d260ac service swift] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:44.068044 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98fec8-acb9-4578-a67a-08aa65cab1e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:44.072374 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98fec8-acb9-4578-a67a-08aa65cab1e4 service nova] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:44.074137 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98fec8-acb9-4578-a67a-08aa65cab1e4 service nova] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:44.075577 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98fec8-acb9-4578-a67a-08aa65cab1e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:44.082064 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-2a98fec8-acb9-4578-a67a-08aa65cab1e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:44.106168 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98fec8-acb9-4578-a67a-08aa65cab1e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:44.110390 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98fec8-acb9-4578-a67a-08aa65cab1e4 service nova] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:44.130186 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1206/2394] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:59:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:59:48.288732 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d0119-7392-4d3d-a20d-7821dc4e442f service neutron] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:48.290120 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-602d0119-7392-4d3d-a20d-7821dc4e442f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:48.360373 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98fec8-acb9-4578-a67a-08aa65cab1e4 service nova] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:48.363022 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-2a98fec8-acb9-4578-a67a-08aa65cab1e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:48.378864 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98fec8-acb9-4578-a67a-08aa65cab1e4 service nova] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:48.383458 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff117f82-a57b-4851-9f9e-ea8cef54e05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:48.384533 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff117f82-a57b-4851-9f9e-ea8cef54e05d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:48.384820 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff117f82-a57b-4851-9f9e-ea8cef54e05d admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:48.385089 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff117f82-a57b-4851-9f9e-ea8cef54e05d admin admin] PATH_INFO: `/v3/users/a9a00ca081c24dde98c89e398267133f` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:48.386317 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff117f82-a57b-4851-9f9e-ea8cef54e05d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9a00ca081c24dde98c89e398267133f)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:48.388274 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff117f82-a57b-4851-9f9e-ea8cef54e05d admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:48.389599 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d0119-7392-4d3d-a20d-7821dc4e442f service neutron] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:48.399963 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d3405-b4df-4471-86e1-308afae18ddc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '938634e835b94a75af698aef6941958f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:48.400636 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d3405-b4df-4471-86e1-308afae18ddc service placement] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:48.400985 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d3405-b4df-4471-86e1-308afae18ddc service placement] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:48.401568 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d3405-b4df-4471-86e1-308afae18ddc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:48.403790 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-cf3d3405-b4df-4471-86e1-308afae18ddc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:48.418262 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3d3405-b4df-4471-86e1-308afae18ddc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:48.419883 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3d3405-b4df-4471-86e1-308afae18ddc service placement] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:48.432199 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1189/2395] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:59:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:59:48.442651 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ff117f82-a57b-4851-9f9e-ea8cef54e05d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9a00ca081c24dde98c89e398267133f'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:48.456686 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ff117f82-a57b-4851-9f9e-ea8cef54e05d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9a00ca081c24dde98c89e398267133f'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:48.465016 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ff117f82-a57b-4851-9f9e-ea8cef54e05d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9a00ca081c24dde98c89e398267133f'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:48.465699 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ff117f82-a57b-4851-9f9e-ea8cef54e05d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9a00ca081c24dde98c89e398267133f'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:48.478923 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ff117f82-a57b-4851-9f9e-ea8cef54e05d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9a00ca081c24dde98c89e398267133f'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:48.486126 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1207/2396] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:59:48 2022] DELETE /identity/v3/users/a9a00ca081c24dde98c89e398267133f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:59:48.686824 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d3405-b4df-4471-86e1-308afae18ddc service placement] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:48.704151 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d3405-b4df-4471-86e1-308afae18ddc service placement] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:48.744564 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff117f82-a57b-4851-9f9e-ea8cef54e05d admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:48.748711 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-ff117f82-a57b-4851-9f9e-ea8cef54e05d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:48.784307 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae4e95-71dc-49d2-92c4-b5eec47a5376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:48.785185 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae4e95-71dc-49d2-92c4-b5eec47a5376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:48.785456 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae4e95-71dc-49d2-92c4-b5eec47a5376 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:48.785730 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae4e95-71dc-49d2-92c4-b5eec47a5376 admin admin] PATH_INFO: `/v3/projects/aa76b14bb1ff4a7383ff932ec1df8e10` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:48.787051 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae4e95-71dc-49d2-92c4-b5eec47a5376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa76b14bb1ff4a7383ff932ec1df8e10)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:48.788932 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae4e95-71dc-49d2-92c4-b5eec47a5376 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:48.831222 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff117f82-a57b-4851-9f9e-ea8cef54e05d admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:48.848905 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-46ae4e95-71dc-49d2-92c4-b5eec47a5376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa76b14bb1ff4a7383ff932ec1df8e10', 'request_id': 'req-46ae4e95-71dc-49d2-92c4-b5eec47a5376'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:48.854581 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-46ae4e95-71dc-49d2-92c4-b5eec47a5376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa76b14bb1ff4a7383ff932ec1df8e10', 'request_id': 'req-46ae4e95-71dc-49d2-92c4-b5eec47a5376'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:48.861066 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-46ae4e95-71dc-49d2-92c4-b5eec47a5376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa76b14bb1ff4a7383ff932ec1df8e10', 'request_id': 'req-46ae4e95-71dc-49d2-92c4-b5eec47a5376'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:48.875505 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-46ae4e95-71dc-49d2-92c4-b5eec47a5376 admin admin] The token cache is being invalidate because project aa76b14bb1ff4a7383ff932ec1df8e10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:59:48.875971 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-46ae4e95-71dc-49d2-92c4-b5eec47a5376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:48.876808 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-46ae4e95-71dc-49d2-92c4-b5eec47a5376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:48.878428 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1190/2397] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:59:48 2022] DELETE /identity/v3/projects/aa76b14bb1ff4a7383ff932ec1df8e10 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:59:48.883278 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637638e-97d1-4e0c-bc9b-bd7fae75da30 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:48.883637 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637638e-97d1-4e0c-bc9b-bd7fae75da30 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:48.883970 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637638e-97d1-4e0c-bc9b-bd7fae75da30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:48.903579 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e62969-74ea-40be-b531-ef792ccb8958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:48.904982 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e62969-74ea-40be-b531-ef792ccb8958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:48.906066 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e62969-74ea-40be-b531-ef792ccb8958 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:48.906468 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e62969-74ea-40be-b531-ef792ccb8958 admin admin] PATH_INFO: `/v3/users/60cd03402c7040b09bdb03ec9e68b64b` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:48.908204 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e62969-74ea-40be-b531-ef792ccb8958 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60cd03402c7040b09bdb03ec9e68b64b)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:48.910513 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-e637638e-97d1-4e0c-bc9b-bd7fae75da30 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:59:48.911826 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e62969-74ea-40be-b531-ef792ccb8958 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:48.912440 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-e637638e-97d1-4e0c-bc9b-bd7fae75da30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:48.932100 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1191/2398] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:59:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:59:48.933776 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbddb5-9aae-4c18-b3bf-4d634801c06c None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:48.934064 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbddb5-9aae-4c18-b3bf-4d634801c06c None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:48.934343 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbddb5-9aae-4c18-b3bf-4d634801c06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:48.954414 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-bbdbddb5-9aae-4c18-b3bf-4d634801c06c None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:59:48.955711 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-bbdbddb5-9aae-4c18-b3bf-4d634801c06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:48.964407 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1192/2399] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:59:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:59:48.969593 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbddb5-9aae-4c18-b3bf-4d634801c06c None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:48.974460 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-27e62969-74ea-40be-b531-ef792ccb8958 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60cd03402c7040b09bdb03ec9e68b64b'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:48.979058 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbddb5-9aae-4c18-b3bf-4d634801c06c None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:48.981299 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-27e62969-74ea-40be-b531-ef792ccb8958 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60cd03402c7040b09bdb03ec9e68b64b'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:48.985110 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576092f-6240-474d-9e4c-9cbd4075b8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:48.986012 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576092f-6240-474d-9e4c-9cbd4075b8cc admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:48.986292 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576092f-6240-474d-9e4c-9cbd4075b8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:48.986565 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576092f-6240-474d-9e4c-9cbd4075b8cc admin admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:48.987767 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576092f-6240-474d-9e4c-9cbd4075b8cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:59:48.988088 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576092f-6240-474d-9e4c-9cbd4075b8cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:48.990259 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576092f-6240-474d-9e4c-9cbd4075b8cc admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:48.991088 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-27e62969-74ea-40be-b531-ef792ccb8958 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60cd03402c7040b09bdb03ec9e68b64b'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:48.991927 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-27e62969-74ea-40be-b531-ef792ccb8958 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60cd03402c7040b09bdb03ec9e68b64b'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:49.006508 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1193/2400] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:59:49.006729 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-27e62969-74ea-40be-b531-ef792ccb8958 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60cd03402c7040b09bdb03ec9e68b64b'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:49.007880 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576092f-6240-474d-9e4c-9cbd4075b8cc admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:49.010319 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-0576092f-6240-474d-9e4c-9cbd4075b8cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:49.013173 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1208/2401] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:59:48 2022] DELETE /identity/v3/users/60cd03402c7040b09bdb03ec9e68b64b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:59:49.019334 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4739e-4739-40e0-a459-70e627518962 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:49.019976 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4739e-4739-40e0-a459-70e627518962 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:49.020399 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4739e-4739-40e0-a459-70e627518962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:49.025838 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576092f-6240-474d-9e4c-9cbd4075b8cc admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:49.039702 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-e7c4739e-4739-40e0-a459-70e627518962 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:59:49.040865 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-e7c4739e-4739-40e0-a459-70e627518962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:49.086679 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdb3be-dc75-4a82-a56b-2ae9dafc8c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:49.087408 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdb3be-dc75-4a82-a56b-2ae9dafc8c96 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:49.087704 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdb3be-dc75-4a82-a56b-2ae9dafc8c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:49.087995 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdb3be-dc75-4a82-a56b-2ae9dafc8c96 admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:49.088717 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbdb3be-dc75-4a82-a56b-2ae9dafc8c96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:49.090817 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbdb3be-dc75-4a82-a56b-2ae9dafc8c96 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:49.107282 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1209/2402] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:59:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:59:49.120460 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4739e-4739-40e0-a459-70e627518962 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:49.122318 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-e7c4739e-4739-40e0-a459-70e627518962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:49.125566 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1194/2403] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:59:49 2022] POST /identity/v3/projects => generated 371 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:59:49.130132 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdb3be-dc75-4a82-a56b-2ae9dafc8c96 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:49.185757 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4739e-4739-40e0-a459-70e627518962 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:49.193194 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdb3be-dc75-4a82-a56b-2ae9dafc8c96 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:49.198223 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6269002-e107-49d6-99ae-9e2936ff89e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:49.198886 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6269002-e107-49d6-99ae-9e2936ff89e7 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:49.199155 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6269002-e107-49d6-99ae-9e2936ff89e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:49.199425 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6269002-e107-49d6-99ae-9e2936ff89e7 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:49.200146 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6269002-e107-49d6-99ae-9e2936ff89e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:49.202071 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6269002-e107-49d6-99ae-9e2936ff89e7 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:49.229152 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1195/2404] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:59:49 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:59:49.235562 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6269002-e107-49d6-99ae-9e2936ff89e7 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:49.237771 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7dee3-ff8a-472d-a58c-67ef8272947e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:49.238435 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7dee3-ff8a-472d-a58c-67ef8272947e service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:49.238753 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7dee3-ff8a-472d-a58c-67ef8272947e service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:49.239059 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7dee3-ff8a-472d-a58c-67ef8272947e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:49.245914 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6269002-e107-49d6-99ae-9e2936ff89e7 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:49.250544 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7dee3-ff8a-472d-a58c-67ef8272947e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:49.252041 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7dee3-ff8a-472d-a58c-67ef8272947e service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:49.253138 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab035e-f70f-44d5-9e7b-ec35cddfd641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:49.254054 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab035e-f70f-44d5-9e7b-ec35cddfd641 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:49.254370 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab035e-f70f-44d5-9e7b-ec35cddfd641 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:49.254694 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab035e-f70f-44d5-9e7b-ec35cddfd641 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:49.255697 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab035e-f70f-44d5-9e7b-ec35cddfd641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:49.257972 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab035e-f70f-44d5-9e7b-ec35cddfd641 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:49.262512 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1210/2405] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:59:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:59:49.269851 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1196/2406] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:59:49.273969 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7dee3-ff8a-472d-a58c-67ef8272947e service neutron] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:49.284097 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7dee3-ff8a-472d-a58c-67ef8272947e service neutron] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:49.289049 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06f9d3-1d05-403c-a96d-2cc0d8e69197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:49.289781 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06f9d3-1d05-403c-a96d-2cc0d8e69197 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:49.289998 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06f9d3-1d05-403c-a96d-2cc0d8e69197 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:49.290270 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06f9d3-1d05-403c-a96d-2cc0d8e69197 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:49.291002 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06f9d3-1d05-403c-a96d-2cc0d8e69197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:49.292665 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06f9d3-1d05-403c-a96d-2cc0d8e69197 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:49.304087 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1211/2407] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:59:49.308354 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab035e-f70f-44d5-9e7b-ec35cddfd641 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:49.319715 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab035e-f70f-44d5-9e7b-ec35cddfd641 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:49.324826 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf5a21-a2e3-4dbd-b1cc-9809f1f4697f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:49.325945 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf5a21-a2e3-4dbd-b1cc-9809f1f4697f admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:49.326234 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf5a21-a2e3-4dbd-b1cc-9809f1f4697f admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:49.326509 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf5a21-a2e3-4dbd-b1cc-9809f1f4697f admin admin] PATH_INFO: `/v3/projects/fd36d8c6a0d0498498eed64820b43e73/users/1e11d6f74ac0441f910960837da415bf/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:49.344562 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf5a21-a2e3-4dbd-b1cc-9809f1f4697f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd36d8c6a0d0498498eed64820b43e73, user_id=1e11d6f74ac0441f910960837da415bf, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:49.347660 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf5a21-a2e3-4dbd-b1cc-9809f1f4697f admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:49.364903 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1197/2408] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:59:49 2022] PUT /identity/v3/projects/fd36d8c6a0d0498498eed64820b43e73/users/1e11d6f74ac0441f910960837da415bf/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:59:49.376415 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3813908-94e4-436b-8d5c-5615a3887965 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:49.377281 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3813908-94e4-436b-8d5c-5615a3887965 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:49.377450 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3813908-94e4-436b-8d5c-5615a3887965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:49.410855 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-d3813908-94e4-436b-8d5c-5615a3887965 None None] MFA Rules not processed for user `1e11d6f74ac0441f910960837da415bf`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:59:49.413535 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-d3813908-94e4-436b-8d5c-5615a3887965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:49.499251 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1212/2409] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:59:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:59:49.511252 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf5a21-a2e3-4dbd-b1cc-9809f1f4697f admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:49.513967 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-abbf5a21-a2e3-4dbd-b1cc-9809f1f4697f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:49.604976 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3813908-94e4-436b-8d5c-5615a3887965 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:49.606945 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-d3813908-94e4-436b-8d5c-5615a3887965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:49.619825 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf5a21-a2e3-4dbd-b1cc-9809f1f4697f admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:49.627079 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7f161-a881-4148-a19a-796f18ac66e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:49.627778 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7f161-a881-4148-a19a-796f18ac66e0 service nova] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:49.628179 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7f161-a881-4148-a19a-796f18ac66e0 service nova] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:49.628354 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7f161-a881-4148-a19a-796f18ac66e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:49.648554 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7f161-a881-4148-a19a-796f18ac66e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:49.651325 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7f161-a881-4148-a19a-796f18ac66e0 service nova] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:49.672323 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1198/2410] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:59:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:59:49.713961 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3813908-94e4-436b-8d5c-5615a3887965 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:49.728154 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fd29d-fdd9-48a6-a233-3eca4a422dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:49.730481 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fd29d-fdd9-48a6-a233-3eca4a422dba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:49.730864 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fd29d-fdd9-48a6-a233-3eca4a422dba admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:49.731312 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fd29d-fdd9-48a6-a233-3eca4a422dba admin admin] PATH_INFO: `/v3/projects/207d5290631147d19d8928fefcb16fdf` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:49.732854 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7fd29d-fdd9-48a6-a233-3eca4a422dba admin admin] RBAC: Authorizing `identity:delete_project(project_id=207d5290631147d19d8928fefcb16fdf)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:49.735790 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7fd29d-fdd9-48a6-a233-3eca4a422dba admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:49.805696 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-7d7fd29d-fdd9-48a6-a233-3eca4a422dba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '207d5290631147d19d8928fefcb16fdf', 'request_id': 'req-7d7fd29d-fdd9-48a6-a233-3eca4a422dba'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:49.814384 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-7d7fd29d-fdd9-48a6-a233-3eca4a422dba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '207d5290631147d19d8928fefcb16fdf', 'request_id': 'req-7d7fd29d-fdd9-48a6-a233-3eca4a422dba'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:49.832102 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-7d7fd29d-fdd9-48a6-a233-3eca4a422dba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '207d5290631147d19d8928fefcb16fdf', 'request_id': 'req-7d7fd29d-fdd9-48a6-a233-3eca4a422dba'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:49.848199 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-7d7fd29d-fdd9-48a6-a233-3eca4a422dba admin admin] The token cache is being invalidate because project 207d5290631147d19d8928fefcb16fdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:59:49.848199 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-7d7fd29d-fdd9-48a6-a233-3eca4a422dba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:49.848510 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-7d7fd29d-fdd9-48a6-a233-3eca4a422dba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:49.850760 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1213/2411] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:59:49 2022] DELETE /identity/v3/projects/207d5290631147d19d8928fefcb16fdf => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:59:49.855950 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ec7db-da35-42cc-a2e0-aaaeceec6cbc None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:49.856443 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ec7db-da35-42cc-a2e0-aaaeceec6cbc None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:49.856630 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ec7db-da35-42cc-a2e0-aaaeceec6cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:49.879147 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-7b0ec7db-da35-42cc-a2e0-aaaeceec6cbc None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:59:49.880589 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-7b0ec7db-da35-42cc-a2e0-aaaeceec6cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:49.960329 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1199/2412] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:59:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:59:49.969609 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc48614-4251-4f65-aecb-790beb26cffd None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:49.969891 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc48614-4251-4f65-aecb-790beb26cffd None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:49.970163 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc48614-4251-4f65-aecb-790beb26cffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:49.995923 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-8bc48614-4251-4f65-aecb-790beb26cffd None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:59:49.998047 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-8bc48614-4251-4f65-aecb-790beb26cffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:50.009722 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1214/2413] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:59:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:59:50.016595 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ec7db-da35-42cc-a2e0-aaaeceec6cbc None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:50.029104 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ec7db-da35-42cc-a2e0-aaaeceec6cbc None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:50.038050 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfd066-caf1-4494-b109-8d9a410b3442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:50.038899 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfd066-caf1-4494-b109-8d9a410b3442 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:50.039254 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfd066-caf1-4494-b109-8d9a410b3442 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:50.039692 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfd066-caf1-4494-b109-8d9a410b3442 admin admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:50.040446 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bfd066-caf1-4494-b109-8d9a410b3442 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:59:50.040753 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bfd066-caf1-4494-b109-8d9a410b3442 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:50.042403 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bfd066-caf1-4494-b109-8d9a410b3442 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:50.060482 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1200/2414] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:59:50.062656 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc48614-4251-4f65-aecb-790beb26cffd None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:50.074824 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc48614-4251-4f65-aecb-790beb26cffd None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:50.080472 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c61b7-bb2d-439c-97ec-26c38266398f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:50.081063 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c61b7-bb2d-439c-97ec-26c38266398f admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:50.081340 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c61b7-bb2d-439c-97ec-26c38266398f admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:50.081675 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c61b7-bb2d-439c-97ec-26c38266398f admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:50.082915 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c61b7-bb2d-439c-97ec-26c38266398f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:50.085455 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c61b7-bb2d-439c-97ec-26c38266398f admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:50.125311 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1215/2415] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:59:50 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:59:50.129558 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfd066-caf1-4494-b109-8d9a410b3442 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:50.142018 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfd066-caf1-4494-b109-8d9a410b3442 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:50.213569 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab53ee5-dd77-4598-85e4-cb0b9c64df5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:50.214582 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab53ee5-dd77-4598-85e4-cb0b9c64df5a admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:50.214842 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab53ee5-dd77-4598-85e4-cb0b9c64df5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:50.215245 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab53ee5-dd77-4598-85e4-cb0b9c64df5a admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:50.216064 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab53ee5-dd77-4598-85e4-cb0b9c64df5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:50.219395 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab53ee5-dd77-4598-85e4-cb0b9c64df5a admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:50.248430 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1201/2416] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:59:50 2022] POST /identity/v3/users => generated 292 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:59:50.253455 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c61b7-bb2d-439c-97ec-26c38266398f admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:50.264454 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c61b7-bb2d-439c-97ec-26c38266398f admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:50.269958 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac84a5-2dfe-4bef-8dd3-fca517ac4c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:50.270628 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac84a5-2dfe-4bef-8dd3-fca517ac4c05 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:50.270907 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac84a5-2dfe-4bef-8dd3-fca517ac4c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:50.271175 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac84a5-2dfe-4bef-8dd3-fca517ac4c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:50.271939 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac84a5-2dfe-4bef-8dd3-fca517ac4c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:50.273554 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac84a5-2dfe-4bef-8dd3-fca517ac4c05 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:50.285297 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1216/2417] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:59:50.289618 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab53ee5-dd77-4598-85e4-cb0b9c64df5a admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:50.300825 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab53ee5-dd77-4598-85e4-cb0b9c64df5a admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:50.305576 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5182022-62a0-4777-80a6-8c19916fd135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:50.306246 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5182022-62a0-4777-80a6-8c19916fd135 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:50.306519 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5182022-62a0-4777-80a6-8c19916fd135 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:50.306785 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5182022-62a0-4777-80a6-8c19916fd135 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:50.307512 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5182022-62a0-4777-80a6-8c19916fd135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:50.309154 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5182022-62a0-4777-80a6-8c19916fd135 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:50.322334 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1202/2418] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:59:50.326672 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac84a5-2dfe-4bef-8dd3-fca517ac4c05 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:50.339329 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac84a5-2dfe-4bef-8dd3-fca517ac4c05 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:50.346202 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd992c-a45b-4185-8642-458e0a085846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:50.347763 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd992c-a45b-4185-8642-458e0a085846 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:50.348267 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd992c-a45b-4185-8642-458e0a085846 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:50.348761 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd992c-a45b-4185-8642-458e0a085846 admin admin] PATH_INFO: `/v3/projects/4cf31f6da5c044e4b3664270104192c8/users/0e7a065d7e5f442fb841328777b64d51/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:50.368801 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd992c-a45b-4185-8642-458e0a085846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cf31f6da5c044e4b3664270104192c8, user_id=0e7a065d7e5f442fb841328777b64d51, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:50.371444 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd992c-a45b-4185-8642-458e0a085846 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:50.387656 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1217/2419] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:59:50 2022] PUT /identity/v3/projects/4cf31f6da5c044e4b3664270104192c8/users/0e7a065d7e5f442fb841328777b64d51/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:59:50.396021 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5bfe5-3edb-408d-8ad7-b9532daabc05 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:50.396021 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5bfe5-3edb-408d-8ad7-b9532daabc05 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:50.396021 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5bfe5-3edb-408d-8ad7-b9532daabc05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:50.419724 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-84e5bfe5-3edb-408d-8ad7-b9532daabc05 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:59:50.421635 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-84e5bfe5-3edb-408d-8ad7-b9532daabc05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:50.493400 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1203/2420] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:59:50.503911 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd992c-a45b-4185-8642-458e0a085846 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:50.505733 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-c6bd992c-a45b-4185-8642-458e0a085846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:50.566193 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd992c-a45b-4185-8642-458e0a085846 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:50.570289 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99172f7a-a461-446b-8dcd-bbcd765f31d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:50.570973 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99172f7a-a461-446b-8dcd-bbcd765f31d6 service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:50.571254 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99172f7a-a461-446b-8dcd-bbcd765f31d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:50.571528 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99172f7a-a461-446b-8dcd-bbcd765f31d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:50.581460 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99172f7a-a461-446b-8dcd-bbcd765f31d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:50.582915 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99172f7a-a461-446b-8dcd-bbcd765f31d6 service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:50.593809 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1218/2421] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:59:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:59:51.045415 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5bfe5-3edb-408d-8ad7-b9532daabc05 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:51.047991 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-84e5bfe5-3edb-408d-8ad7-b9532daabc05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:51.060987 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5bfe5-3edb-408d-8ad7-b9532daabc05 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:51.065835 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6a9e8-e299-42a3-acd9-c51ddd82d690 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:51.066665 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6a9e8-e299-42a3-acd9-c51ddd82d690 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:51.067013 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6a9e8-e299-42a3-acd9-c51ddd82d690 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:51.067372 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6a9e8-e299-42a3-acd9-c51ddd82d690 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:51.069921 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-94f6a9e8-e299-42a3-acd9-c51ddd82d690 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:51.084304 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6a9e8-e299-42a3-acd9-c51ddd82d690 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:51.086038 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6a9e8-e299-42a3-acd9-c51ddd82d690 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:51.097351 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1204/2422] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:59:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:59:51.800614 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b20309-f898-462d-82dc-6dbce6af1c36 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:51.801422 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b20309-f898-462d-82dc-6dbce6af1c36 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:51.801422 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b20309-f898-462d-82dc-6dbce6af1c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:51.845604 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-24b20309-f898-462d-82dc-6dbce6af1c36 None None] MFA Rules not processed for user `0e7a065d7e5f442fb841328777b64d51`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:59:51.847908 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-24b20309-f898-462d-82dc-6dbce6af1c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:51.942284 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1219/2423] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:59:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:59:51.952225 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6a9e8-e299-42a3-acd9-c51ddd82d690 service neutron] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:51.955898 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-94f6a9e8-e299-42a3-acd9-c51ddd82d690 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:52.020277 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6a9e8-e299-42a3-acd9-c51ddd82d690 service neutron] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:52.024811 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638689d-4036-4782-be92-b30fef1dc5e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:52.025467 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638689d-4036-4782-be92-b30fef1dc5e1 service cinder] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:52.025773 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638689d-4036-4782-be92-b30fef1dc5e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:52.026042 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638689d-4036-4782-be92-b30fef1dc5e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:52.035920 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638689d-4036-4782-be92-b30fef1dc5e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:52.037397 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638689d-4036-4782-be92-b30fef1dc5e1 service cinder] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:52.047202 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1205/2424] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:59:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:59:52.616867 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b20309-f898-462d-82dc-6dbce6af1c36 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:52.618660 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-24b20309-f898-462d-82dc-6dbce6af1c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:52.640512 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b20309-f898-462d-82dc-6dbce6af1c36 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:52.646447 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c90ced-e9f6-43e4-84f7-f36a487df732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:52.647330 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c90ced-e9f6-43e4-84f7-f36a487df732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:52.647860 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c90ced-e9f6-43e4-84f7-f36a487df732 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:52.648134 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c90ced-e9f6-43e4-84f7-f36a487df732 admin admin] PATH_INFO: `/v3/users/1e11d6f74ac0441f910960837da415bf` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:52.649599 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c90ced-e9f6-43e4-84f7-f36a487df732 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e11d6f74ac0441f910960837da415bf)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:52.651825 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c90ced-e9f6-43e4-84f7-f36a487df732 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:52.712787 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-c3c90ced-e9f6-43e4-84f7-f36a487df732 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e11d6f74ac0441f910960837da415bf'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:52.720685 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-c3c90ced-e9f6-43e4-84f7-f36a487df732 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e11d6f74ac0441f910960837da415bf'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:52.728319 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-c3c90ced-e9f6-43e4-84f7-f36a487df732 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e11d6f74ac0441f910960837da415bf'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:52.729190 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-c3c90ced-e9f6-43e4-84f7-f36a487df732 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e11d6f74ac0441f910960837da415bf'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:52.741687 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-c3c90ced-e9f6-43e4-84f7-f36a487df732 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e11d6f74ac0441f910960837da415bf'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:52.748343 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1220/2425] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:59:52 2022] DELETE /identity/v3/users/1e11d6f74ac0441f910960837da415bf => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:59:52.753962 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c45d3-c0e5-49bf-9a63-e7acfad02610 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:52.754559 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c45d3-c0e5-49bf-9a63-e7acfad02610 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:52.755146 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c45d3-c0e5-49bf-9a63-e7acfad02610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:52.776333 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-ed8c45d3-c0e5-49bf-9a63-e7acfad02610 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:59:52.777459 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-ed8c45d3-c0e5-49bf-9a63-e7acfad02610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:52.848121 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1206/2426] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:59:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:59:52.857834 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c90ced-e9f6-43e4-84f7-f36a487df732 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:52.859973 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-c3c90ced-e9f6-43e4-84f7-f36a487df732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:52.936393 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c90ced-e9f6-43e4-84f7-f36a487df732 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:52.941103 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2470f02-1f15-4210-9843-ef71aed1e690 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:52.941758 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2470f02-1f15-4210-9843-ef71aed1e690 service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:52.942221 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2470f02-1f15-4210-9843-ef71aed1e690 service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:52.942498 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2470f02-1f15-4210-9843-ef71aed1e690 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:52.957029 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2470f02-1f15-4210-9843-ef71aed1e690 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:52.958826 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2470f02-1f15-4210-9843-ef71aed1e690 service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:52.970061 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1221/2427] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:59:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:59:53.515259 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bde9e-2d2b-4b9e-9aff-03ed3f2a9a18 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:53.515259 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bde9e-2d2b-4b9e-9aff-03ed3f2a9a18 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:53.524651 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bde9e-2d2b-4b9e-9aff-03ed3f2a9a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:53.532509 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2470f02-1f15-4210-9843-ef71aed1e690 service neutron] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:53.534100 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-b2470f02-1f15-4210-9843-ef71aed1e690 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:53.573652 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2470f02-1f15-4210-9843-ef71aed1e690 service neutron] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:53.579500 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-329bde9e-2d2b-4b9e-9aff-03ed3f2a9a18 None None] MFA Rules not processed for user `0e7a065d7e5f442fb841328777b64d51`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:59:53.580769 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ae551-695a-4ebf-bc95-d799fa773c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:53.581690 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-329bde9e-2d2b-4b9e-9aff-03ed3f2a9a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:53.581843 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ae551-695a-4ebf-bc95-d799fa773c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:53.582161 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ae551-695a-4ebf-bc95-d799fa773c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:53.582503 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ae551-695a-4ebf-bc95-d799fa773c62 admin admin] PATH_INFO: `/v3/projects/fd36d8c6a0d0498498eed64820b43e73` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:53.584124 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ae551-695a-4ebf-bc95-d799fa773c62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd36d8c6a0d0498498eed64820b43e73)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:53.586375 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ae551-695a-4ebf-bc95-d799fa773c62 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:53.663552 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-7e6ae551-695a-4ebf-bc95-d799fa773c62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd36d8c6a0d0498498eed64820b43e73', 'request_id': 'req-7e6ae551-695a-4ebf-bc95-d799fa773c62'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:53.673695 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-7e6ae551-695a-4ebf-bc95-d799fa773c62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd36d8c6a0d0498498eed64820b43e73', 'request_id': 'req-7e6ae551-695a-4ebf-bc95-d799fa773c62'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:53.688699 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-7e6ae551-695a-4ebf-bc95-d799fa773c62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd36d8c6a0d0498498eed64820b43e73', 'request_id': 'req-7e6ae551-695a-4ebf-bc95-d799fa773c62'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:53.698111 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1207/2428] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:59:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:59:53.705703 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-7e6ae551-695a-4ebf-bc95-d799fa773c62 admin admin] The token cache is being invalidate because project fd36d8c6a0d0498498eed64820b43e73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:59:53.705980 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-7e6ae551-695a-4ebf-bc95-d799fa773c62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:53.706643 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-7e6ae551-695a-4ebf-bc95-d799fa773c62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:53.708449 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1222/2429] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:59:53 2022] DELETE /identity/v3/projects/fd36d8c6a0d0498498eed64820b43e73 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:59:53.714144 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67f7c7-5df4-4047-b219-2157a44a9ef2 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:53.714438 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67f7c7-5df4-4047-b219-2157a44a9ef2 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:53.714861 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67f7c7-5df4-4047-b219-2157a44a9ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:53.737406 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-fa67f7c7-5df4-4047-b219-2157a44a9ef2 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:59:53.738669 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-fa67f7c7-5df4-4047-b219-2157a44a9ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:53.821311 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1208/2430] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:59:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:59:53.831110 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb4ea5-15e8-4723-9e9e-59a655e03d8c None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:53.832352 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb4ea5-15e8-4723-9e9e-59a655e03d8c None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:53.832634 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb4ea5-15e8-4723-9e9e-59a655e03d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:53.856741 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-49cb4ea5-15e8-4723-9e9e-59a655e03d8c None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:59:53.858092 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-49cb4ea5-15e8-4723-9e9e-59a655e03d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:53.871284 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1223/2431] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:59:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:59:53.873571 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67f7c7-5df4-4047-b219-2157a44a9ef2 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:53.884095 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67f7c7-5df4-4047-b219-2157a44a9ef2 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:53.890627 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3ba58-fe50-4034-a296-20f19dc4bb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:53.891661 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3ba58-fe50-4034-a296-20f19dc4bb5d admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:53.892024 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3ba58-fe50-4034-a296-20f19dc4bb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:53.892366 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3ba58-fe50-4034-a296-20f19dc4bb5d admin admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:53.893180 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3ba58-fe50-4034-a296-20f19dc4bb5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:59:53.893553 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3ba58-fe50-4034-a296-20f19dc4bb5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:53.895825 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3ba58-fe50-4034-a296-20f19dc4bb5d admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:53.916457 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1209/2432] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:59:53.921489 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb4ea5-15e8-4723-9e9e-59a655e03d8c None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:53.931412 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb4ea5-15e8-4723-9e9e-59a655e03d8c None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:53.936600 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b21a3-14de-4ce1-b597-28c43adc4fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:53.937947 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b21a3-14de-4ce1-b597-28c43adc4fee admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:53.938550 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b21a3-14de-4ce1-b597-28c43adc4fee admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:53.938928 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b21a3-14de-4ce1-b597-28c43adc4fee admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:53.940226 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b21a3-14de-4ce1-b597-28c43adc4fee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:53.941984 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b21a3-14de-4ce1-b597-28c43adc4fee admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:53.980339 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1224/2433] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:59:53 2022] POST /identity/v3/projects => generated 365 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:59:53.984860 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3ba58-fe50-4034-a296-20f19dc4bb5d admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:54.004424 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3ba58-fe50-4034-a296-20f19dc4bb5d admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:54.005414 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b21a3-14de-4ce1-b597-28c43adc4fee admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:54.007179 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-698b21a3-14de-4ce1-b597-28c43adc4fee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:54.096592 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc077e56-9a20-4a05-a026-0eeae4d07bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:54.097272 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc077e56-9a20-4a05-a026-0eeae4d07bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:54.097549 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc077e56-9a20-4a05-a026-0eeae4d07bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:54.097819 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc077e56-9a20-4a05-a026-0eeae4d07bd4 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:54.098511 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc077e56-9a20-4a05-a026-0eeae4d07bd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:54.100983 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b21a3-14de-4ce1-b597-28c43adc4fee admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:54.101156 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc077e56-9a20-4a05-a026-0eeae4d07bd4 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:54.104853 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8cb8a-bd15-4ac5-8027-6af9013d60ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:54.106051 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8cb8a-bd15-4ac5-8027-6af9013d60ba service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:54.106051 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8cb8a-bd15-4ac5-8027-6af9013d60ba service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:54.106419 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8cb8a-bd15-4ac5-8027-6af9013d60ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:54.108667 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-8dc8cb8a-bd15-4ac5-8027-6af9013d60ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:54.125512 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8cb8a-bd15-4ac5-8027-6af9013d60ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:54.127121 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8cb8a-bd15-4ac5-8027-6af9013d60ba service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:54.130435 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1210/2434] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:59:53 2022] POST /identity/v3/users => generated 283 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:59:54.133330 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc077e56-9a20-4a05-a026-0eeae4d07bd4 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:54.147044 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc077e56-9a20-4a05-a026-0eeae4d07bd4 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:54.147237 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1225/2435] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:59:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:59:54.152006 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f9622-72af-4343-9a20-7b1bf18d9783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:54.152700 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f9622-72af-4343-9a20-7b1bf18d9783 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:54.152977 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f9622-72af-4343-9a20-7b1bf18d9783 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:54.153246 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f9622-72af-4343-9a20-7b1bf18d9783 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:54.154011 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f9622-72af-4343-9a20-7b1bf18d9783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:54.155945 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f9622-72af-4343-9a20-7b1bf18d9783 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:54.171413 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1211/2436] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:59:54.173396 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8cb8a-bd15-4ac5-8027-6af9013d60ba service neutron] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:54.187460 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8cb8a-bd15-4ac5-8027-6af9013d60ba service neutron] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:54.192829 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06f86c-4c3d-40b0-a37d-980ca717d146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:54.193778 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06f86c-4c3d-40b0-a37d-980ca717d146 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:54.194155 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06f86c-4c3d-40b0-a37d-980ca717d146 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:54.195206 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06f86c-4c3d-40b0-a37d-980ca717d146 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:54.195561 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b06f86c-4c3d-40b0-a37d-980ca717d146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:54.198719 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b06f86c-4c3d-40b0-a37d-980ca717d146 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:54.211780 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1226/2437] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:59:54.219490 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f9622-72af-4343-9a20-7b1bf18d9783 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:54.230114 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f9622-72af-4343-9a20-7b1bf18d9783 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:54.237213 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedbf33f-1c6f-4b92-8285-53615b24d7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:54.238576 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbf33f-1c6f-4b92-8285-53615b24d7c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:54.238576 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbf33f-1c6f-4b92-8285-53615b24d7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:54.238876 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbf33f-1c6f-4b92-8285-53615b24d7c0 admin admin] PATH_INFO: `/v3/projects/07b9a4e55dfc47bdae7295ccc10eda49/users/cf48d461e31243d5b920628b476132f8/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:54.259054 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedbf33f-1c6f-4b92-8285-53615b24d7c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07b9a4e55dfc47bdae7295ccc10eda49, user_id=cf48d461e31243d5b920628b476132f8, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:54.261875 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedbf33f-1c6f-4b92-8285-53615b24d7c0 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:54.280205 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1212/2438] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:59:54 2022] PUT /identity/v3/projects/07b9a4e55dfc47bdae7295ccc10eda49/users/cf48d461e31243d5b920628b476132f8/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:59:54.291864 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4763440-de14-482b-b056-034db618fb9a None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:54.292148 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4763440-de14-482b-b056-034db618fb9a None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:54.292547 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4763440-de14-482b-b056-034db618fb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:54.326333 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-b4763440-de14-482b-b056-034db618fb9a None None] MFA Rules not processed for user `cf48d461e31243d5b920628b476132f8`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:59:54.328235 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-b4763440-de14-482b-b056-034db618fb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:54.451123 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1227/2439] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:59:54 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:59:54.463803 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedbf33f-1c6f-4b92-8285-53615b24d7c0 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:54.465705 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-eedbf33f-1c6f-4b92-8285-53615b24d7c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:54.564319 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedbf33f-1c6f-4b92-8285-53615b24d7c0 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:54.592281 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf4c8a-6a14-43a8-9b74-4d068dcd602b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:54.593617 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf4c8a-6a14-43a8-9b74-4d068dcd602b service cinder] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:54.593870 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf4c8a-6a14-43a8-9b74-4d068dcd602b service cinder] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:54.594145 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf4c8a-6a14-43a8-9b74-4d068dcd602b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:54.605896 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf4c8a-6a14-43a8-9b74-4d068dcd602b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:54.607454 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf4c8a-6a14-43a8-9b74-4d068dcd602b service cinder] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:54.620746 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1213/2440] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:59:54 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:59:55.084919 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4763440-de14-482b-b056-034db618fb9a None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:55.085907 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-b4763440-de14-482b-b056-034db618fb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:55.185131 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4763440-de14-482b-b056-034db618fb9a None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:55.191945 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228e594-49bf-46e8-b9e1-241148741336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:55.192860 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228e594-49bf-46e8-b9e1-241148741336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:55.193145 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228e594-49bf-46e8-b9e1-241148741336 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:55.193422 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228e594-49bf-46e8-b9e1-241148741336 admin admin] PATH_INFO: `/v3/users/5dec57310b724afa966fd56650707e54` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:55.194649 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3228e594-49bf-46e8-b9e1-241148741336 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dec57310b724afa966fd56650707e54)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:55.196623 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3228e594-49bf-46e8-b9e1-241148741336 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:55.253524 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-3228e594-49bf-46e8-b9e1-241148741336 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dec57310b724afa966fd56650707e54'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:55.262243 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-3228e594-49bf-46e8-b9e1-241148741336 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dec57310b724afa966fd56650707e54'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:55.272385 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-3228e594-49bf-46e8-b9e1-241148741336 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dec57310b724afa966fd56650707e54'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:55.274348 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-3228e594-49bf-46e8-b9e1-241148741336 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dec57310b724afa966fd56650707e54'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:55.289150 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-3228e594-49bf-46e8-b9e1-241148741336 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dec57310b724afa966fd56650707e54'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:55.295939 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1228/2441] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:59:55 2022] DELETE /identity/v3/users/5dec57310b724afa966fd56650707e54 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:59:55.537002 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf4c8a-6a14-43a8-9b74-4d068dcd602b service cinder] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:55.552030 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf4c8a-6a14-43a8-9b74-4d068dcd602b service cinder] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:55.619967 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1c42e-e57e-4856-a50f-2f9676d1d354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:55.620899 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1c42e-e57e-4856-a50f-2f9676d1d354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:55.621260 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1c42e-e57e-4856-a50f-2f9676d1d354 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:55.621656 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1c42e-e57e-4856-a50f-2f9676d1d354 admin admin] PATH_INFO: `/v3/projects/c09c53c40108411b8b37620f637000e2` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:55.622793 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1c42e-e57e-4856-a50f-2f9676d1d354 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c09c53c40108411b8b37620f637000e2)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:55.625649 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1c42e-e57e-4856-a50f-2f9676d1d354 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:55.673302 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0de1c42e-e57e-4856-a50f-2f9676d1d354 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c09c53c40108411b8b37620f637000e2', 'request_id': 'req-0de1c42e-e57e-4856-a50f-2f9676d1d354'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:55.678653 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0de1c42e-e57e-4856-a50f-2f9676d1d354 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c09c53c40108411b8b37620f637000e2', 'request_id': 'req-0de1c42e-e57e-4856-a50f-2f9676d1d354'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:55.684706 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0de1c42e-e57e-4856-a50f-2f9676d1d354 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c09c53c40108411b8b37620f637000e2', 'request_id': 'req-0de1c42e-e57e-4856-a50f-2f9676d1d354'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:55.697850 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0de1c42e-e57e-4856-a50f-2f9676d1d354 admin admin] The token cache is being invalidate because project c09c53c40108411b8b37620f637000e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:59:55.698123 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0de1c42e-e57e-4856-a50f-2f9676d1d354 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:55.698766 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0de1c42e-e57e-4856-a50f-2f9676d1d354 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:55.700351 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1214/2442] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:59:55 2022] DELETE /identity/v3/projects/c09c53c40108411b8b37620f637000e2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:59:55.706513 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a6a4b-36cf-4d72-8cb1-8de359efedba None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:55.706920 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a6a4b-36cf-4d72-8cb1-8de359efedba None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:55.707763 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a6a4b-36cf-4d72-8cb1-8de359efedba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:55.727965 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-e21a6a4b-36cf-4d72-8cb1-8de359efedba None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:59:55.729188 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-e21a6a4b-36cf-4d72-8cb1-8de359efedba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:55.797182 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1229/2443] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:59:55.805264 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ab49f-0136-4383-893b-6505a63233f9 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:55.805545 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ab49f-0136-4383-893b-6505a63233f9 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:55.805876 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ab49f-0136-4383-893b-6505a63233f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:55.825518 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-e46ab49f-0136-4383-893b-6505a63233f9 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:59:55.826958 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-e46ab49f-0136-4383-893b-6505a63233f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:55.842384 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1215/2444] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:59:55.848772 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a6a4b-36cf-4d72-8cb1-8de359efedba None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:55.860888 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a6a4b-36cf-4d72-8cb1-8de359efedba None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:55.866254 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c06c4-4b64-426a-bd9d-5e10d7563df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:55.866978 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c06c4-4b64-426a-bd9d-5e10d7563df9 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:55.867262 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c06c4-4b64-426a-bd9d-5e10d7563df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:55.867717 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c06c4-4b64-426a-bd9d-5e10d7563df9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:55.868794 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c06c4-4b64-426a-bd9d-5e10d7563df9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:59:55.869155 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c06c4-4b64-426a-bd9d-5e10d7563df9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:55.871011 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c06c4-4b64-426a-bd9d-5e10d7563df9 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:55.885822 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1230/2445] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:59:55.890895 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ab49f-0136-4383-893b-6505a63233f9 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:55.901623 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ab49f-0136-4383-893b-6505a63233f9 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:55.908247 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae6e0d-f3e9-46ce-bb80-3245e17afed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:55.908929 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae6e0d-f3e9-46ce-bb80-3245e17afed1 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:55.909261 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae6e0d-f3e9-46ce-bb80-3245e17afed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:55.909540 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae6e0d-f3e9-46ce-bb80-3245e17afed1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:55.910283 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae6e0d-f3e9-46ce-bb80-3245e17afed1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:55.912287 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae6e0d-f3e9-46ce-bb80-3245e17afed1 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:55.947001 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1216/2446] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:59:55 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:59:55.948294 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c06c4-4b64-426a-bd9d-5e10d7563df9 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:55.961804 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c06c4-4b64-426a-bd9d-5e10d7563df9 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:56.024078 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068c19e-d8e6-464c-b0f9-d7a683057fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:56.024755 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068c19e-d8e6-464c-b0f9-d7a683057fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:56.025037 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068c19e-d8e6-464c-b0f9-d7a683057fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:56.025310 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068c19e-d8e6-464c-b0f9-d7a683057fa5 admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:56.026027 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068c19e-d8e6-464c-b0f9-d7a683057fa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:56.027999 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068c19e-d8e6-464c-b0f9-d7a683057fa5 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:56.050055 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1231/2447] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:59:55 2022] POST /identity/v3/users => generated 283 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:59:56.054408 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae6e0d-f3e9-46ce-bb80-3245e17afed1 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:56.065568 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae6e0d-f3e9-46ce-bb80-3245e17afed1 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:56.070666 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e2244-ebf7-4108-b985-c1593c5b3e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:56.071433 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e2244-ebf7-4108-b985-c1593c5b3e82 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:56.071813 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e2244-ebf7-4108-b985-c1593c5b3e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:56.072157 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e2244-ebf7-4108-b985-c1593c5b3e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:56.073008 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e2244-ebf7-4108-b985-c1593c5b3e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:56.074861 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e2244-ebf7-4108-b985-c1593c5b3e82 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:56.087371 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1217/2448] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:59:56.092792 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068c19e-d8e6-464c-b0f9-d7a683057fa5 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:56.104729 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068c19e-d8e6-464c-b0f9-d7a683057fa5 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:56.110646 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb942bb-ec21-486e-8690-a648ddecf20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:56.111320 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb942bb-ec21-486e-8690-a648ddecf20d admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:56.111601 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb942bb-ec21-486e-8690-a648ddecf20d admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:56.111915 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb942bb-ec21-486e-8690-a648ddecf20d admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:56.112691 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb942bb-ec21-486e-8690-a648ddecf20d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:56.114268 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb942bb-ec21-486e-8690-a648ddecf20d admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:56.125505 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1232/2449] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:59:56.129919 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e2244-ebf7-4108-b985-c1593c5b3e82 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:56.141940 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e2244-ebf7-4108-b985-c1593c5b3e82 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:56.147301 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30310b89-5bed-480a-9bee-3282bcaeb6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:56.148389 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30310b89-5bed-480a-9bee-3282bcaeb6d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:56.148811 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30310b89-5bed-480a-9bee-3282bcaeb6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:56.149144 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30310b89-5bed-480a-9bee-3282bcaeb6d1 admin admin] PATH_INFO: `/v3/projects/e725daa0a5b3406c816aae131ef549f1/users/147b50b5348544e6b2709f46ed4fb61f/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:56.171267 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30310b89-5bed-480a-9bee-3282bcaeb6d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e725daa0a5b3406c816aae131ef549f1, user_id=147b50b5348544e6b2709f46ed4fb61f, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:56.174051 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30310b89-5bed-480a-9bee-3282bcaeb6d1 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:56.203405 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1218/2450] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:59:56 2022] PUT /identity/v3/projects/e725daa0a5b3406c816aae131ef549f1/users/147b50b5348544e6b2709f46ed4fb61f/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:59:56.206316 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7de1a2-a3bf-49c5-8c67-724bc825c154 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:56.206600 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7de1a2-a3bf-49c5-8c67-724bc825c154 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:56.206940 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7de1a2-a3bf-49c5-8c67-724bc825c154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:56.242255 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-cc7de1a2-a3bf-49c5-8c67-724bc825c154 None None] MFA Rules not processed for user `147b50b5348544e6b2709f46ed4fb61f`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:59:56.243581 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-cc7de1a2-a3bf-49c5-8c67-724bc825c154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:56.322676 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1233/2451] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:59:56 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:59:56.327520 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30310b89-5bed-480a-9bee-3282bcaeb6d1 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:56.398148 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30310b89-5bed-480a-9bee-3282bcaeb6d1 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:56.403794 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5198a97-6330-4578-8487-5a1094e8f338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:56.404467 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5198a97-6330-4578-8487-5a1094e8f338 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:56.404745 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5198a97-6330-4578-8487-5a1094e8f338 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:56.405017 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5198a97-6330-4578-8487-5a1094e8f338 admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:56.406568 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5198a97-6330-4578-8487-5a1094e8f338 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:56.408688 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5198a97-6330-4578-8487-5a1094e8f338 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:56.440326 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1219/2452] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:59:56 2022] POST /identity/v3/projects => generated 363 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:59:56.455968 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7de1a2-a3bf-49c5-8c67-724bc825c154 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:56.486493 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7de1a2-a3bf-49c5-8c67-724bc825c154 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:56.579681 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30578d4-bb9d-4f85-988f-5c375edfd3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:56.580788 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30578d4-bb9d-4f85-988f-5c375edfd3da admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:56.581289 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30578d4-bb9d-4f85-988f-5c375edfd3da admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:56.581799 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30578d4-bb9d-4f85-988f-5c375edfd3da admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:56.582945 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30578d4-bb9d-4f85-988f-5c375edfd3da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:56.585463 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30578d4-bb9d-4f85-988f-5c375edfd3da admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:56.615333 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1234/2453] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:59:56 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:59:56.619872 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5198a97-6330-4578-8487-5a1094e8f338 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:56.633895 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5198a97-6330-4578-8487-5a1094e8f338 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:56.640921 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1234c-f887-4f2b-8d5a-2834f053e98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:56.641957 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1234c-f887-4f2b-8d5a-2834f053e98f admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:56.642390 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1234c-f887-4f2b-8d5a-2834f053e98f admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:56.642752 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1234c-f887-4f2b-8d5a-2834f053e98f admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:56.643435 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c1234c-f887-4f2b-8d5a-2834f053e98f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:56.646062 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c1234c-f887-4f2b-8d5a-2834f053e98f admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:56.665223 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1220/2454] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:59:56.670294 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30578d4-bb9d-4f85-988f-5c375edfd3da admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:56.684361 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30578d4-bb9d-4f85-988f-5c375edfd3da admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:56.694049 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7d0a5-2bed-44dd-a01f-046adf9f6a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:56.695363 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7d0a5-2bed-44dd-a01f-046adf9f6a97 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:56.695724 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7d0a5-2bed-44dd-a01f-046adf9f6a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:56.696382 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7d0a5-2bed-44dd-a01f-046adf9f6a97 admin admin] PATH_INFO: `/v3/projects/8a7c129de36449509aa61be9105bef2e/users/a4f4de32c5194bdeb8b4498aae87bc65/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:56.719552 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d7d0a5-2bed-44dd-a01f-046adf9f6a97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a7c129de36449509aa61be9105bef2e, user_id=a4f4de32c5194bdeb8b4498aae87bc65, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:56.725211 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d7d0a5-2bed-44dd-a01f-046adf9f6a97 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:56.746121 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1235/2455] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:59:56 2022] PUT /identity/v3/projects/8a7c129de36449509aa61be9105bef2e/users/a4f4de32c5194bdeb8b4498aae87bc65/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:59:56.751979 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1234c-f887-4f2b-8d5a-2834f053e98f admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:56.772040 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1234c-f887-4f2b-8d5a-2834f053e98f admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:56.888419 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216cc32-1a79-49d4-acae-51c77cf19523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:56.891466 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216cc32-1a79-49d4-acae-51c77cf19523 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:56.891466 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216cc32-1a79-49d4-acae-51c77cf19523 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:56.891466 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216cc32-1a79-49d4-acae-51c77cf19523 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:56.892851 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2216cc32-1a79-49d4-acae-51c77cf19523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:56.896254 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2216cc32-1a79-49d4-acae-51c77cf19523 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:56.912100 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1221/2456] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:59:56.918148 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7d0a5-2bed-44dd-a01f-046adf9f6a97 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:56.935925 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7d0a5-2bed-44dd-a01f-046adf9f6a97 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:56.944430 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4ce42-3f18-4d1c-b986-90b3c911302c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:56.945739 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4ce42-3f18-4d1c-b986-90b3c911302c admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:56.946071 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4ce42-3f18-4d1c-b986-90b3c911302c admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:56.946356 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4ce42-3f18-4d1c-b986-90b3c911302c admin admin] PATH_INFO: `/v3/projects/8a7c129de36449509aa61be9105bef2e/users/a4f4de32c5194bdeb8b4498aae87bc65/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:56.948787 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4ce42-3f18-4d1c-b986-90b3c911302c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a7c129de36449509aa61be9105bef2e, user_id=a4f4de32c5194bdeb8b4498aae87bc65, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:56.951856 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4ce42-3f18-4d1c-b986-90b3c911302c admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:56.966042 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1236/2457] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:59:56 2022] PUT /identity/v3/projects/8a7c129de36449509aa61be9105bef2e/users/a4f4de32c5194bdeb8b4498aae87bc65/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:59:56.977351 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285b42e-b973-4775-a6c2-6fdd681b4c67 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:56.977667 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285b42e-b973-4775-a6c2-6fdd681b4c67 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:56.978037 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285b42e-b973-4775-a6c2-6fdd681b4c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:57.009049 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-8285b42e-b973-4775-a6c2-6fdd681b4c67 None None] MFA Rules not processed for user `a4f4de32c5194bdeb8b4498aae87bc65`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:59:57.010493 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-8285b42e-b973-4775-a6c2-6fdd681b4c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:57.094949 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1222/2458] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:59:56 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:59:57.113227 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4ce42-3f18-4d1c-b986-90b3c911302c admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:57.115480 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-8aa4ce42-3f18-4d1c-b986-90b3c911302c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:57.190664 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4ce42-3f18-4d1c-b986-90b3c911302c admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:57.194375 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f90c8c-a32b-45b3-a8f8-099b77698a16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:57.195025 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f90c8c-a32b-45b3-a8f8-099b77698a16 service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:57.195302 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f90c8c-a32b-45b3-a8f8-099b77698a16 service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:57.195577 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f90c8c-a32b-45b3-a8f8-099b77698a16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:57.205463 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f90c8c-a32b-45b3-a8f8-099b77698a16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:57.206924 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f90c8c-a32b-45b3-a8f8-099b77698a16 service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:57.216956 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1237/2459] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:59:57 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:59:57.691424 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285b42e-b973-4775-a6c2-6fdd681b4c67 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:57.768095 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285b42e-b973-4775-a6c2-6fdd681b4c67 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:57.772995 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4888ac-029d-4c12-9521-adee132b51ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:57.773871 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4888ac-029d-4c12-9521-adee132b51ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:57.774138 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4888ac-029d-4c12-9521-adee132b51ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:57.774413 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4888ac-029d-4c12-9521-adee132b51ec admin admin] PATH_INFO: `/v3/users/147b50b5348544e6b2709f46ed4fb61f` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:57.775619 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4888ac-029d-4c12-9521-adee132b51ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=147b50b5348544e6b2709f46ed4fb61f)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:57.777635 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4888ac-029d-4c12-9521-adee132b51ec admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:57.826329 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-dc4888ac-029d-4c12-9521-adee132b51ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '147b50b5348544e6b2709f46ed4fb61f'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:57.834311 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-dc4888ac-029d-4c12-9521-adee132b51ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '147b50b5348544e6b2709f46ed4fb61f'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:57.835122 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-dc4888ac-029d-4c12-9521-adee132b51ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '147b50b5348544e6b2709f46ed4fb61f'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:57.847823 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-dc4888ac-029d-4c12-9521-adee132b51ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '147b50b5348544e6b2709f46ed4fb61f'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:57.850677 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-dc4888ac-029d-4c12-9521-adee132b51ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '147b50b5348544e6b2709f46ed4fb61f'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:57.867406 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1223/2460] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:59:57 2022] DELETE /identity/v3/users/147b50b5348544e6b2709f46ed4fb61f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:59:57.873448 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376505a3-ec7e-4af6-8ed4-4d947425114a None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:57.873737 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376505a3-ec7e-4af6-8ed4-4d947425114a None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:57.874536 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376505a3-ec7e-4af6-8ed4-4d947425114a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:57.896482 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-376505a3-ec7e-4af6-8ed4-4d947425114a None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:59:57.898119 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-376505a3-ec7e-4af6-8ed4-4d947425114a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:57.978857 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1238/2461] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:59:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:59:57.989957 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4888ac-029d-4c12-9521-adee132b51ec admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:57.991684 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-dc4888ac-029d-4c12-9521-adee132b51ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:58.060696 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4888ac-029d-4c12-9521-adee132b51ec admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:58.065731 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe56bee-b89b-4e8d-be80-62dc51f19a9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:58.066401 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe56bee-b89b-4e8d-be80-62dc51f19a9a service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:58.066994 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe56bee-b89b-4e8d-be80-62dc51f19a9a service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:58.066994 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe56bee-b89b-4e8d-be80-62dc51f19a9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:58.087980 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe56bee-b89b-4e8d-be80-62dc51f19a9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:58.091784 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe56bee-b89b-4e8d-be80-62dc51f19a9a service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:58.112791 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1224/2462] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 20:59:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:59:58.520712 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376505a3-ec7e-4af6-8ed4-4d947425114a None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:58.522601 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-376505a3-ec7e-4af6-8ed4-4d947425114a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:58.542363 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376505a3-ec7e-4af6-8ed4-4d947425114a None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:58.549459 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d051642-7dd6-4f23-8c90-968dc7645624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:58.550503 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d051642-7dd6-4f23-8c90-968dc7645624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:58.550798 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d051642-7dd6-4f23-8c90-968dc7645624 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:58.551061 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d051642-7dd6-4f23-8c90-968dc7645624 admin admin] PATH_INFO: `/v3/projects/e725daa0a5b3406c816aae131ef549f1` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:58.552624 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d051642-7dd6-4f23-8c90-968dc7645624 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e725daa0a5b3406c816aae131ef549f1)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:58.554444 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d051642-7dd6-4f23-8c90-968dc7645624 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:58.607841 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-1d051642-7dd6-4f23-8c90-968dc7645624 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e725daa0a5b3406c816aae131ef549f1', 'request_id': 'req-1d051642-7dd6-4f23-8c90-968dc7645624'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:58.614327 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-1d051642-7dd6-4f23-8c90-968dc7645624 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e725daa0a5b3406c816aae131ef549f1', 'request_id': 'req-1d051642-7dd6-4f23-8c90-968dc7645624'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:58.625254 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-1d051642-7dd6-4f23-8c90-968dc7645624 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e725daa0a5b3406c816aae131ef549f1', 'request_id': 'req-1d051642-7dd6-4f23-8c90-968dc7645624'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:58.638163 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-1d051642-7dd6-4f23-8c90-968dc7645624 admin admin] The token cache is being invalidate because project e725daa0a5b3406c816aae131ef549f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:59:58.638499 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-1d051642-7dd6-4f23-8c90-968dc7645624 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:58.639161 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-1d051642-7dd6-4f23-8c90-968dc7645624 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:58.641476 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1239/2463] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:59:58 2022] DELETE /identity/v3/projects/e725daa0a5b3406c816aae131ef549f1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:59:58.646232 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe56bee-b89b-4e8d-be80-62dc51f19a9a service neutron] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:58.657985 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe56bee-b89b-4e8d-be80-62dc51f19a9a service neutron] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:58.719988 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780c5a0-8ee3-423b-8a5f-94dac68c7bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:58.720906 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780c5a0-8ee3-423b-8a5f-94dac68c7bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:58.721185 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780c5a0-8ee3-423b-8a5f-94dac68c7bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:58.721457 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780c5a0-8ee3-423b-8a5f-94dac68c7bb9 admin admin] PATH_INFO: `/v3/users/a4f4de32c5194bdeb8b4498aae87bc65` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:58.722693 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780c5a0-8ee3-423b-8a5f-94dac68c7bb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4f4de32c5194bdeb8b4498aae87bc65)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:58.725558 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780c5a0-8ee3-423b-8a5f-94dac68c7bb9 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:58.784585 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-7780c5a0-8ee3-423b-8a5f-94dac68c7bb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4f4de32c5194bdeb8b4498aae87bc65'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:58.796587 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-7780c5a0-8ee3-423b-8a5f-94dac68c7bb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4f4de32c5194bdeb8b4498aae87bc65'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:58.797595 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-7780c5a0-8ee3-423b-8a5f-94dac68c7bb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4f4de32c5194bdeb8b4498aae87bc65'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:58.817217 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-7780c5a0-8ee3-423b-8a5f-94dac68c7bb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4f4de32c5194bdeb8b4498aae87bc65'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:58.818195 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-7780c5a0-8ee3-423b-8a5f-94dac68c7bb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4f4de32c5194bdeb8b4498aae87bc65'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:58.835541 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1225/2464] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 20:59:58 2022] DELETE /identity/v3/users/a4f4de32c5194bdeb8b4498aae87bc65 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:59:59.139172 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d051642-7dd6-4f23-8c90-968dc7645624 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:59.141724 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-1d051642-7dd6-4f23-8c90-968dc7645624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:59.158700 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d051642-7dd6-4f23-8c90-968dc7645624 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:59.238883 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20d397-0a6a-49ce-a423-79dc689ffddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:59.239810 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20d397-0a6a-49ce-a423-79dc689ffddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:59.240087 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20d397-0a6a-49ce-a423-79dc689ffddb admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:59.240361 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20d397-0a6a-49ce-a423-79dc689ffddb admin admin] PATH_INFO: `/v3/projects/8a7c129de36449509aa61be9105bef2e` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:59.241603 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d20d397-0a6a-49ce-a423-79dc689ffddb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a7c129de36449509aa61be9105bef2e)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:59.243522 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d20d397-0a6a-49ce-a423-79dc689ffddb admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:59.295325 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-7d20d397-0a6a-49ce-a423-79dc689ffddb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a7c129de36449509aa61be9105bef2e', 'request_id': 'req-7d20d397-0a6a-49ce-a423-79dc689ffddb'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:59.301742 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-7d20d397-0a6a-49ce-a423-79dc689ffddb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a7c129de36449509aa61be9105bef2e', 'request_id': 'req-7d20d397-0a6a-49ce-a423-79dc689ffddb'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:59.310056 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-7d20d397-0a6a-49ce-a423-79dc689ffddb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a7c129de36449509aa61be9105bef2e', 'request_id': 'req-7d20d397-0a6a-49ce-a423-79dc689ffddb'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:59.322358 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-7d20d397-0a6a-49ce-a423-79dc689ffddb admin admin] The token cache is being invalidate because project 8a7c129de36449509aa61be9105bef2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:59:59.322653 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-7d20d397-0a6a-49ce-a423-79dc689ffddb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:59.323312 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-7d20d397-0a6a-49ce-a423-79dc689ffddb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:59:59.324945 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1240/2465] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 20:59:59 2022] DELETE /identity/v3/projects/8a7c129de36449509aa61be9105bef2e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:59:59.330386 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cebd02-d61c-4430-861e-35de91c1eb4e None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:59.330675 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cebd02-d61c-4430-861e-35de91c1eb4e None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:59.330952 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cebd02-d61c-4430-861e-35de91c1eb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:59.351113 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-34cebd02-d61c-4430-861e-35de91c1eb4e None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:59:59.352412 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-34cebd02-d61c-4430-861e-35de91c1eb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:59.437155 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1226/2466] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:59:59.446976 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d027e-6c12-425a-9f88-eb857ffae176 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:59.447323 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d027e-6c12-425a-9f88-eb857ffae176 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:59.447524 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d027e-6c12-425a-9f88-eb857ffae176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:59.471031 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-e50d027e-6c12-425a-9f88-eb857ffae176 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:59:59.472310 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-e50d027e-6c12-425a-9f88-eb857ffae176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:59:59.480588 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1241/2467] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:59:59.485861 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cebd02-d61c-4430-861e-35de91c1eb4e None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:59.495844 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cebd02-d61c-4430-861e-35de91c1eb4e None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:59.500976 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4abd538-5ae9-49b6-9f55-6ce216f843d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:59.501649 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abd538-5ae9-49b6-9f55-6ce216f843d3 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:59.502185 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abd538-5ae9-49b6-9f55-6ce216f843d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:59.504266 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abd538-5ae9-49b6-9f55-6ce216f843d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:59.505314 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4abd538-5ae9-49b6-9f55-6ce216f843d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:59:59.505875 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4abd538-5ae9-49b6-9f55-6ce216f843d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:59.507646 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4abd538-5ae9-49b6-9f55-6ce216f843d3 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:59.527837 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1227/2468] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 20:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:59:59.530778 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d027e-6c12-425a-9f88-eb857ffae176 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:59.541639 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d027e-6c12-425a-9f88-eb857ffae176 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:59.548016 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507de78-6c8e-434a-8c21-e73eb68e566f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:59.549036 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507de78-6c8e-434a-8c21-e73eb68e566f admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:59.549303 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507de78-6c8e-434a-8c21-e73eb68e566f admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:59.549755 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507de78-6c8e-434a-8c21-e73eb68e566f admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:59.550457 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6507de78-6c8e-434a-8c21-e73eb68e566f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:59.556112 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6507de78-6c8e-434a-8c21-e73eb68e566f admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:59.593856 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1242/2469] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 20:59:59 2022] POST /identity/v3/projects => generated 365 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:59:59.598714 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4abd538-5ae9-49b6-9f55-6ce216f843d3 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:59.610102 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4abd538-5ae9-49b6-9f55-6ce216f843d3 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:59.688339 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935386cd-a54e-466c-91cf-f13651773aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:59.689215 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935386cd-a54e-466c-91cf-f13651773aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:59.689695 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935386cd-a54e-466c-91cf-f13651773aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:59.689986 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935386cd-a54e-466c-91cf-f13651773aa0 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:59.691043 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935386cd-a54e-466c-91cf-f13651773aa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:59.693802 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935386cd-a54e-466c-91cf-f13651773aa0 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:59.720925 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1228/2470] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 20:59:59 2022] POST /identity/v3/users => generated 283 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:59:59.722500 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507de78-6c8e-434a-8c21-e73eb68e566f admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:59.740629 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507de78-6c8e-434a-8c21-e73eb68e566f admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:59.748938 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb5dc1-25df-494f-bd89-a8ed32ff90de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:59.750004 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb5dc1-25df-494f-bd89-a8ed32ff90de admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:59.750590 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb5dc1-25df-494f-bd89-a8ed32ff90de admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:59.750993 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb5dc1-25df-494f-bd89-a8ed32ff90de admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:59.753087 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb5dc1-25df-494f-bd89-a8ed32ff90de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:59.757354 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb5dc1-25df-494f-bd89-a8ed32ff90de admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:59.779656 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1243/2471] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:59:59.785089 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935386cd-a54e-466c-91cf-f13651773aa0 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:59.796282 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935386cd-a54e-466c-91cf-f13651773aa0 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:59.801647 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdb088-b230-4754-96d0-68c230db3576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:59.802363 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdb088-b230-4754-96d0-68c230db3576 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:59.802699 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdb088-b230-4754-96d0-68c230db3576 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:59.803004 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdb088-b230-4754-96d0-68c230db3576 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:59.803941 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cdb088-b230-4754-96d0-68c230db3576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:59.805789 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cdb088-b230-4754-96d0-68c230db3576 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:59.820327 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1229/2472] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 20:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:59:59.826737 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb5dc1-25df-494f-bd89-a8ed32ff90de admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:59:59.840001 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb5dc1-25df-494f-bd89-a8ed32ff90de admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:59:59.848307 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a2794-ad19-455e-9e4b-44581a0554bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:59:59.849386 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a2794-ad19-455e-9e4b-44581a0554bb admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:59.849805 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a2794-ad19-455e-9e4b-44581a0554bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:59.850080 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a2794-ad19-455e-9e4b-44581a0554bb admin admin] PATH_INFO: `/v3/projects/efad673005464d169df6dacd7a246ddf/users/1c0b641778dd442ebad41a4f561e4134/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:59.869529 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a2794-ad19-455e-9e4b-44581a0554bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=efad673005464d169df6dacd7a246ddf, user_id=1c0b641778dd442ebad41a4f561e4134, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:59:59.872176 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a2794-ad19-455e-9e4b-44581a0554bb admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:59:59.887035 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1244/2473] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 20:59:59 2022] PUT /identity/v3/projects/efad673005464d169df6dacd7a246ddf/users/1c0b641778dd442ebad41a4f561e4134/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:59:59.899284 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bb426-49ed-4fcd-a59b-45ca5e50d472 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:59:59.899542 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bb426-49ed-4fcd-a59b-45ca5e50d472 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:59:59.899861 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bb426-49ed-4fcd-a59b-45ca5e50d472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:59:59.940071 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-119bb426-49ed-4fcd-a59b-45ca5e50d472 None None] MFA Rules not processed for user `1c0b641778dd442ebad41a4f561e4134`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:59:59.941995 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-119bb426-49ed-4fcd-a59b-45ca5e50d472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:00.034967 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1230/2474] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 20:59:59 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:00:00.036751 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a2794-ad19-455e-9e4b-44581a0554bb admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:00.115152 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a2794-ad19-455e-9e4b-44581a0554bb admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:00.119828 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6930b-1944-4e26-bb6a-3413a2c3eb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:00.120545 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6930b-1944-4e26-bb6a-3413a2c3eb38 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:00.120824 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6930b-1944-4e26-bb6a-3413a2c3eb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:00.121102 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6930b-1944-4e26-bb6a-3413a2c3eb38 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:00.121791 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da6930b-1944-4e26-bb6a-3413a2c3eb38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:00.123709 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da6930b-1944-4e26-bb6a-3413a2c3eb38 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:00.152187 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1245/2475] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 21:00:00 2022] POST /identity/v3/projects => generated 359 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:00:00.156923 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bb426-49ed-4fcd-a59b-45ca5e50d472 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:00.169179 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bb426-49ed-4fcd-a59b-45ca5e50d472 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:00.237196 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b8917-bee0-4f73-a05d-f795596210d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:00.237876 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b8917-bee0-4f73-a05d-f795596210d2 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:00.238155 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b8917-bee0-4f73-a05d-f795596210d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:00.238424 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b8917-bee0-4f73-a05d-f795596210d2 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:00.239136 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b8917-bee0-4f73-a05d-f795596210d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:00.241096 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b8917-bee0-4f73-a05d-f795596210d2 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:00.263140 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1231/2476] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 21:00:00 2022] POST /identity/v3/users => generated 286 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:00:00.273240 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6930b-1944-4e26-bb6a-3413a2c3eb38 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:00.284804 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6930b-1944-4e26-bb6a-3413a2c3eb38 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:00.289758 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffabdcd-8573-4265-9814-85c6248eb19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:00.290412 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffabdcd-8573-4265-9814-85c6248eb19f admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:00.290689 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffabdcd-8573-4265-9814-85c6248eb19f admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:00.290958 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffabdcd-8573-4265-9814-85c6248eb19f admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:00.291673 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffabdcd-8573-4265-9814-85c6248eb19f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:00.293319 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffabdcd-8573-4265-9814-85c6248eb19f admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:00.306638 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1246/2477] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:00:00.311047 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b8917-bee0-4f73-a05d-f795596210d2 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:00.322363 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b8917-bee0-4f73-a05d-f795596210d2 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:00.327089 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0aa191-a9a8-4a78-b194-c10609d232ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:00.327985 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0aa191-a9a8-4a78-b194-c10609d232ec admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:00.328257 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0aa191-a9a8-4a78-b194-c10609d232ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:00.328521 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0aa191-a9a8-4a78-b194-c10609d232ec admin admin] PATH_INFO: `/v3/projects/b845dcbb4f394f718925eb4707b08102/users/84bc704e88f6451cbaa84a9b23c21675/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:00.344543 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0aa191-a9a8-4a78-b194-c10609d232ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=b845dcbb4f394f718925eb4707b08102, user_id=84bc704e88f6451cbaa84a9b23c21675, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:00.348907 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0aa191-a9a8-4a78-b194-c10609d232ec admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:00.366881 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1232/2478] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:00:00 2022] PUT /identity/v3/projects/b845dcbb4f394f718925eb4707b08102/users/84bc704e88f6451cbaa84a9b23c21675/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:00.370823 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffabdcd-8573-4265-9814-85c6248eb19f admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:00.381173 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffabdcd-8573-4265-9814-85c6248eb19f admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:00.440777 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d47cb9-cc54-4a2a-a1b7-877f64c97b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:00.441436 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d47cb9-cc54-4a2a-a1b7-877f64c97b7a admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:00.441711 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d47cb9-cc54-4a2a-a1b7-877f64c97b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:00.441977 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d47cb9-cc54-4a2a-a1b7-877f64c97b7a admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:00.442690 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d47cb9-cc54-4a2a-a1b7-877f64c97b7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:00.444301 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d47cb9-cc54-4a2a-a1b7-877f64c97b7a admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:00.455762 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1247/2479] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:00:00.460954 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0aa191-a9a8-4a78-b194-c10609d232ec admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:00.472607 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0aa191-a9a8-4a78-b194-c10609d232ec admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:00.477494 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fa338-a7ef-4d12-915b-173be223f0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:00.478373 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fa338-a7ef-4d12-915b-173be223f0b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:00.478671 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fa338-a7ef-4d12-915b-173be223f0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:00.478962 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fa338-a7ef-4d12-915b-173be223f0b9 admin admin] PATH_INFO: `/v3/projects/b845dcbb4f394f718925eb4707b08102/users/84bc704e88f6451cbaa84a9b23c21675/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:00.480948 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899fa338-a7ef-4d12-915b-173be223f0b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b845dcbb4f394f718925eb4707b08102, user_id=84bc704e88f6451cbaa84a9b23c21675, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:00.483734 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899fa338-a7ef-4d12-915b-173be223f0b9 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:00.494679 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1233/2480] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:00:00 2022] PUT /identity/v3/projects/b845dcbb4f394f718925eb4707b08102/users/84bc704e88f6451cbaa84a9b23c21675/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:00.505478 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c709db-94bf-47e0-a144-21d8dbf4d230 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:00.505759 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c709db-94bf-47e0-a144-21d8dbf4d230 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:00.506039 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c709db-94bf-47e0-a144-21d8dbf4d230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:00.538476 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-24c709db-94bf-47e0-a144-21d8dbf4d230 None None] MFA Rules not processed for user `84bc704e88f6451cbaa84a9b23c21675`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:00.540515 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-24c709db-94bf-47e0-a144-21d8dbf4d230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:00.635599 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1248/2481] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:00 2022] POST /identity/v3/auth/tokens => generated 3293 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:00:00.643952 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fa338-a7ef-4d12-915b-173be223f0b9 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:00.646081 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-899fa338-a7ef-4d12-915b-173be223f0b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:00.708012 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fa338-a7ef-4d12-915b-173be223f0b9 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:00.719669 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577e14b-01a5-4946-a755-171c4d9321ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:00.720404 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577e14b-01a5-4946-a755-171c4d9321ed service cinder] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:00.720680 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577e14b-01a5-4946-a755-171c4d9321ed service cinder] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:00.721001 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577e14b-01a5-4946-a755-171c4d9321ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:00.735603 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577e14b-01a5-4946-a755-171c4d9321ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:00.737117 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577e14b-01a5-4946-a755-171c4d9321ed service cinder] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:00.747347 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1234/2482] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:00:00 2022] GET /identity/v3/auth/tokens => generated 3293 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:00:00.832158 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c709db-94bf-47e0-a144-21d8dbf4d230 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:00.841890 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c709db-94bf-47e0-a144-21d8dbf4d230 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:00.846780 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70147af-459d-4282-baf1-728aaecd1f0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:00.847447 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70147af-459d-4282-baf1-728aaecd1f0a service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:00.847730 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70147af-459d-4282-baf1-728aaecd1f0a service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:00.848041 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70147af-459d-4282-baf1-728aaecd1f0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:00.914748 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70147af-459d-4282-baf1-728aaecd1f0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:00.916146 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70147af-459d-4282-baf1-728aaecd1f0a service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:00.925650 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1249/2483] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:00:00 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:00:03.396584 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577e14b-01a5-4946-a755-171c4d9321ed service cinder] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:03.398128 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-9577e14b-01a5-4946-a755-171c4d9321ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:03.468858 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577e14b-01a5-4946-a755-171c4d9321ed service cinder] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:03.474263 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2a235-d3b5-4531-99c0-dfb78eccfae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:03.475215 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2a235-d3b5-4531-99c0-dfb78eccfae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:03.475430 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2a235-d3b5-4531-99c0-dfb78eccfae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:03.475715 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2a235-d3b5-4531-99c0-dfb78eccfae7 admin admin] PATH_INFO: `/v3/users/cf48d461e31243d5b920628b476132f8` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:03.477032 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a2a235-d3b5-4531-99c0-dfb78eccfae7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf48d461e31243d5b920628b476132f8)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:03.479109 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a2a235-d3b5-4531-99c0-dfb78eccfae7 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:03.531607 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-68a2a235-d3b5-4531-99c0-dfb78eccfae7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf48d461e31243d5b920628b476132f8'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:03.538724 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-68a2a235-d3b5-4531-99c0-dfb78eccfae7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf48d461e31243d5b920628b476132f8'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:03.539412 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-68a2a235-d3b5-4531-99c0-dfb78eccfae7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf48d461e31243d5b920628b476132f8'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:03.551088 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-68a2a235-d3b5-4531-99c0-dfb78eccfae7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf48d461e31243d5b920628b476132f8'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:03.551930 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-68a2a235-d3b5-4531-99c0-dfb78eccfae7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf48d461e31243d5b920628b476132f8'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:03.565739 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1235/2484] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:00:03 2022] DELETE /identity/v3/users/cf48d461e31243d5b920628b476132f8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:03.570543 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940112a9-5611-41b2-af3f-4a58e22fd128 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:03.571035 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940112a9-5611-41b2-af3f-4a58e22fd128 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:03.571155 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940112a9-5611-41b2-af3f-4a58e22fd128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:03.591029 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-940112a9-5611-41b2-af3f-4a58e22fd128 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:03.592267 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-940112a9-5611-41b2-af3f-4a58e22fd128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:03.663028 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1250/2485] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 21:00:03.672832 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2a235-d3b5-4531-99c0-dfb78eccfae7 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:03.676294 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-68a2a235-d3b5-4531-99c0-dfb78eccfae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:03.687512 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940112a9-5611-41b2-af3f-4a58e22fd128 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:03.688969 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-940112a9-5611-41b2-af3f-4a58e22fd128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:03.700693 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940112a9-5611-41b2-af3f-4a58e22fd128 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:03.706056 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145d9a7-acc5-484e-8b77-65065ec22e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:03.706960 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145d9a7-acc5-484e-8b77-65065ec22e76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:03.707238 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145d9a7-acc5-484e-8b77-65065ec22e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:03.707508 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145d9a7-acc5-484e-8b77-65065ec22e76 admin admin] PATH_INFO: `/v3/users/1c0b641778dd442ebad41a4f561e4134` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:03.708791 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145d9a7-acc5-484e-8b77-65065ec22e76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c0b641778dd442ebad41a4f561e4134)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:03.710732 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145d9a7-acc5-484e-8b77-65065ec22e76 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:03.741529 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2a235-d3b5-4531-99c0-dfb78eccfae7 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:03.746572 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9ab3a-2ff8-42bc-bb90-61483bdc35f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:03.747305 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9ab3a-2ff8-42bc-bb90-61483bdc35f8 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:03.747604 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9ab3a-2ff8-42bc-bb90-61483bdc35f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:03.747914 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9ab3a-2ff8-42bc-bb90-61483bdc35f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:03.760275 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9ab3a-2ff8-42bc-bb90-61483bdc35f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:03.761810 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9ab3a-2ff8-42bc-bb90-61483bdc35f8 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:03.769746 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-0145d9a7-acc5-484e-8b77-65065ec22e76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c0b641778dd442ebad41a4f561e4134'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:03.774323 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1236/2486] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:00:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:00:03.781579 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-0145d9a7-acc5-484e-8b77-65065ec22e76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c0b641778dd442ebad41a4f561e4134'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:03.790868 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-0145d9a7-acc5-484e-8b77-65065ec22e76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c0b641778dd442ebad41a4f561e4134'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:03.791500 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-0145d9a7-acc5-484e-8b77-65065ec22e76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c0b641778dd442ebad41a4f561e4134'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:03.804616 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-0145d9a7-acc5-484e-8b77-65065ec22e76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c0b641778dd442ebad41a4f561e4134'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:03.810961 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1251/2487] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:00:03 2022] DELETE /identity/v3/users/1c0b641778dd442ebad41a4f561e4134 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 21:00:03.816269 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7c9c2-a84a-42e8-909f-5afd489101c9 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:03.816554 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7c9c2-a84a-42e8-909f-5afd489101c9 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:03.816835 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7c9c2-a84a-42e8-909f-5afd489101c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:03.837613 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-2ca7c9c2-a84a-42e8-909f-5afd489101c9 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:03.838874 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-2ca7c9c2-a84a-42e8-909f-5afd489101c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:03.907122 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1237/2488] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:00:03.919013 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145d9a7-acc5-484e-8b77-65065ec22e76 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:03.920709 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-0145d9a7-acc5-484e-8b77-65065ec22e76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:04.005440 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145d9a7-acc5-484e-8b77-65065ec22e76 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:04.009513 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef37e31-b299-419c-b61c-bda8a9c17446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:04.010252 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef37e31-b299-419c-b61c-bda8a9c17446 service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:04.010668 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef37e31-b299-419c-b61c-bda8a9c17446 service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:04.010968 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef37e31-b299-419c-b61c-bda8a9c17446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:04.021276 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef37e31-b299-419c-b61c-bda8a9c17446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:04.022764 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef37e31-b299-419c-b61c-bda8a9c17446 service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:04.035386 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1252/2489] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:00:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:00:04.148561 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7c9c2-a84a-42e8-909f-5afd489101c9 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:04.150347 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-2ca7c9c2-a84a-42e8-909f-5afd489101c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:04.163440 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7c9c2-a84a-42e8-909f-5afd489101c9 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:04.168775 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538ca12-6857-4cca-927c-ffb227e60cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:04.170070 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538ca12-6857-4cca-927c-ffb227e60cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:04.170225 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538ca12-6857-4cca-927c-ffb227e60cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:04.171282 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538ca12-6857-4cca-927c-ffb227e60cc7 admin admin] PATH_INFO: `/v3/projects/07b9a4e55dfc47bdae7295ccc10eda49` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:04.172644 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538ca12-6857-4cca-927c-ffb227e60cc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07b9a4e55dfc47bdae7295ccc10eda49)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:04.174716 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538ca12-6857-4cca-927c-ffb227e60cc7 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:04.243152 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-5538ca12-6857-4cca-927c-ffb227e60cc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07b9a4e55dfc47bdae7295ccc10eda49', 'request_id': 'req-5538ca12-6857-4cca-927c-ffb227e60cc7'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:04.252269 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-5538ca12-6857-4cca-927c-ffb227e60cc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07b9a4e55dfc47bdae7295ccc10eda49', 'request_id': 'req-5538ca12-6857-4cca-927c-ffb227e60cc7'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:04.273093 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-5538ca12-6857-4cca-927c-ffb227e60cc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07b9a4e55dfc47bdae7295ccc10eda49', 'request_id': 'req-5538ca12-6857-4cca-927c-ffb227e60cc7'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:04.293238 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-5538ca12-6857-4cca-927c-ffb227e60cc7 admin admin] The token cache is being invalidate because project 07b9a4e55dfc47bdae7295ccc10eda49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:00:04.293787 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-5538ca12-6857-4cca-927c-ffb227e60cc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:04.294721 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-5538ca12-6857-4cca-927c-ffb227e60cc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:04.297754 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1238/2490] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:00:04 2022] DELETE /identity/v3/projects/07b9a4e55dfc47bdae7295ccc10eda49 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:04.304328 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536f675-4aeb-4982-983f-a76acd05d7af None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:04.305112 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536f675-4aeb-4982-983f-a76acd05d7af None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:04.305291 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536f675-4aeb-4982-983f-a76acd05d7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:04.331541 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-3536f675-4aeb-4982-983f-a76acd05d7af None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:04.333226 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-3536f675-4aeb-4982-983f-a76acd05d7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:04.408444 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1253/2491] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:00:04.416455 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c8aa1-6c38-4ce6-a750-e279c91ec993 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:04.416986 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c8aa1-6c38-4ce6-a750-e279c91ec993 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:04.417114 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c8aa1-6c38-4ce6-a750-e279c91ec993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:04.419059 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536f675-4aeb-4982-983f-a76acd05d7af None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:04.420620 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-3536f675-4aeb-4982-983f-a76acd05d7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:04.433109 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536f675-4aeb-4982-983f-a76acd05d7af None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:04.438244 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-310c8aa1-6c38-4ce6-a750-e279c91ec993 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:04.440030 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-310c8aa1-6c38-4ce6-a750-e279c91ec993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:04.441147 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ef1f3-4691-4f34-be37-5bc73d46d11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:04.442025 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ef1f3-4691-4f34-be37-5bc73d46d11a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:04.442351 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ef1f3-4691-4f34-be37-5bc73d46d11a admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:04.442619 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ef1f3-4691-4f34-be37-5bc73d46d11a admin admin] PATH_INFO: `/v3/projects/efad673005464d169df6dacd7a246ddf` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:04.448603 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196ef1f3-4691-4f34-be37-5bc73d46d11a admin admin] RBAC: Authorizing `identity:delete_project(project_id=efad673005464d169df6dacd7a246ddf)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:04.450569 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196ef1f3-4691-4f34-be37-5bc73d46d11a admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:04.457245 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1239/2492] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 21:00:04.461773 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c8aa1-6c38-4ce6-a750-e279c91ec993 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:04.473649 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c8aa1-6c38-4ce6-a750-e279c91ec993 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:04.481172 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5b154-6de9-4e23-9622-0a51fefde45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:04.481951 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5b154-6de9-4e23-9622-0a51fefde45e admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:04.485126 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5b154-6de9-4e23-9622-0a51fefde45e admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:04.485126 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5b154-6de9-4e23-9622-0a51fefde45e admin admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:04.485126 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5b154-6de9-4e23-9622-0a51fefde45e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 21:00:04.485126 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5b154-6de9-4e23-9622-0a51fefde45e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:04.486009 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5b154-6de9-4e23-9622-0a51fefde45e admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:04.499872 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1240/2493] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 21:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 21:00:04.504483 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5b154-6de9-4e23-9622-0a51fefde45e admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:04.515618 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5b154-6de9-4e23-9622-0a51fefde45e admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:04.533503 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-196ef1f3-4691-4f34-be37-5bc73d46d11a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efad673005464d169df6dacd7a246ddf', 'request_id': 'req-196ef1f3-4691-4f34-be37-5bc73d46d11a'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:04.542495 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-196ef1f3-4691-4f34-be37-5bc73d46d11a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efad673005464d169df6dacd7a246ddf', 'request_id': 'req-196ef1f3-4691-4f34-be37-5bc73d46d11a'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:04.565133 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-196ef1f3-4691-4f34-be37-5bc73d46d11a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efad673005464d169df6dacd7a246ddf', 'request_id': 'req-196ef1f3-4691-4f34-be37-5bc73d46d11a'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:04.580068 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-196ef1f3-4691-4f34-be37-5bc73d46d11a admin admin] The token cache is being invalidate because project efad673005464d169df6dacd7a246ddf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:00:04.580780 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-196ef1f3-4691-4f34-be37-5bc73d46d11a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:04.581357 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-196ef1f3-4691-4f34-be37-5bc73d46d11a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:04.584158 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1254/2494] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:00:04 2022] DELETE /identity/v3/projects/efad673005464d169df6dacd7a246ddf => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:04.588566 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ef1f3-4691-4f34-be37-5bc73d46d11a admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:04.590000 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-196ef1f3-4691-4f34-be37-5bc73d46d11a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:04.599276 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfdee32-f55f-48e7-b90b-30fc5a6fa211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:04.600099 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfdee32-f55f-48e7-b90b-30fc5a6fa211 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:04.600443 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfdee32-f55f-48e7-b90b-30fc5a6fa211 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:04.600783 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfdee32-f55f-48e7-b90b-30fc5a6fa211 admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:04.601762 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfdee32-f55f-48e7-b90b-30fc5a6fa211 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:04.604354 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfdee32-f55f-48e7-b90b-30fc5a6fa211 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:04.638680 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1241/2495] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 21:00:04 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:00:04.640014 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfdee32-f55f-48e7-b90b-30fc5a6fa211 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:04.642556 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-4dfdee32-f55f-48e7-b90b-30fc5a6fa211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:04.668594 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ef1f3-4691-4f34-be37-5bc73d46d11a admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:04.730828 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfdee32-f55f-48e7-b90b-30fc5a6fa211 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:04.739549 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd8812-2253-4539-999b-011b792e1062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:04.740374 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd8812-2253-4539-999b-011b792e1062 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:04.740721 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd8812-2253-4539-999b-011b792e1062 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:04.741061 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd8812-2253-4539-999b-011b792e1062 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:04.741825 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd8812-2253-4539-999b-011b792e1062 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:04.743854 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd8812-2253-4539-999b-011b792e1062 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:04.744879 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722197af-48b4-4999-aa97-688ad75bf7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:04.746121 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722197af-48b4-4999-aa97-688ad75bf7dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:04.746553 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722197af-48b4-4999-aa97-688ad75bf7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:04.747049 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722197af-48b4-4999-aa97-688ad75bf7dc admin admin] PATH_INFO: `/v3/users/84bc704e88f6451cbaa84a9b23c21675` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:04.749111 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722197af-48b4-4999-aa97-688ad75bf7dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=84bc704e88f6451cbaa84a9b23c21675)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:04.753946 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722197af-48b4-4999-aa97-688ad75bf7dc admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:04.769048 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1242/2496] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 21:00:04 2022] POST /identity/v3/users => generated 287 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:00:04.775459 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd8812-2253-4539-999b-011b792e1062 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:04.785884 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd8812-2253-4539-999b-011b792e1062 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:04.790981 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1738b843-1c18-4514-bfee-9604bd1e3623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:04.791646 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738b843-1c18-4514-bfee-9604bd1e3623 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:04.791993 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738b843-1c18-4514-bfee-9604bd1e3623 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:04.792268 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738b843-1c18-4514-bfee-9604bd1e3623 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:04.793018 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1738b843-1c18-4514-bfee-9604bd1e3623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:04.794639 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1738b843-1c18-4514-bfee-9604bd1e3623 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:04.815477 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1243/2497] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:00:04.819615 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1738b843-1c18-4514-bfee-9604bd1e3623 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:04.820864 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-722197af-48b4-4999-aa97-688ad75bf7dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84bc704e88f6451cbaa84a9b23c21675'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:04.828451 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-722197af-48b4-4999-aa97-688ad75bf7dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84bc704e88f6451cbaa84a9b23c21675'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:04.831117 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1738b843-1c18-4514-bfee-9604bd1e3623 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:04.836223 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-722197af-48b4-4999-aa97-688ad75bf7dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84bc704e88f6451cbaa84a9b23c21675'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:04.837710 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-722197af-48b4-4999-aa97-688ad75bf7dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84bc704e88f6451cbaa84a9b23c21675'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:04.840401 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09357ac8-0555-4a0f-9b82-3c226877c83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:04.841383 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09357ac8-0555-4a0f-9b82-3c226877c83f admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:04.841812 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09357ac8-0555-4a0f-9b82-3c226877c83f admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:04.842220 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09357ac8-0555-4a0f-9b82-3c226877c83f admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:04.844020 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09357ac8-0555-4a0f-9b82-3c226877c83f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:04.846523 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09357ac8-0555-4a0f-9b82-3c226877c83f admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:04.857037 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1244/2498] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 21:00:04.859413 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-722197af-48b4-4999-aa97-688ad75bf7dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84bc704e88f6451cbaa84a9b23c21675'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:04.862551 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09357ac8-0555-4a0f-9b82-3c226877c83f admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:04.864378 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-09357ac8-0555-4a0f-9b82-3c226877c83f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:04.866189 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1255/2499] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:00:04 2022] DELETE /identity/v3/users/84bc704e88f6451cbaa84a9b23c21675 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 21:00:04.878736 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09357ac8-0555-4a0f-9b82-3c226877c83f admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:04.941939 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad751a-bafb-4007-8be4-f064ca22e618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:04.943118 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad751a-bafb-4007-8be4-f064ca22e618 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:04.944153 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad751a-bafb-4007-8be4-f064ca22e618 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:04.944434 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad751a-bafb-4007-8be4-f064ca22e618 admin admin] PATH_INFO: `/v3/projects/aa38cff1f83b49e4a7b00f522c785317/users/6e610ccaae6244478e7d8669af8e919d/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:04.965745 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad751a-bafb-4007-8be4-f064ca22e618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa38cff1f83b49e4a7b00f522c785317, user_id=6e610ccaae6244478e7d8669af8e919d, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:04.969421 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad751a-bafb-4007-8be4-f064ca22e618 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:04.985283 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1245/2500] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:00:04 2022] PUT /identity/v3/projects/aa38cff1f83b49e4a7b00f522c785317/users/6e610ccaae6244478e7d8669af8e919d/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 21:00:04.996898 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe424edc-2088-45c0-9d4a-d1922466bf0e None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:04.997192 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe424edc-2088-45c0-9d4a-d1922466bf0e None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:04.997445 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe424edc-2088-45c0-9d4a-d1922466bf0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:05.026751 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-fe424edc-2088-45c0-9d4a-d1922466bf0e None None] MFA Rules not processed for user `6e610ccaae6244478e7d8669af8e919d`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:05.028186 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-fe424edc-2088-45c0-9d4a-d1922466bf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:05.102400 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1256/2501] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:00:05.114098 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad751a-bafb-4007-8be4-f064ca22e618 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:05.115822 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-93ad751a-bafb-4007-8be4-f064ca22e618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:05.162341 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe424edc-2088-45c0-9d4a-d1922466bf0e None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:05.164155 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-fe424edc-2088-45c0-9d4a-d1922466bf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:05.209247 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad751a-bafb-4007-8be4-f064ca22e618 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:05.215389 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926a82d-6599-4cb6-8829-beb29b8c6e59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:05.216201 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926a82d-6599-4cb6-8829-beb29b8c6e59 service nova] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:05.216478 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926a82d-6599-4cb6-8829-beb29b8c6e59 service nova] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:05.216752 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926a82d-6599-4cb6-8829-beb29b8c6e59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:05.226968 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926a82d-6599-4cb6-8829-beb29b8c6e59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:05.228657 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926a82d-6599-4cb6-8829-beb29b8c6e59 service nova] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:05.234821 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe424edc-2088-45c0-9d4a-d1922466bf0e None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:05.238410 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1246/2502] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:00:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 21:00:05.240026 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83f29e-92b6-4618-9cf8-b2fb73cea35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:05.240896 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83f29e-92b6-4618-9cf8-b2fb73cea35b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:05.241169 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83f29e-92b6-4618-9cf8-b2fb73cea35b admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:05.241448 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83f29e-92b6-4618-9cf8-b2fb73cea35b admin admin] PATH_INFO: `/v3/projects/b845dcbb4f394f718925eb4707b08102` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:05.242662 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83f29e-92b6-4618-9cf8-b2fb73cea35b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b845dcbb4f394f718925eb4707b08102)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:05.244840 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83f29e-92b6-4618-9cf8-b2fb73cea35b admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:05.314372 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-da83f29e-92b6-4618-9cf8-b2fb73cea35b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b845dcbb4f394f718925eb4707b08102', 'request_id': 'req-da83f29e-92b6-4618-9cf8-b2fb73cea35b'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:05.320166 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-da83f29e-92b6-4618-9cf8-b2fb73cea35b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b845dcbb4f394f718925eb4707b08102', 'request_id': 'req-da83f29e-92b6-4618-9cf8-b2fb73cea35b'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:05.329723 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-da83f29e-92b6-4618-9cf8-b2fb73cea35b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b845dcbb4f394f718925eb4707b08102', 'request_id': 'req-da83f29e-92b6-4618-9cf8-b2fb73cea35b'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:05.342867 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-da83f29e-92b6-4618-9cf8-b2fb73cea35b admin admin] The token cache is being invalidate because project b845dcbb4f394f718925eb4707b08102 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:00:05.343980 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-da83f29e-92b6-4618-9cf8-b2fb73cea35b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:05.344504 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-da83f29e-92b6-4618-9cf8-b2fb73cea35b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:05.346394 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1257/2503] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:00:05 2022] DELETE /identity/v3/projects/b845dcbb4f394f718925eb4707b08102 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:05.353225 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21720aff-5684-4ef8-8ffa-1b27aa60b875 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:05.353883 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21720aff-5684-4ef8-8ffa-1b27aa60b875 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:05.353883 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21720aff-5684-4ef8-8ffa-1b27aa60b875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:05.376480 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-21720aff-5684-4ef8-8ffa-1b27aa60b875 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:05.377803 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-21720aff-5684-4ef8-8ffa-1b27aa60b875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:05.446118 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83f29e-92b6-4618-9cf8-b2fb73cea35b admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:05.447937 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-da83f29e-92b6-4618-9cf8-b2fb73cea35b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:05.458925 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1247/2504] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:00:05.468003 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224a795-168f-4305-8269-ed6e43dc4643 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:05.468291 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224a795-168f-4305-8269-ed6e43dc4643 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:05.468574 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224a795-168f-4305-8269-ed6e43dc4643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:05.487088 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-4224a795-168f-4305-8269-ed6e43dc4643 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:05.488447 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-4224a795-168f-4305-8269-ed6e43dc4643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:05.496563 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1248/2505] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 21:00:05.501955 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224a795-168f-4305-8269-ed6e43dc4643 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:05.516825 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224a795-168f-4305-8269-ed6e43dc4643 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:05.524152 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339e300-f42e-42d5-845c-6a469a760c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:05.525178 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339e300-f42e-42d5-845c-6a469a760c2c admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:05.525617 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339e300-f42e-42d5-845c-6a469a760c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:05.526061 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339e300-f42e-42d5-845c-6a469a760c2c admin admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:05.527272 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6339e300-f42e-42d5-845c-6a469a760c2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 21:00:05.527795 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6339e300-f42e-42d5-845c-6a469a760c2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:05.530016 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83f29e-92b6-4618-9cf8-b2fb73cea35b admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:05.530663 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6339e300-f42e-42d5-845c-6a469a760c2c admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:05.536146 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12d715-d31c-4569-b3ce-64e4b14b77c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:05.537063 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12d715-d31c-4569-b3ce-64e4b14b77c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:05.537341 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12d715-d31c-4569-b3ce-64e4b14b77c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:05.537616 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12d715-d31c-4569-b3ce-64e4b14b77c8 admin admin] PATH_INFO: `/v3/users/6e610ccaae6244478e7d8669af8e919d` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:05.538967 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12d715-d31c-4569-b3ce-64e4b14b77c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e610ccaae6244478e7d8669af8e919d)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:05.541046 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12d715-d31c-4569-b3ce-64e4b14b77c8 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:05.548275 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1249/2506] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 21:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 21:00:05.549421 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339e300-f42e-42d5-845c-6a469a760c2c admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:05.560834 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339e300-f42e-42d5-845c-6a469a760c2c admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:05.570246 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364aa783-521c-4844-a346-3ef55c4c240e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:05.571082 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364aa783-521c-4844-a346-3ef55c4c240e admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:05.571582 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364aa783-521c-4844-a346-3ef55c4c240e admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:05.572136 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364aa783-521c-4844-a346-3ef55c4c240e admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:05.573361 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364aa783-521c-4844-a346-3ef55c4c240e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:05.578678 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364aa783-521c-4844-a346-3ef55c4c240e admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:05.592513 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ab12d715-d31c-4569-b3ce-64e4b14b77c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e610ccaae6244478e7d8669af8e919d'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:05.599566 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ab12d715-d31c-4569-b3ce-64e4b14b77c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e610ccaae6244478e7d8669af8e919d'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:05.609522 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ab12d715-d31c-4569-b3ce-64e4b14b77c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e610ccaae6244478e7d8669af8e919d'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:05.610400 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ab12d715-d31c-4569-b3ce-64e4b14b77c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e610ccaae6244478e7d8669af8e919d'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:05.615588 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1250/2507] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 21:00:05 2022] POST /identity/v3/projects => generated 367 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:00:05.617506 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364aa783-521c-4844-a346-3ef55c4c240e admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:05.619378 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-364aa783-521c-4844-a346-3ef55c4c240e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:05.625769 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ab12d715-d31c-4569-b3ce-64e4b14b77c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e610ccaae6244478e7d8669af8e919d'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:05.632287 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1258/2508] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:00:05 2022] DELETE /identity/v3/users/6e610ccaae6244478e7d8669af8e919d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:05.637685 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c091f-7516-4433-9c7c-52678d02f667 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:05.638049 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c091f-7516-4433-9c7c-52678d02f667 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:05.638383 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c091f-7516-4433-9c7c-52678d02f667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:05.659185 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-0d6c091f-7516-4433-9c7c-52678d02f667 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:05.660567 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-0d6c091f-7516-4433-9c7c-52678d02f667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:05.712938 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364aa783-521c-4844-a346-3ef55c4c240e admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:05.755789 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1259/2509] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 21:00:05.767446 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c091f-7516-4433-9c7c-52678d02f667 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:05.770002 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-0d6c091f-7516-4433-9c7c-52678d02f667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:05.785299 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce1aed-c026-40fb-b5d7-457ec86f1006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:05.786215 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce1aed-c026-40fb-b5d7-457ec86f1006 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:05.786532 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce1aed-c026-40fb-b5d7-457ec86f1006 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:05.786942 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce1aed-c026-40fb-b5d7-457ec86f1006 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:05.787919 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce1aed-c026-40fb-b5d7-457ec86f1006 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:05.790169 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce1aed-c026-40fb-b5d7-457ec86f1006 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:05.820283 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1251/2510] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 21:00:05 2022] POST /identity/v3/users => generated 284 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:00:05.833536 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce1aed-c026-40fb-b5d7-457ec86f1006 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:05.850132 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce1aed-c026-40fb-b5d7-457ec86f1006 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:05.856779 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9342cce-99e3-455f-a4f2-cc2c0fa1b4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:05.856963 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c091f-7516-4433-9c7c-52678d02f667 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:05.857604 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9342cce-99e3-455f-a4f2-cc2c0fa1b4fa admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:05.857951 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9342cce-99e3-455f-a4f2-cc2c0fa1b4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:05.858805 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9342cce-99e3-455f-a4f2-cc2c0fa1b4fa admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:05.859917 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9342cce-99e3-455f-a4f2-cc2c0fa1b4fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:05.861720 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9342cce-99e3-455f-a4f2-cc2c0fa1b4fa admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:05.862396 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611cf4d-1ed6-4d0c-9a11-9edd950652b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:05.863428 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611cf4d-1ed6-4d0c-9a11-9edd950652b9 service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:05.863804 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611cf4d-1ed6-4d0c-9a11-9edd950652b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:05.864582 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611cf4d-1ed6-4d0c-9a11-9edd950652b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:05.874000 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1252/2511] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 21:00:05.875571 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611cf4d-1ed6-4d0c-9a11-9edd950652b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:05.877215 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611cf4d-1ed6-4d0c-9a11-9edd950652b9 service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:05.878143 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9342cce-99e3-455f-a4f2-cc2c0fa1b4fa admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:05.888566 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1260/2512] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:00:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:00:05.892048 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9342cce-99e3-455f-a4f2-cc2c0fa1b4fa admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:05.898719 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9dcb4d-0668-4195-af46-2f76248b4b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:05.899402 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dcb4d-0668-4195-af46-2f76248b4b61 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:05.899678 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dcb4d-0668-4195-af46-2f76248b4b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:05.899994 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dcb4d-0668-4195-af46-2f76248b4b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:05.900799 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9dcb4d-0668-4195-af46-2f76248b4b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:05.903448 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9dcb4d-0668-4195-af46-2f76248b4b61 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:05.915574 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1253/2513] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:00:05.920312 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611cf4d-1ed6-4d0c-9a11-9edd950652b9 service neutron] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:05.941062 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611cf4d-1ed6-4d0c-9a11-9edd950652b9 service neutron] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:05.955372 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3f157-e225-4fe5-bc88-77e889736e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:05.957029 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3f157-e225-4fe5-bc88-77e889736e83 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:05.957522 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3f157-e225-4fe5-bc88-77e889736e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:05.958014 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3f157-e225-4fe5-bc88-77e889736e83 admin admin] PATH_INFO: `/v3/projects/e8c01d41b49d4c669bbd9116d6bf4001/users/7f79d047d8814ff1b83cd2d40778bb35/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:05.989459 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab3f157-e225-4fe5-bc88-77e889736e83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8c01d41b49d4c669bbd9116d6bf4001, user_id=7f79d047d8814ff1b83cd2d40778bb35, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:05.992014 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab3f157-e225-4fe5-bc88-77e889736e83 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:06.012065 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1261/2514] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:00:05 2022] PUT /identity/v3/projects/e8c01d41b49d4c669bbd9116d6bf4001/users/7f79d047d8814ff1b83cd2d40778bb35/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:06.021107 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39254482-800d-4705-82f2-3da728613a33 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:06.021393 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39254482-800d-4705-82f2-3da728613a33 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:06.021652 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39254482-800d-4705-82f2-3da728613a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:06.068981 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-39254482-800d-4705-82f2-3da728613a33 None None] MFA Rules not processed for user `7f79d047d8814ff1b83cd2d40778bb35`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:06.070644 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-39254482-800d-4705-82f2-3da728613a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:06.174421 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1254/2515] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:06 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:00:06.176676 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3f157-e225-4fe5-bc88-77e889736e83 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:06.267810 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39254482-800d-4705-82f2-3da728613a33 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:06.270130 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-39254482-800d-4705-82f2-3da728613a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:06.293272 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3f157-e225-4fe5-bc88-77e889736e83 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:06.301843 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c6a5b-f2fb-42b6-aa10-11ad9de55f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:06.302689 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c6a5b-f2fb-42b6-aa10-11ad9de55f06 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:06.303080 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c6a5b-f2fb-42b6-aa10-11ad9de55f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:06.303498 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c6a5b-f2fb-42b6-aa10-11ad9de55f06 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:06.304720 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c6a5b-f2fb-42b6-aa10-11ad9de55f06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:06.308271 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c6a5b-f2fb-42b6-aa10-11ad9de55f06 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:06.382258 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1262/2516] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 21:00:06 2022] POST /identity/v3/projects => generated 365 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:00:06.386032 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c6a5b-f2fb-42b6-aa10-11ad9de55f06 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:06.412050 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39254482-800d-4705-82f2-3da728613a33 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:06.482393 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a6618-aa12-4331-92fa-a909dd61af31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:06.484002 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a6618-aa12-4331-92fa-a909dd61af31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:06.484337 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a6618-aa12-4331-92fa-a909dd61af31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:06.484685 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a6618-aa12-4331-92fa-a909dd61af31 admin admin] PATH_INFO: `/v3/projects/aa38cff1f83b49e4a7b00f522c785317` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:06.486064 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a6618-aa12-4331-92fa-a909dd61af31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa38cff1f83b49e4a7b00f522c785317)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:06.486840 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c6a5b-f2fb-42b6-aa10-11ad9de55f06 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:06.488082 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a6618-aa12-4331-92fa-a909dd61af31 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:06.491668 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b23a79-b3a6-4441-941e-7f3cbf69d522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:06.492385 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b23a79-b3a6-4441-941e-7f3cbf69d522 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:06.492663 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b23a79-b3a6-4441-941e-7f3cbf69d522 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:06.492935 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b23a79-b3a6-4441-941e-7f3cbf69d522 admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:06.493625 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b23a79-b3a6-4441-941e-7f3cbf69d522 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:06.495582 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b23a79-b3a6-4441-941e-7f3cbf69d522 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:06.524358 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1263/2517] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 21:00:06 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 21:00:06.525531 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b23a79-b3a6-4441-941e-7f3cbf69d522 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:06.536822 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b23a79-b3a6-4441-941e-7f3cbf69d522 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:06.543888 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-893a6618-aa12-4331-92fa-a909dd61af31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa38cff1f83b49e4a7b00f522c785317', 'request_id': 'req-893a6618-aa12-4331-92fa-a909dd61af31'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:06.551574 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-893a6618-aa12-4331-92fa-a909dd61af31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa38cff1f83b49e4a7b00f522c785317', 'request_id': 'req-893a6618-aa12-4331-92fa-a909dd61af31'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:06.558153 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-893a6618-aa12-4331-92fa-a909dd61af31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa38cff1f83b49e4a7b00f522c785317', 'request_id': 'req-893a6618-aa12-4331-92fa-a909dd61af31'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:06.575478 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-893a6618-aa12-4331-92fa-a909dd61af31 admin admin] The token cache is being invalidate because project aa38cff1f83b49e4a7b00f522c785317 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:00:06.575797 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-893a6618-aa12-4331-92fa-a909dd61af31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:06.576603 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-893a6618-aa12-4331-92fa-a909dd61af31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:06.578702 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1255/2518] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:00:06 2022] DELETE /identity/v3/projects/aa38cff1f83b49e4a7b00f522c785317 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:06.583980 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29583bd0-60b3-4bc9-b1df-697635a2a025 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:06.584502 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29583bd0-60b3-4bc9-b1df-697635a2a025 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:06.584815 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29583bd0-60b3-4bc9-b1df-697635a2a025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:06.599110 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af9bdb-56b5-47f0-b060-371c7d9168c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:06.599980 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af9bdb-56b5-47f0-b060-371c7d9168c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:06.600259 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af9bdb-56b5-47f0-b060-371c7d9168c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:06.600550 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af9bdb-56b5-47f0-b060-371c7d9168c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:06.601350 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af9bdb-56b5-47f0-b060-371c7d9168c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:06.603192 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af9bdb-56b5-47f0-b060-371c7d9168c2 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:06.607379 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-29583bd0-60b3-4bc9-b1df-697635a2a025 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:06.609794 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-29583bd0-60b3-4bc9-b1df-697635a2a025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:06.619032 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1264/2519] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 21:00:06.619238 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1256/2520] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 21:00:06.622179 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af9bdb-56b5-47f0-b060-371c7d9168c2 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:06.626061 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-47af9bdb-56b5-47f0-b060-371c7d9168c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:06.626346 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645a248-79b4-47a3-b8f5-5fc4bad9ed23 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:06.626631 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645a248-79b4-47a3-b8f5-5fc4bad9ed23 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:06.626908 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645a248-79b4-47a3-b8f5-5fc4bad9ed23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:06.639562 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af9bdb-56b5-47f0-b060-371c7d9168c2 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:06.645380 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212859f-f71c-44c9-a2c3-991e9fc3ea7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:06.646269 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212859f-f71c-44c9-a2c3-991e9fc3ea7b admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:06.646547 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212859f-f71c-44c9-a2c3-991e9fc3ea7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:06.646845 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212859f-f71c-44c9-a2c3-991e9fc3ea7b admin admin] PATH_INFO: `/v3/projects/f70133334d6c409b8b2f4dc6ce09fcd8/users/8e69c9bb8ba44fb6b8ef327d5443995a/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:06.648501 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-5645a248-79b4-47a3-b8f5-5fc4bad9ed23 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:06.650161 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-5645a248-79b4-47a3-b8f5-5fc4bad9ed23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:06.659430 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1257/2521] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:00:06.663483 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212859f-f71c-44c9-a2c3-991e9fc3ea7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f70133334d6c409b8b2f4dc6ce09fcd8, user_id=8e69c9bb8ba44fb6b8ef327d5443995a, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:06.664252 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645a248-79b4-47a3-b8f5-5fc4bad9ed23 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:06.666224 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212859f-f71c-44c9-a2c3-991e9fc3ea7b admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:06.676122 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645a248-79b4-47a3-b8f5-5fc4bad9ed23 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:06.687713 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1265/2522] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:00:06 2022] PUT /identity/v3/projects/f70133334d6c409b8b2f4dc6ce09fcd8/users/8e69c9bb8ba44fb6b8ef327d5443995a/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:06.692057 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212859f-f71c-44c9-a2c3-991e9fc3ea7b admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:06.752002 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f00187-9172-4a99-9be0-9c57827772e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:06.753281 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f00187-9172-4a99-9be0-9c57827772e4 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:06.753736 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f00187-9172-4a99-9be0-9c57827772e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:06.754182 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f00187-9172-4a99-9be0-9c57827772e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:06.757165 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f00187-9172-4a99-9be0-9c57827772e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 21:00:06.757752 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f00187-9172-4a99-9be0-9c57827772e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:06.760085 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f00187-9172-4a99-9be0-9c57827772e4 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:06.763319 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212859f-f71c-44c9-a2c3-991e9fc3ea7b admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:06.768807 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d30a40-4eff-4efe-a5f6-f48aa783fa01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:06.771321 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d30a40-4eff-4efe-a5f6-f48aa783fa01 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:06.771321 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d30a40-4eff-4efe-a5f6-f48aa783fa01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:06.771321 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d30a40-4eff-4efe-a5f6-f48aa783fa01 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:06.771835 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d30a40-4eff-4efe-a5f6-f48aa783fa01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:06.773281 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d30a40-4eff-4efe-a5f6-f48aa783fa01 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:06.779792 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1258/2523] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 21:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 21:00:06.783144 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f00187-9172-4a99-9be0-9c57827772e4 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:06.787312 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1266/2524] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 21:00:06.791648 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d30a40-4eff-4efe-a5f6-f48aa783fa01 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:06.796653 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f00187-9172-4a99-9be0-9c57827772e4 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:06.801642 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b291f-aca2-44ea-86e9-308a68dbfbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:06.802301 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b291f-aca2-44ea-86e9-308a68dbfbc5 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:06.802631 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b291f-aca2-44ea-86e9-308a68dbfbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:06.802845 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b291f-aca2-44ea-86e9-308a68dbfbc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:06.804201 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b291f-aca2-44ea-86e9-308a68dbfbc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:06.804879 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d30a40-4eff-4efe-a5f6-f48aa783fa01 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:06.806133 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b291f-aca2-44ea-86e9-308a68dbfbc5 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:06.809931 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4060c7-cbd6-447c-bbfd-9f2598ac0a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:06.810880 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4060c7-cbd6-447c-bbfd-9f2598ac0a55 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:06.812027 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4060c7-cbd6-447c-bbfd-9f2598ac0a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:06.812320 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4060c7-cbd6-447c-bbfd-9f2598ac0a55 admin admin] PATH_INFO: `/v3/projects/f70133334d6c409b8b2f4dc6ce09fcd8/users/8e69c9bb8ba44fb6b8ef327d5443995a/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:06.814557 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4060c7-cbd6-447c-bbfd-9f2598ac0a55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f70133334d6c409b8b2f4dc6ce09fcd8, user_id=8e69c9bb8ba44fb6b8ef327d5443995a, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:06.817460 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4060c7-cbd6-447c-bbfd-9f2598ac0a55 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:06.830542 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1267/2525] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:00:06 2022] PUT /identity/v3/projects/f70133334d6c409b8b2f4dc6ce09fcd8/users/8e69c9bb8ba44fb6b8ef327d5443995a/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 21:00:06.841531 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c4dcb-8f65-4977-bebc-968307cd8512 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:06.841818 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c4dcb-8f65-4977-bebc-968307cd8512 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:06.842095 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c4dcb-8f65-4977-bebc-968307cd8512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:06.847633 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1259/2526] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 21:00:06 2022] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:00:06.849543 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b291f-aca2-44ea-86e9-308a68dbfbc5 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:06.882121 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-5c5c4dcb-8f65-4977-bebc-968307cd8512 None None] MFA Rules not processed for user `8e69c9bb8ba44fb6b8ef327d5443995a`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:06.883347 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-5c5c4dcb-8f65-4977-bebc-968307cd8512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:06.924194 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b291f-aca2-44ea-86e9-308a68dbfbc5 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:06.931374 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5588c-6ffd-420a-ab08-4492a38bfb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:06.932624 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5588c-6ffd-420a-ab08-4492a38bfb3c admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:06.933011 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5588c-6ffd-420a-ab08-4492a38bfb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:06.933375 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5588c-6ffd-420a-ab08-4492a38bfb3c admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:06.934167 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5588c-6ffd-420a-ab08-4492a38bfb3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:06.936263 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5588c-6ffd-420a-ab08-4492a38bfb3c admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:06.963185 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1260/2527] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 21:00:06 2022] POST /identity/v3/users => generated 291 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:00:06.968408 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5588c-6ffd-420a-ab08-4492a38bfb3c admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:06.973672 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1268/2528] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:06 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 21:00:06.979689 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5588c-6ffd-420a-ab08-4492a38bfb3c admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:06.986181 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7008c0c-c7d0-4790-b886-a5ce12747f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:06.987121 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7008c0c-c7d0-4790-b886-a5ce12747f68 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:06.987434 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7008c0c-c7d0-4790-b886-a5ce12747f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:06.987878 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7008c0c-c7d0-4790-b886-a5ce12747f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:06.988881 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7008c0c-c7d0-4790-b886-a5ce12747f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:06.989696 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c4dcb-8f65-4977-bebc-968307cd8512 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:06.990842 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7008c0c-c7d0-4790-b886-a5ce12747f68 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:06.993822 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-5c5c4dcb-8f65-4977-bebc-968307cd8512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:07.008423 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1261/2529] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 21:00:07.012706 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7008c0c-c7d0-4790-b886-a5ce12747f68 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:07.023353 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7008c0c-c7d0-4790-b886-a5ce12747f68 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:07.028329 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62caad-7af3-4705-8d74-06c4ecfb7b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:07.029018 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62caad-7af3-4705-8d74-06c4ecfb7b46 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:07.029324 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62caad-7af3-4705-8d74-06c4ecfb7b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:07.029621 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62caad-7af3-4705-8d74-06c4ecfb7b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:07.031020 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f62caad-7af3-4705-8d74-06c4ecfb7b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:07.033283 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f62caad-7af3-4705-8d74-06c4ecfb7b46 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:07.049554 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1262/2530] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:00:07.051393 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62caad-7af3-4705-8d74-06c4ecfb7b46 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:07.062875 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62caad-7af3-4705-8d74-06c4ecfb7b46 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:07.067922 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035fec2-1d27-4dec-b5fd-a791ef302880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:07.068818 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035fec2-1d27-4dec-b5fd-a791ef302880 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:07.069095 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035fec2-1d27-4dec-b5fd-a791ef302880 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:07.069371 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035fec2-1d27-4dec-b5fd-a791ef302880 admin admin] PATH_INFO: `/v3/projects/518626c6369c423383f3de14c94df18c/users/783cf0363ac943b8befb0b938687dd96/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:07.077705 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c4dcb-8f65-4977-bebc-968307cd8512 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:07.083988 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7c4fa-4b42-4b84-9a08-7d4888f61131 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:07.084977 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7c4fa-4b42-4b84-9a08-7d4888f61131 service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:07.085554 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7c4fa-4b42-4b84-9a08-7d4888f61131 service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:07.086081 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7c4fa-4b42-4b84-9a08-7d4888f61131 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:07.097051 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035fec2-1d27-4dec-b5fd-a791ef302880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=518626c6369c423383f3de14c94df18c, user_id=783cf0363ac943b8befb0b938687dd96, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:07.097814 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7c4fa-4b42-4b84-9a08-7d4888f61131 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:07.099263 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7c4fa-4b42-4b84-9a08-7d4888f61131 service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:07.102368 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035fec2-1d27-4dec-b5fd-a791ef302880 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:07.110144 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1269/2531] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:00:06 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 21:00:07.121810 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1263/2532] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:00:07 2022] PUT /identity/v3/projects/518626c6369c423383f3de14c94df18c/users/783cf0363ac943b8befb0b938687dd96/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 21:00:07.136962 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c1eb9-780c-4f06-b84c-77ea5d959005 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:07.136962 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c1eb9-780c-4f06-b84c-77ea5d959005 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:07.136962 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c1eb9-780c-4f06-b84c-77ea5d959005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:07.167878 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-dd7c1eb9-780c-4f06-b84c-77ea5d959005 None None] MFA Rules not processed for user `783cf0363ac943b8befb0b938687dd96`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:07.169134 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-dd7c1eb9-780c-4f06-b84c-77ea5d959005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:07.212217 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035fec2-1d27-4dec-b5fd-a791ef302880 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:07.244731 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1270/2533] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:00:07.249570 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c1eb9-780c-4f06-b84c-77ea5d959005 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:07.281043 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035fec2-1d27-4dec-b5fd-a791ef302880 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:07.284703 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc2fe0-d36b-4d4a-a074-fe55b3255857 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:07.285982 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc2fe0-d36b-4d4a-a074-fe55b3255857 service cinder] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:07.285982 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc2fe0-d36b-4d4a-a074-fe55b3255857 service cinder] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:07.285982 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc2fe0-d36b-4d4a-a074-fe55b3255857 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:07.288547 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-aabc2fe0-d36b-4d4a-a074-fe55b3255857 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:07.321691 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c1eb9-780c-4f06-b84c-77ea5d959005 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:07.326345 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9851c-e0b6-40a7-bb52-3bc7405b7a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:07.327527 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9851c-e0b6-40a7-bb52-3bc7405b7a68 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:07.327837 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9851c-e0b6-40a7-bb52-3bc7405b7a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:07.328115 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9851c-e0b6-40a7-bb52-3bc7405b7a68 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:07.328812 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9851c-e0b6-40a7-bb52-3bc7405b7a68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:07.330728 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9851c-e0b6-40a7-bb52-3bc7405b7a68 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:07.360284 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1271/2534] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 21:00:07 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 21:00:07.364261 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9851c-e0b6-40a7-bb52-3bc7405b7a68 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:07.364596 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabc2fe0-d36b-4d4a-a074-fe55b3255857 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:07.366053 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabc2fe0-d36b-4d4a-a074-fe55b3255857 service cinder] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:07.376809 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1264/2535] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:00:07 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 21:00:07.429601 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9851c-e0b6-40a7-bb52-3bc7405b7a68 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:07.436128 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b37f0-f943-4acd-821b-d18dc1e255d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:07.437078 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b37f0-f943-4acd-821b-d18dc1e255d8 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:07.437323 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b37f0-f943-4acd-821b-d18dc1e255d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:07.437670 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b37f0-f943-4acd-821b-d18dc1e255d8 admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:07.438585 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b37f0-f943-4acd-821b-d18dc1e255d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:07.440962 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b37f0-f943-4acd-821b-d18dc1e255d8 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:07.476524 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1272/2536] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 21:00:07 2022] POST /identity/v3/users => generated 296 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 21:00:07.477750 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc2fe0-d36b-4d4a-a074-fe55b3255857 service cinder] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:07.500393 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc2fe0-d36b-4d4a-a074-fe55b3255857 service cinder] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:07.505996 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e46e2-2ff9-4b84-9af3-1fcb88b0c4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:07.506950 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e46e2-2ff9-4b84-9af3-1fcb88b0c4eb admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:07.507257 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e46e2-2ff9-4b84-9af3-1fcb88b0c4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:07.507726 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e46e2-2ff9-4b84-9af3-1fcb88b0c4eb admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:07.508546 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e46e2-2ff9-4b84-9af3-1fcb88b0c4eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:07.510341 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e46e2-2ff9-4b84-9af3-1fcb88b0c4eb admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:07.526568 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1265/2537] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:00:07.528152 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b37f0-f943-4acd-821b-d18dc1e255d8 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:07.539842 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b37f0-f943-4acd-821b-d18dc1e255d8 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:07.548091 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1aa371-007f-4db2-9cd7-3143e5265ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:07.549489 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1aa371-007f-4db2-9cd7-3143e5265ba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:07.549870 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1aa371-007f-4db2-9cd7-3143e5265ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:07.550220 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1aa371-007f-4db2-9cd7-3143e5265ba4 admin admin] PATH_INFO: `/v3/projects/1629d720f52a4b07b07d55523a83bc1f/users/569dad32d38a4ffb96da129a779a0c22/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:07.574627 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1aa371-007f-4db2-9cd7-3143e5265ba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1629d720f52a4b07b07d55523a83bc1f, user_id=569dad32d38a4ffb96da129a779a0c22, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:07.578681 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1aa371-007f-4db2-9cd7-3143e5265ba4 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:07.596111 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1273/2538] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:00:07 2022] PUT /identity/v3/projects/1629d720f52a4b07b07d55523a83bc1f/users/569dad32d38a4ffb96da129a779a0c22/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:07.600156 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e46e2-2ff9-4b84-9af3-1fcb88b0c4eb admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:07.612810 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e46e2-2ff9-4b84-9af3-1fcb88b0c4eb admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:07.701879 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153fe157-5b5e-4535-bc27-5065da9d440d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:07.702342 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fe157-5b5e-4535-bc27-5065da9d440d admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:07.702615 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fe157-5b5e-4535-bc27-5065da9d440d admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:07.702882 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fe157-5b5e-4535-bc27-5065da9d440d admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:07.703762 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153fe157-5b5e-4535-bc27-5065da9d440d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:07.708453 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153fe157-5b5e-4535-bc27-5065da9d440d admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:07.722790 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1266/2539] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 21:00:07.729855 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1aa371-007f-4db2-9cd7-3143e5265ba4 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:07.746539 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1aa371-007f-4db2-9cd7-3143e5265ba4 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:07.754923 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d40341-be2c-4de2-8ee9-d3ae68b75539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:07.756288 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d40341-be2c-4de2-8ee9-d3ae68b75539 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:07.756678 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d40341-be2c-4de2-8ee9-d3ae68b75539 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:07.757010 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d40341-be2c-4de2-8ee9-d3ae68b75539 admin admin] PATH_INFO: `/v3/projects/1629d720f52a4b07b07d55523a83bc1f/users/569dad32d38a4ffb96da129a779a0c22/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:07.759007 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d40341-be2c-4de2-8ee9-d3ae68b75539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1629d720f52a4b07b07d55523a83bc1f, user_id=569dad32d38a4ffb96da129a779a0c22, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:07.763140 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d40341-be2c-4de2-8ee9-d3ae68b75539 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:07.779510 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1274/2540] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:00:07 2022] PUT /identity/v3/projects/1629d720f52a4b07b07d55523a83bc1f/users/569dad32d38a4ffb96da129a779a0c22/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 21:00:07.790858 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6a8f6-665b-4216-9438-46c1938f2053 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:07.791212 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6a8f6-665b-4216-9438-46c1938f2053 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:07.791466 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6a8f6-665b-4216-9438-46c1938f2053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:07.822341 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-c4f6a8f6-665b-4216-9438-46c1938f2053 None None] MFA Rules not processed for user `569dad32d38a4ffb96da129a779a0c22`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:07.823595 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-c4f6a8f6-665b-4216-9438-46c1938f2053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:07.898519 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1267/2541] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:07 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 21:00:07.912715 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d40341-be2c-4de2-8ee9-d3ae68b75539 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:07.979590 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d40341-be2c-4de2-8ee9-d3ae68b75539 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:07.985539 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06e4eb-90c1-4651-876f-e99e45cfd763 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:07.986699 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06e4eb-90c1-4651-876f-e99e45cfd763 service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:07.987204 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06e4eb-90c1-4651-876f-e99e45cfd763 service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:07.987798 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06e4eb-90c1-4651-876f-e99e45cfd763 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:08.005985 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa06e4eb-90c1-4651-876f-e99e45cfd763 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:08.009793 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa06e4eb-90c1-4651-876f-e99e45cfd763 service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:08.028466 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1275/2542] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:00:07 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:00:08.422687 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6a8f6-665b-4216-9438-46c1938f2053 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:08.434293 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6a8f6-665b-4216-9438-46c1938f2053 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:08.439494 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d08953-bab6-42e0-9c3b-c86232760a34 tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '569dad32d38a4ffb96da129a779a0c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1629d720f52a4b07b07d55523a83bc1f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:08.440205 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d08953-bab6-42e0-9c3b-c86232760a34 tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:08.440486 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d08953-bab6-42e0-9c3b-c86232760a34 tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:08.440763 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d08953-bab6-42e0-9c3b-c86232760a34 tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:08.441552 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d08953-bab6-42e0-9c3b-c86232760a34 tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 21:00:08.441904 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d08953-bab6-42e0-9c3b-c86232760a34 tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:08.443632 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d08953-bab6-42e0-9c3b-c86232760a34 tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:08.456308 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1268/2543] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 21:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 21:00:08.460638 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06e4eb-90c1-4651-876f-e99e45cfd763 service cinder] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:08.471003 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06e4eb-90c1-4651-876f-e99e45cfd763 service cinder] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:08.475980 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1af20f-5907-424e-9096-dd1941e89114 tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '569dad32d38a4ffb96da129a779a0c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1629d720f52a4b07b07d55523a83bc1f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:08.476638 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1af20f-5907-424e-9096-dd1941e89114 tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:08.476917 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1af20f-5907-424e-9096-dd1941e89114 tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:08.477198 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1af20f-5907-424e-9096-dd1941e89114 tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:08.477925 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1af20f-5907-424e-9096-dd1941e89114 tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:08.479884 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1af20f-5907-424e-9096-dd1941e89114 tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:08.511967 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1276/2544] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 21:00:08 2022] POST /identity/v3/projects => generated 355 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:00:08.520462 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d08953-bab6-42e0-9c3b-c86232760a34 tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:08.537743 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d08953-bab6-42e0-9c3b-c86232760a34 tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:08.606203 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fb7f5-46f4-48fe-9eee-433acca5ce62 tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '569dad32d38a4ffb96da129a779a0c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1629d720f52a4b07b07d55523a83bc1f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:08.606871 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fb7f5-46f4-48fe-9eee-433acca5ce62 tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:08.607153 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fb7f5-46f4-48fe-9eee-433acca5ce62 tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:08.607430 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fb7f5-46f4-48fe-9eee-433acca5ce62 tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:08.608283 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3fb7f5-46f4-48fe-9eee-433acca5ce62 tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 21:00:08.608742 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3fb7f5-46f4-48fe-9eee-433acca5ce62 tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:08.610370 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3fb7f5-46f4-48fe-9eee-433acca5ce62 tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:08.623313 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1269/2545] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 21:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 21:00:08.665898 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1af20f-5907-424e-9096-dd1941e89114 tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:08.678109 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1af20f-5907-424e-9096-dd1941e89114 tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:08.682940 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c09f83-8da0-49fc-ad53-40d6ddb9d7df tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '569dad32d38a4ffb96da129a779a0c22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1629d720f52a4b07b07d55523a83bc1f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:08.683877 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c09f83-8da0-49fc-ad53-40d6ddb9d7df tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:08.684306 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c09f83-8da0-49fc-ad53-40d6ddb9d7df tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:08.684656 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c09f83-8da0-49fc-ad53-40d6ddb9d7df tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] PATH_INFO: `/v3/projects/3bc6bbd709a44a54ab125d04ab6695b5` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:08.687576 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c09f83-8da0-49fc-ad53-40d6ddb9d7df tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3bc6bbd709a44a54ab125d04ab6695b5)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:08.690263 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c09f83-8da0-49fc-ad53-40d6ddb9d7df tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:08.740636 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-70c09f83-8da0-49fc-ad53-40d6ddb9d7df tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bc6bbd709a44a54ab125d04ab6695b5', 'request_id': 'req-70c09f83-8da0-49fc-ad53-40d6ddb9d7df'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:08.746015 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-70c09f83-8da0-49fc-ad53-40d6ddb9d7df tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bc6bbd709a44a54ab125d04ab6695b5', 'request_id': 'req-70c09f83-8da0-49fc-ad53-40d6ddb9d7df'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:08.755271 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-70c09f83-8da0-49fc-ad53-40d6ddb9d7df tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bc6bbd709a44a54ab125d04ab6695b5', 'request_id': 'req-70c09f83-8da0-49fc-ad53-40d6ddb9d7df'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:08.772198 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-70c09f83-8da0-49fc-ad53-40d6ddb9d7df tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] The token cache is being invalidate because project 3bc6bbd709a44a54ab125d04ab6695b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:00:08.772407 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-70c09f83-8da0-49fc-ad53-40d6ddb9d7df tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:08.773098 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-70c09f83-8da0-49fc-ad53-40d6ddb9d7df tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:08.774667 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1277/2546] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:00:08 2022] DELETE /identity/v3/projects/3bc6bbd709a44a54ab125d04ab6695b5 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:09.011614 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fb7f5-46f4-48fe-9eee-433acca5ce62 tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:09.013355 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-5a3fb7f5-46f4-48fe-9eee-433acca5ce62 tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:09.090057 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fb7f5-46f4-48fe-9eee-433acca5ce62 tempest-VolumeQuotaClassesTest-184702018 tempest-VolumeQuotaClassesTest-184702018-project-admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:09.149681 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431960d-d1ac-49c4-ad31-972ebf5c8059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:09.150560 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431960d-d1ac-49c4-ad31-972ebf5c8059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:09.150865 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431960d-d1ac-49c4-ad31-972ebf5c8059 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:09.151118 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431960d-d1ac-49c4-ad31-972ebf5c8059 admin admin] PATH_INFO: `/v3/users/783cf0363ac943b8befb0b938687dd96` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:09.152356 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431960d-d1ac-49c4-ad31-972ebf5c8059 admin admin] RBAC: Authorizing `identity:delete_user(user_id=783cf0363ac943b8befb0b938687dd96)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:09.154483 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431960d-d1ac-49c4-ad31-972ebf5c8059 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:09.214990 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-3431960d-d1ac-49c4-ad31-972ebf5c8059 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '783cf0363ac943b8befb0b938687dd96'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:09.222648 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-3431960d-d1ac-49c4-ad31-972ebf5c8059 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '783cf0363ac943b8befb0b938687dd96'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:09.223388 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-3431960d-d1ac-49c4-ad31-972ebf5c8059 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '783cf0363ac943b8befb0b938687dd96'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:09.235584 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-3431960d-d1ac-49c4-ad31-972ebf5c8059 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '783cf0363ac943b8befb0b938687dd96'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:09.236359 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-3431960d-d1ac-49c4-ad31-972ebf5c8059 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '783cf0363ac943b8befb0b938687dd96'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:09.250069 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1270/2547] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:00:09 2022] DELETE /identity/v3/users/783cf0363ac943b8befb0b938687dd96 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:09.254633 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35f664-079c-443d-8fa9-844b578d77e0 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:09.254924 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35f664-079c-443d-8fa9-844b578d77e0 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:09.255195 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35f664-079c-443d-8fa9-844b578d77e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:09.276068 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-ef35f664-079c-443d-8fa9-844b578d77e0 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:09.277326 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-ef35f664-079c-443d-8fa9-844b578d77e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:09.337942 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1278/2548] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:00:09.349159 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431960d-d1ac-49c4-ad31-972ebf5c8059 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:09.350656 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-3431960d-d1ac-49c4-ad31-972ebf5c8059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:09.410654 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431960d-d1ac-49c4-ad31-972ebf5c8059 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:09.414411 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aeed40-1d75-4e15-a94a-c82827ad6876 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:09.415062 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aeed40-1d75-4e15-a94a-c82827ad6876 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:09.415345 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aeed40-1d75-4e15-a94a-c82827ad6876 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:09.415615 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aeed40-1d75-4e15-a94a-c82827ad6876 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:09.426649 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aeed40-1d75-4e15-a94a-c82827ad6876 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:09.428334 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aeed40-1d75-4e15-a94a-c82827ad6876 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:09.439605 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1271/2549] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:00:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:00:09.736799 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35f664-079c-443d-8fa9-844b578d77e0 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:09.738631 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-ef35f664-079c-443d-8fa9-844b578d77e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:09.752165 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35f664-079c-443d-8fa9-844b578d77e0 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:09.757678 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c6ad0-b8c0-4852-8c7f-70e87975ff16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:09.758591 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c6ad0-b8c0-4852-8c7f-70e87975ff16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:09.759070 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c6ad0-b8c0-4852-8c7f-70e87975ff16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:09.759350 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c6ad0-b8c0-4852-8c7f-70e87975ff16 admin admin] PATH_INFO: `/v3/projects/518626c6369c423383f3de14c94df18c` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:09.760620 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c6ad0-b8c0-4852-8c7f-70e87975ff16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=518626c6369c423383f3de14c94df18c)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:09.763164 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c6ad0-b8c0-4852-8c7f-70e87975ff16 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:09.809233 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ab8c6ad0-b8c0-4852-8c7f-70e87975ff16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '518626c6369c423383f3de14c94df18c', 'request_id': 'req-ab8c6ad0-b8c0-4852-8c7f-70e87975ff16'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:09.815409 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ab8c6ad0-b8c0-4852-8c7f-70e87975ff16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '518626c6369c423383f3de14c94df18c', 'request_id': 'req-ab8c6ad0-b8c0-4852-8c7f-70e87975ff16'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:09.824133 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ab8c6ad0-b8c0-4852-8c7f-70e87975ff16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '518626c6369c423383f3de14c94df18c', 'request_id': 'req-ab8c6ad0-b8c0-4852-8c7f-70e87975ff16'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:09.836842 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ab8c6ad0-b8c0-4852-8c7f-70e87975ff16 admin admin] The token cache is being invalidate because project 518626c6369c423383f3de14c94df18c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:00:09.837132 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ab8c6ad0-b8c0-4852-8c7f-70e87975ff16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:09.837808 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ab8c6ad0-b8c0-4852-8c7f-70e87975ff16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:09.839394 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1279/2550] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:00:09 2022] DELETE /identity/v3/projects/518626c6369c423383f3de14c94df18c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:09.843655 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aeed40-1d75-4e15-a94a-c82827ad6876 service neutron] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:09.853797 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aeed40-1d75-4e15-a94a-c82827ad6876 service neutron] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:09.913129 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a0d79-c3dd-4c58-83c2-7842eafa1642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:09.914106 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a0d79-c3dd-4c58-83c2-7842eafa1642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:09.914440 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a0d79-c3dd-4c58-83c2-7842eafa1642 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:09.914714 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a0d79-c3dd-4c58-83c2-7842eafa1642 admin admin] PATH_INFO: `/v3/users/569dad32d38a4ffb96da129a779a0c22` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:09.916022 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a0d79-c3dd-4c58-83c2-7842eafa1642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=569dad32d38a4ffb96da129a779a0c22)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:09.918051 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a0d79-c3dd-4c58-83c2-7842eafa1642 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:09.968563 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-2d0a0d79-c3dd-4c58-83c2-7842eafa1642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '569dad32d38a4ffb96da129a779a0c22'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:09.975266 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-2d0a0d79-c3dd-4c58-83c2-7842eafa1642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '569dad32d38a4ffb96da129a779a0c22'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:09.976016 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-2d0a0d79-c3dd-4c58-83c2-7842eafa1642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '569dad32d38a4ffb96da129a779a0c22'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:09.988248 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-2d0a0d79-c3dd-4c58-83c2-7842eafa1642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '569dad32d38a4ffb96da129a779a0c22'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:09.988934 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-2d0a0d79-c3dd-4c58-83c2-7842eafa1642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '569dad32d38a4ffb96da129a779a0c22'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:10.002056 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1272/2551] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:00:09 2022] DELETE /identity/v3/users/569dad32d38a4ffb96da129a779a0c22 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:10.312197 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c6ad0-b8c0-4852-8c7f-70e87975ff16 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:10.314080 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-ab8c6ad0-b8c0-4852-8c7f-70e87975ff16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:10.340941 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c6ad0-b8c0-4852-8c7f-70e87975ff16 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:10.416120 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb96a7-3172-4a0d-a813-c125a9cfe4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:10.416747 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb96a7-3172-4a0d-a813-c125a9cfe4a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:10.417029 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb96a7-3172-4a0d-a813-c125a9cfe4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:10.417305 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb96a7-3172-4a0d-a813-c125a9cfe4a9 admin admin] PATH_INFO: `/v3/projects/1629d720f52a4b07b07d55523a83bc1f` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:10.421511 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb96a7-3172-4a0d-a813-c125a9cfe4a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1629d720f52a4b07b07d55523a83bc1f)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:10.425258 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb96a7-3172-4a0d-a813-c125a9cfe4a9 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:10.485234 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-c7bb96a7-3172-4a0d-a813-c125a9cfe4a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1629d720f52a4b07b07d55523a83bc1f', 'request_id': 'req-c7bb96a7-3172-4a0d-a813-c125a9cfe4a9'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:10.493246 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-c7bb96a7-3172-4a0d-a813-c125a9cfe4a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1629d720f52a4b07b07d55523a83bc1f', 'request_id': 'req-c7bb96a7-3172-4a0d-a813-c125a9cfe4a9'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:10.504282 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-c7bb96a7-3172-4a0d-a813-c125a9cfe4a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1629d720f52a4b07b07d55523a83bc1f', 'request_id': 'req-c7bb96a7-3172-4a0d-a813-c125a9cfe4a9'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:10.517972 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-c7bb96a7-3172-4a0d-a813-c125a9cfe4a9 admin admin] The token cache is being invalidate because project 1629d720f52a4b07b07d55523a83bc1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:00:10.518421 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-c7bb96a7-3172-4a0d-a813-c125a9cfe4a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:10.519546 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-c7bb96a7-3172-4a0d-a813-c125a9cfe4a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:10.521482 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1280/2552] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:00:10 2022] DELETE /identity/v3/projects/1629d720f52a4b07b07d55523a83bc1f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:10.527316 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85cbacd-6538-4db3-8e01-4e0e31dd489e None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:10.527960 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85cbacd-6538-4db3-8e01-4e0e31dd489e None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:10.528300 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85cbacd-6538-4db3-8e01-4e0e31dd489e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:10.549490 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-c85cbacd-6538-4db3-8e01-4e0e31dd489e None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:10.550776 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-c85cbacd-6538-4db3-8e01-4e0e31dd489e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:10.632083 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1273/2553] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 21:00:10.641027 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32e45d-5b2e-437c-8db4-1b8bf2b8e0fc None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:10.641495 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32e45d-5b2e-437c-8db4-1b8bf2b8e0fc None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:10.641948 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32e45d-5b2e-437c-8db4-1b8bf2b8e0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:10.674342 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-af32e45d-5b2e-437c-8db4-1b8bf2b8e0fc None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:10.677345 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-af32e45d-5b2e-437c-8db4-1b8bf2b8e0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:10.702611 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1281/2554] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 21:00:10.706974 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85cbacd-6538-4db3-8e01-4e0e31dd489e None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:10.716799 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85cbacd-6538-4db3-8e01-4e0e31dd489e None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:10.721754 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91358fe-7834-4a57-98f1-f4e88c32bb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:10.724020 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91358fe-7834-4a57-98f1-f4e88c32bb2b admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:10.724020 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91358fe-7834-4a57-98f1-f4e88c32bb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:10.724020 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91358fe-7834-4a57-98f1-f4e88c32bb2b admin admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:10.724020 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91358fe-7834-4a57-98f1-f4e88c32bb2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 21:00:10.724480 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91358fe-7834-4a57-98f1-f4e88c32bb2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:10.726148 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91358fe-7834-4a57-98f1-f4e88c32bb2b admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:10.739469 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1274/2555] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 21:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 21:00:10.743873 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32e45d-5b2e-437c-8db4-1b8bf2b8e0fc None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:10.754801 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32e45d-5b2e-437c-8db4-1b8bf2b8e0fc None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:10.760854 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0f1ea-22c9-4550-a7e0-2743aab02b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:10.761647 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0f1ea-22c9-4550-a7e0-2743aab02b31 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:10.761930 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0f1ea-22c9-4550-a7e0-2743aab02b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:10.762205 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0f1ea-22c9-4550-a7e0-2743aab02b31 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:10.762913 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0f1ea-22c9-4550-a7e0-2743aab02b31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:10.766093 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0f1ea-22c9-4550-a7e0-2743aab02b31 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:10.799641 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1282/2556] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 21:00:10 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 21:00:10.801091 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91358fe-7834-4a57-98f1-f4e88c32bb2b admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:10.813518 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91358fe-7834-4a57-98f1-f4e88c32bb2b admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:10.876949 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e81c1-a548-496a-ba3a-521c2396e3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:10.877991 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e81c1-a548-496a-ba3a-521c2396e3a6 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:10.878268 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e81c1-a548-496a-ba3a-521c2396e3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:10.878665 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e81c1-a548-496a-ba3a-521c2396e3a6 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:10.879580 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e81c1-a548-496a-ba3a-521c2396e3a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:10.882159 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e81c1-a548-496a-ba3a-521c2396e3a6 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:10.907353 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1275/2557] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 21:00:10 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 21:00:10.908693 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0f1ea-22c9-4550-a7e0-2743aab02b31 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:10.919670 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0f1ea-22c9-4550-a7e0-2743aab02b31 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:10.926427 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56ed79-0090-4926-9fb9-cb5b002e9921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:10.927211 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56ed79-0090-4926-9fb9-cb5b002e9921 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:10.927529 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56ed79-0090-4926-9fb9-cb5b002e9921 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:10.927932 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56ed79-0090-4926-9fb9-cb5b002e9921 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:10.928721 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b56ed79-0090-4926-9fb9-cb5b002e9921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:10.930506 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b56ed79-0090-4926-9fb9-cb5b002e9921 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:10.942487 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1283/2558] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:00:10.946779 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e81c1-a548-496a-ba3a-521c2396e3a6 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:10.958862 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e81c1-a548-496a-ba3a-521c2396e3a6 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:10.965687 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c5f71-0723-4e82-a7a9-cc9b06f1c914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:10.966562 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c5f71-0723-4e82-a7a9-cc9b06f1c914 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:10.967035 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c5f71-0723-4e82-a7a9-cc9b06f1c914 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:10.967306 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c5f71-0723-4e82-a7a9-cc9b06f1c914 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:10.968572 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c5f71-0723-4e82-a7a9-cc9b06f1c914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:10.970198 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c5f71-0723-4e82-a7a9-cc9b06f1c914 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:10.980657 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1276/2559] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:00:10.985770 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56ed79-0090-4926-9fb9-cb5b002e9921 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:10.996288 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56ed79-0090-4926-9fb9-cb5b002e9921 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:11.002579 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9aca54-f93b-47ce-8c74-2450e248e4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:11.003471 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9aca54-f93b-47ce-8c74-2450e248e4a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:11.003824 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9aca54-f93b-47ce-8c74-2450e248e4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:11.004037 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9aca54-f93b-47ce-8c74-2450e248e4a7 admin admin] PATH_INFO: `/v3/projects/3394563fc3e8465c99ec388f45bc46b7/users/3301907b1caf43d9b7d9e4b80af98880/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:11.021602 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9aca54-f93b-47ce-8c74-2450e248e4a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3394563fc3e8465c99ec388f45bc46b7, user_id=3301907b1caf43d9b7d9e4b80af98880, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:11.024900 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9aca54-f93b-47ce-8c74-2450e248e4a7 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:11.039778 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1284/2560] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:00:10 2022] PUT /identity/v3/projects/3394563fc3e8465c99ec388f45bc46b7/users/3301907b1caf43d9b7d9e4b80af98880/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:11.052348 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5046fe4-7619-48e9-8791-085675b7b287 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:11.052348 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5046fe4-7619-48e9-8791-085675b7b287 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:11.052698 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5046fe4-7619-48e9-8791-085675b7b287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:11.081551 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-b5046fe4-7619-48e9-8791-085675b7b287 None None] MFA Rules not processed for user `3301907b1caf43d9b7d9e4b80af98880`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:11.082859 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-b5046fe4-7619-48e9-8791-085675b7b287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:11.158932 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1277/2561] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:00:11.163612 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9aca54-f93b-47ce-8c74-2450e248e4a7 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:11.232903 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9aca54-f93b-47ce-8c74-2450e248e4a7 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:11.237667 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694aa33-5a7d-4253-8f05-2aca838b431c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:11.238318 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694aa33-5a7d-4253-8f05-2aca838b431c admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:11.238599 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694aa33-5a7d-4253-8f05-2aca838b431c admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:11.238873 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694aa33-5a7d-4253-8f05-2aca838b431c admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:11.239613 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7694aa33-5a7d-4253-8f05-2aca838b431c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:11.241578 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7694aa33-5a7d-4253-8f05-2aca838b431c admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:11.269670 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1285/2562] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 21:00:11 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:00:11.273623 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5046fe4-7619-48e9-8791-085675b7b287 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:11.284867 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5046fe4-7619-48e9-8791-085675b7b287 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:11.339637 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd367e43-44b8-478c-96db-9c49e9909b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:11.340378 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd367e43-44b8-478c-96db-9c49e9909b36 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:11.340654 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd367e43-44b8-478c-96db-9c49e9909b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:11.340925 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd367e43-44b8-478c-96db-9c49e9909b36 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:11.341620 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd367e43-44b8-478c-96db-9c49e9909b36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:11.343682 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd367e43-44b8-478c-96db-9c49e9909b36 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:11.363921 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1278/2563] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 21:00:11 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 21:00:11.368928 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694aa33-5a7d-4253-8f05-2aca838b431c admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:11.381449 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694aa33-5a7d-4253-8f05-2aca838b431c admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:11.386314 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92b07f-ed7e-4ceb-b110-2da94918acdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:11.386960 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92b07f-ed7e-4ceb-b110-2da94918acdc admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:11.387234 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92b07f-ed7e-4ceb-b110-2da94918acdc admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:11.387501 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92b07f-ed7e-4ceb-b110-2da94918acdc admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:11.388255 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92b07f-ed7e-4ceb-b110-2da94918acdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:11.390648 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92b07f-ed7e-4ceb-b110-2da94918acdc admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:11.405011 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1286/2564] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:00:11.409092 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd367e43-44b8-478c-96db-9c49e9909b36 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:11.419098 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd367e43-44b8-478c-96db-9c49e9909b36 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:11.424491 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc0f9e-9862-4cd4-a1e9-fe08974053e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:11.425262 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc0f9e-9862-4cd4-a1e9-fe08974053e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:11.425659 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc0f9e-9862-4cd4-a1e9-fe08974053e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:11.425937 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc0f9e-9862-4cd4-a1e9-fe08974053e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:11.426857 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc0f9e-9862-4cd4-a1e9-fe08974053e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:11.428860 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc0f9e-9862-4cd4-a1e9-fe08974053e2 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:11.442132 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1279/2565] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:00:11.446520 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92b07f-ed7e-4ceb-b110-2da94918acdc admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:11.458009 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92b07f-ed7e-4ceb-b110-2da94918acdc admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:11.462957 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898a441-fac7-4d07-a51e-a14eb3fbbf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:11.464127 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898a441-fac7-4d07-a51e-a14eb3fbbf3b admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:11.464415 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898a441-fac7-4d07-a51e-a14eb3fbbf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:11.464690 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898a441-fac7-4d07-a51e-a14eb3fbbf3b admin admin] PATH_INFO: `/v3/projects/42740c275b7f4b5e8082d0e86256e157/users/4e76811a47c3439789661f07e92fdf8a/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:11.480741 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898a441-fac7-4d07-a51e-a14eb3fbbf3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=42740c275b7f4b5e8082d0e86256e157, user_id=4e76811a47c3439789661f07e92fdf8a, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:11.483680 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898a441-fac7-4d07-a51e-a14eb3fbbf3b admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:11.497459 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1287/2566] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:00:11 2022] PUT /identity/v3/projects/42740c275b7f4b5e8082d0e86256e157/users/4e76811a47c3439789661f07e92fdf8a/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:11.509190 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a1017-78be-4524-a5c0-6293ede273bf None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:11.509606 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a1017-78be-4524-a5c0-6293ede273bf None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:11.509782 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a1017-78be-4524-a5c0-6293ede273bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:11.538372 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-ab7a1017-78be-4524-a5c0-6293ede273bf None None] MFA Rules not processed for user `4e76811a47c3439789661f07e92fdf8a`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:11.539497 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-ab7a1017-78be-4524-a5c0-6293ede273bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:11.604640 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1280/2567] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 21:00:11.609383 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898a441-fac7-4d07-a51e-a14eb3fbbf3b admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:11.672769 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898a441-fac7-4d07-a51e-a14eb3fbbf3b admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:11.677718 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa29376-154e-45df-9314-c389e50bcf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:11.678417 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa29376-154e-45df-9314-c389e50bcf74 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:11.678695 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa29376-154e-45df-9314-c389e50bcf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:11.678899 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa29376-154e-45df-9314-c389e50bcf74 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:11.679978 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa29376-154e-45df-9314-c389e50bcf74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:11.682170 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa29376-154e-45df-9314-c389e50bcf74 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:11.715498 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1288/2568] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 21:00:11 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:00:11.716948 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a1017-78be-4524-a5c0-6293ede273bf None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:11.728776 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a1017-78be-4524-a5c0-6293ede273bf None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:11.802048 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811f141-e011-46e6-a2ac-ef818dfd5f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:11.802693 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811f141-e011-46e6-a2ac-ef818dfd5f13 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:11.802964 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811f141-e011-46e6-a2ac-ef818dfd5f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:11.803257 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811f141-e011-46e6-a2ac-ef818dfd5f13 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:11.803993 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e811f141-e011-46e6-a2ac-ef818dfd5f13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:11.806058 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e811f141-e011-46e6-a2ac-ef818dfd5f13 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:11.830385 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1281/2569] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 21:00:11 2022] POST /identity/v3/users => generated 295 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:00:11.835820 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa29376-154e-45df-9314-c389e50bcf74 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:11.847842 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa29376-154e-45df-9314-c389e50bcf74 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:11.853209 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0504d-be45-447d-9d1d-a8c16dcf3e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:11.854019 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0504d-be45-447d-9d1d-a8c16dcf3e1d admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:11.854301 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0504d-be45-447d-9d1d-a8c16dcf3e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:11.854571 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0504d-be45-447d-9d1d-a8c16dcf3e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:11.855296 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b0504d-be45-447d-9d1d-a8c16dcf3e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:11.856936 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b0504d-be45-447d-9d1d-a8c16dcf3e1d admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:11.869005 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1289/2570] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 21:00:11.873623 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811f141-e011-46e6-a2ac-ef818dfd5f13 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:11.890081 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811f141-e011-46e6-a2ac-ef818dfd5f13 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:11.895097 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f6294-5c31-4ecc-86c0-e0b8ed5ca041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:11.896006 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f6294-5c31-4ecc-86c0-e0b8ed5ca041 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:11.896282 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f6294-5c31-4ecc-86c0-e0b8ed5ca041 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:11.896549 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f6294-5c31-4ecc-86c0-e0b8ed5ca041 admin admin] PATH_INFO: `/v3/projects/0a510c5277cb46c8a1b0dec856d43769/users/9f7121c321b3450abef71237d25c0596/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:11.912709 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f6294-5c31-4ecc-86c0-e0b8ed5ca041 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a510c5277cb46c8a1b0dec856d43769, user_id=9f7121c321b3450abef71237d25c0596, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:11.915417 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f6294-5c31-4ecc-86c0-e0b8ed5ca041 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:11.935688 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1282/2571] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:00:11 2022] PUT /identity/v3/projects/0a510c5277cb46c8a1b0dec856d43769/users/9f7121c321b3450abef71237d25c0596/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:11.942826 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0504d-be45-447d-9d1d-a8c16dcf3e1d admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:11.953488 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0504d-be45-447d-9d1d-a8c16dcf3e1d admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:12.023527 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09fe12-2d7f-4186-a404-bf9b0b0a3f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:12.024245 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09fe12-2d7f-4186-a404-bf9b0b0a3f33 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:12.024529 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09fe12-2d7f-4186-a404-bf9b0b0a3f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:12.024807 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09fe12-2d7f-4186-a404-bf9b0b0a3f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:12.025536 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed09fe12-2d7f-4186-a404-bf9b0b0a3f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:12.027157 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed09fe12-2d7f-4186-a404-bf9b0b0a3f33 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:12.039064 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1290/2572] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:00:12.043877 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f6294-5c31-4ecc-86c0-e0b8ed5ca041 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:12.055283 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f6294-5c31-4ecc-86c0-e0b8ed5ca041 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:12.059929 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b1f71-0259-4d89-a7af-0e64b5bbbc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:12.060813 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b1f71-0259-4d89-a7af-0e64b5bbbc16 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:12.061275 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b1f71-0259-4d89-a7af-0e64b5bbbc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:12.061568 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b1f71-0259-4d89-a7af-0e64b5bbbc16 admin admin] PATH_INFO: `/v3/projects/0a510c5277cb46c8a1b0dec856d43769/users/9f7121c321b3450abef71237d25c0596/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:12.063958 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b1f71-0259-4d89-a7af-0e64b5bbbc16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a510c5277cb46c8a1b0dec856d43769, user_id=9f7121c321b3450abef71237d25c0596, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:12.066697 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b1f71-0259-4d89-a7af-0e64b5bbbc16 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:12.079304 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1283/2573] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:00:12 2022] PUT /identity/v3/projects/0a510c5277cb46c8a1b0dec856d43769/users/9f7121c321b3450abef71237d25c0596/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 21:00:12.090107 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393ca6f-340b-43d4-8d27-869e09e03e0a None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:12.090487 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393ca6f-340b-43d4-8d27-869e09e03e0a None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:12.090852 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393ca6f-340b-43d4-8d27-869e09e03e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:12.122630 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-9393ca6f-340b-43d4-8d27-869e09e03e0a None None] MFA Rules not processed for user `9f7121c321b3450abef71237d25c0596`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:12.124363 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-9393ca6f-340b-43d4-8d27-869e09e03e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:12.202288 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1291/2574] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:00:12.214301 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b1f71-0259-4d89-a7af-0e64b5bbbc16 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:12.216043 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-131b1f71-0259-4d89-a7af-0e64b5bbbc16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:12.287557 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b1f71-0259-4d89-a7af-0e64b5bbbc16 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:12.291355 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ed6f0-8b86-4c8f-b3e1-eadae3ea32b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:12.292060 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ed6f0-8b86-4c8f-b3e1-eadae3ea32b8 service cinder] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:12.292337 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ed6f0-8b86-4c8f-b3e1-eadae3ea32b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:12.292612 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ed6f0-8b86-4c8f-b3e1-eadae3ea32b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:12.303764 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ed6f0-8b86-4c8f-b3e1-eadae3ea32b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:12.305560 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ed6f0-8b86-4c8f-b3e1-eadae3ea32b8 service cinder] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:12.317619 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1284/2575] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:00:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:00:12.371623 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393ca6f-340b-43d4-8d27-869e09e03e0a None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:12.381995 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393ca6f-340b-43d4-8d27-869e09e03e0a None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:12.385956 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7f879-0c7f-46ce-b19d-be615fefce16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:12.386621 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7f879-0c7f-46ce-b19d-be615fefce16 service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:12.387542 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7f879-0c7f-46ce-b19d-be615fefce16 service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:12.387542 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7f879-0c7f-46ce-b19d-be615fefce16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:12.421953 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ed6f0-8b86-4c8f-b3e1-eadae3ea32b8 service cinder] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:12.423492 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-018ed6f0-8b86-4c8f-b3e1-eadae3ea32b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:12.477899 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7f879-0c7f-46ce-b19d-be615fefce16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:12.480068 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7f879-0c7f-46ce-b19d-be615fefce16 service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:12.492111 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1292/2576] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:00:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:00:12.503661 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ed6f0-8b86-4c8f-b3e1-eadae3ea32b8 service cinder] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:12.509607 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718d8ce-d685-451f-aa56-847a952d7214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:12.511195 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718d8ce-d685-451f-aa56-847a952d7214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:12.512182 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718d8ce-d685-451f-aa56-847a952d7214 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:12.512456 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718d8ce-d685-451f-aa56-847a952d7214 admin admin] PATH_INFO: `/v3/users/7f79d047d8814ff1b83cd2d40778bb35` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:12.513816 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4718d8ce-d685-451f-aa56-847a952d7214 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f79d047d8814ff1b83cd2d40778bb35)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:12.516520 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4718d8ce-d685-451f-aa56-847a952d7214 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:12.572375 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-4718d8ce-d685-451f-aa56-847a952d7214 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f79d047d8814ff1b83cd2d40778bb35'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:12.580736 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-4718d8ce-d685-451f-aa56-847a952d7214 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f79d047d8814ff1b83cd2d40778bb35'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:12.581635 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-4718d8ce-d685-451f-aa56-847a952d7214 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f79d047d8814ff1b83cd2d40778bb35'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:12.598110 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-4718d8ce-d685-451f-aa56-847a952d7214 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f79d047d8814ff1b83cd2d40778bb35'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:12.599121 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-4718d8ce-d685-451f-aa56-847a952d7214 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f79d047d8814ff1b83cd2d40778bb35'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:12.614543 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1285/2577] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:00:12 2022] DELETE /identity/v3/users/7f79d047d8814ff1b83cd2d40778bb35 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 21:00:12.620112 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0159d-a5e2-4e2e-9dbd-d144c3daa021 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:12.620544 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0159d-a5e2-4e2e-9dbd-d144c3daa021 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:12.620955 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0159d-a5e2-4e2e-9dbd-d144c3daa021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:12.642483 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-6ae0159d-a5e2-4e2e-9dbd-d144c3daa021 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:12.643730 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-6ae0159d-a5e2-4e2e-9dbd-d144c3daa021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:12.725164 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1293/2578] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:00:12.741040 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718d8ce-d685-451f-aa56-847a952d7214 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:12.743274 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-4718d8ce-d685-451f-aa56-847a952d7214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:12.834212 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718d8ce-d685-451f-aa56-847a952d7214 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:12.834212 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102836c7-3fe0-44c8-ae43-193aa07198c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:12.834212 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102836c7-3fe0-44c8-ae43-193aa07198c7 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:12.834212 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102836c7-3fe0-44c8-ae43-193aa07198c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:12.834583 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102836c7-3fe0-44c8-ae43-193aa07198c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:12.841927 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102836c7-3fe0-44c8-ae43-193aa07198c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:12.844668 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102836c7-3fe0-44c8-ae43-193aa07198c7 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:12.856396 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1286/2579] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:00:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:00:13.176163 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0159d-a5e2-4e2e-9dbd-d144c3daa021 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:13.177815 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-6ae0159d-a5e2-4e2e-9dbd-d144c3daa021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:13.194253 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0159d-a5e2-4e2e-9dbd-d144c3daa021 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:13.204631 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61048c81-b3bd-4c52-92ae-c2f4a352980a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:13.206169 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61048c81-b3bd-4c52-92ae-c2f4a352980a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:13.206668 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61048c81-b3bd-4c52-92ae-c2f4a352980a admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:13.207207 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61048c81-b3bd-4c52-92ae-c2f4a352980a admin admin] PATH_INFO: `/v3/projects/e8c01d41b49d4c669bbd9116d6bf4001` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:13.209542 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61048c81-b3bd-4c52-92ae-c2f4a352980a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8c01d41b49d4c669bbd9116d6bf4001)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:13.211949 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61048c81-b3bd-4c52-92ae-c2f4a352980a admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:13.266993 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-61048c81-b3bd-4c52-92ae-c2f4a352980a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8c01d41b49d4c669bbd9116d6bf4001', 'request_id': 'req-61048c81-b3bd-4c52-92ae-c2f4a352980a'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:13.274239 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-61048c81-b3bd-4c52-92ae-c2f4a352980a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8c01d41b49d4c669bbd9116d6bf4001', 'request_id': 'req-61048c81-b3bd-4c52-92ae-c2f4a352980a'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:13.284217 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-61048c81-b3bd-4c52-92ae-c2f4a352980a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8c01d41b49d4c669bbd9116d6bf4001', 'request_id': 'req-61048c81-b3bd-4c52-92ae-c2f4a352980a'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:13.296877 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-61048c81-b3bd-4c52-92ae-c2f4a352980a admin admin] The token cache is being invalidate because project e8c01d41b49d4c669bbd9116d6bf4001 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:00:13.297147 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-61048c81-b3bd-4c52-92ae-c2f4a352980a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:13.297806 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-61048c81-b3bd-4c52-92ae-c2f4a352980a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:13.299348 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1294/2580] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:00:13 2022] DELETE /identity/v3/projects/e8c01d41b49d4c669bbd9116d6bf4001 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:13.303503 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102836c7-3fe0-44c8-ae43-193aa07198c7 service neutron] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:13.314592 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102836c7-3fe0-44c8-ae43-193aa07198c7 service neutron] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:13.384090 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d936b1-8043-4e58-9a61-c59d2c00a80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:13.384979 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d936b1-8043-4e58-9a61-c59d2c00a80b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:13.385266 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d936b1-8043-4e58-9a61-c59d2c00a80b admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:13.385540 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d936b1-8043-4e58-9a61-c59d2c00a80b admin admin] PATH_INFO: `/v3/users/8e69c9bb8ba44fb6b8ef327d5443995a` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:13.386796 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d936b1-8043-4e58-9a61-c59d2c00a80b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e69c9bb8ba44fb6b8ef327d5443995a)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:13.388791 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d936b1-8043-4e58-9a61-c59d2c00a80b admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:13.448615 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-36d936b1-8043-4e58-9a61-c59d2c00a80b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e69c9bb8ba44fb6b8ef327d5443995a'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:13.456639 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-36d936b1-8043-4e58-9a61-c59d2c00a80b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e69c9bb8ba44fb6b8ef327d5443995a'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:13.457390 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-36d936b1-8043-4e58-9a61-c59d2c00a80b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e69c9bb8ba44fb6b8ef327d5443995a'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:13.470895 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-36d936b1-8043-4e58-9a61-c59d2c00a80b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e69c9bb8ba44fb6b8ef327d5443995a'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:13.471596 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-36d936b1-8043-4e58-9a61-c59d2c00a80b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e69c9bb8ba44fb6b8ef327d5443995a'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:13.487072 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1287/2581] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:00:13 2022] DELETE /identity/v3/users/8e69c9bb8ba44fb6b8ef327d5443995a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 21:00:13.823150 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61048c81-b3bd-4c52-92ae-c2f4a352980a admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:13.824821 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-61048c81-b3bd-4c52-92ae-c2f4a352980a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:13.844862 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61048c81-b3bd-4c52-92ae-c2f4a352980a admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:13.940508 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158f3f7-1a7b-4c7e-a231-00a4158b1f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:13.941484 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158f3f7-1a7b-4c7e-a231-00a4158b1f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:13.941773 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158f3f7-1a7b-4c7e-a231-00a4158b1f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:13.942181 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158f3f7-1a7b-4c7e-a231-00a4158b1f95 admin admin] PATH_INFO: `/v3/projects/f70133334d6c409b8b2f4dc6ce09fcd8` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:13.943947 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4158f3f7-1a7b-4c7e-a231-00a4158b1f95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f70133334d6c409b8b2f4dc6ce09fcd8)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:13.945952 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4158f3f7-1a7b-4c7e-a231-00a4158b1f95 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:14.009760 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-4158f3f7-1a7b-4c7e-a231-00a4158b1f95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f70133334d6c409b8b2f4dc6ce09fcd8', 'request_id': 'req-4158f3f7-1a7b-4c7e-a231-00a4158b1f95'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:14.016199 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-4158f3f7-1a7b-4c7e-a231-00a4158b1f95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f70133334d6c409b8b2f4dc6ce09fcd8', 'request_id': 'req-4158f3f7-1a7b-4c7e-a231-00a4158b1f95'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:14.024648 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-4158f3f7-1a7b-4c7e-a231-00a4158b1f95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f70133334d6c409b8b2f4dc6ce09fcd8', 'request_id': 'req-4158f3f7-1a7b-4c7e-a231-00a4158b1f95'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:14.037959 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-4158f3f7-1a7b-4c7e-a231-00a4158b1f95 admin admin] The token cache is being invalidate because project f70133334d6c409b8b2f4dc6ce09fcd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:00:14.038257 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-4158f3f7-1a7b-4c7e-a231-00a4158b1f95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:14.039256 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-4158f3f7-1a7b-4c7e-a231-00a4158b1f95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:14.041874 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1295/2582] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:00:13 2022] DELETE /identity/v3/projects/f70133334d6c409b8b2f4dc6ce09fcd8 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:14.049793 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb88252-0d09-4d53-a7a3-c614ad6f6aa0 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:14.049972 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb88252-0d09-4d53-a7a3-c614ad6f6aa0 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:14.050501 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb88252-0d09-4d53-a7a3-c614ad6f6aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:14.077801 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-acb88252-0d09-4d53-a7a3-c614ad6f6aa0 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:14.079291 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-acb88252-0d09-4d53-a7a3-c614ad6f6aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:14.154522 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1288/2583] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:00:14.164188 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c06d8-f740-4fb3-8d69-e5a1523d53e2 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:14.164533 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c06d8-f740-4fb3-8d69-e5a1523d53e2 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:14.164858 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c06d8-f740-4fb3-8d69-e5a1523d53e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:14.185281 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-8c0c06d8-f740-4fb3-8d69-e5a1523d53e2 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:14.186822 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-8c0c06d8-f740-4fb3-8d69-e5a1523d53e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:14.198894 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1296/2584] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 21:00:14.200298 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb88252-0d09-4d53-a7a3-c614ad6f6aa0 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:14.210884 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb88252-0d09-4d53-a7a3-c614ad6f6aa0 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:14.215487 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b9167-e65f-406f-9065-38e6c3ca0882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:14.216197 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b9167-e65f-406f-9065-38e6c3ca0882 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:14.216462 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b9167-e65f-406f-9065-38e6c3ca0882 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:14.216735 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b9167-e65f-406f-9065-38e6c3ca0882 admin admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:14.219777 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b9167-e65f-406f-9065-38e6c3ca0882 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 21:00:14.219777 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b9167-e65f-406f-9065-38e6c3ca0882 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:14.220295 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b9167-e65f-406f-9065-38e6c3ca0882 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:14.234222 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1289/2585] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 21:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 21:00:14.238756 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c06d8-f740-4fb3-8d69-e5a1523d53e2 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:14.249703 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c06d8-f740-4fb3-8d69-e5a1523d53e2 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:14.259624 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd352e-44cd-4d0b-a2d8-28c7e768c0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:14.260327 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd352e-44cd-4d0b-a2d8-28c7e768c0a6 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:14.260672 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd352e-44cd-4d0b-a2d8-28c7e768c0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:14.260949 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd352e-44cd-4d0b-a2d8-28c7e768c0a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:14.261650 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bd352e-44cd-4d0b-a2d8-28c7e768c0a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:14.263543 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bd352e-44cd-4d0b-a2d8-28c7e768c0a6 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:14.295896 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1297/2586] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 21:00:14 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:00:14.299899 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b9167-e65f-406f-9065-38e6c3ca0882 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:14.312569 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b9167-e65f-406f-9065-38e6c3ca0882 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:14.382325 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245eef58-30ae-4fde-b9e9-932e27f33e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:14.383148 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245eef58-30ae-4fde-b9e9-932e27f33e64 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:14.383440 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245eef58-30ae-4fde-b9e9-932e27f33e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:14.383715 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245eef58-30ae-4fde-b9e9-932e27f33e64 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:14.384443 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245eef58-30ae-4fde-b9e9-932e27f33e64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:14.386526 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245eef58-30ae-4fde-b9e9-932e27f33e64 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:14.412994 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1290/2587] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 21:00:14 2022] POST /identity/v3/users => generated 290 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:00:14.417343 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd352e-44cd-4d0b-a2d8-28c7e768c0a6 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:14.429480 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd352e-44cd-4d0b-a2d8-28c7e768c0a6 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:14.436800 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a49144-fb45-4828-80a5-f418d458762c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:14.437586 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a49144-fb45-4828-80a5-f418d458762c admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:14.437920 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a49144-fb45-4828-80a5-f418d458762c admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:14.438201 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a49144-fb45-4828-80a5-f418d458762c admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:14.438967 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a49144-fb45-4828-80a5-f418d458762c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:14.440699 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a49144-fb45-4828-80a5-f418d458762c admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:14.454405 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1298/2588] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:00:14.459262 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245eef58-30ae-4fde-b9e9-932e27f33e64 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:14.473372 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245eef58-30ae-4fde-b9e9-932e27f33e64 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:14.478683 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110892ae-2dec-4870-9e19-84f93e83f205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:14.479586 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110892ae-2dec-4870-9e19-84f93e83f205 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:14.480081 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110892ae-2dec-4870-9e19-84f93e83f205 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:14.480353 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110892ae-2dec-4870-9e19-84f93e83f205 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:14.481121 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110892ae-2dec-4870-9e19-84f93e83f205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:14.483925 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110892ae-2dec-4870-9e19-84f93e83f205 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:14.493566 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1291/2589] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:00:14.498043 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a49144-fb45-4828-80a5-f418d458762c admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:14.509773 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a49144-fb45-4828-80a5-f418d458762c admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:14.515330 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646739c-b5a0-4f7b-8d38-e96a24143f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:14.516306 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646739c-b5a0-4f7b-8d38-e96a24143f2b admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:14.516695 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646739c-b5a0-4f7b-8d38-e96a24143f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:14.516968 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646739c-b5a0-4f7b-8d38-e96a24143f2b admin admin] PATH_INFO: `/v3/projects/0514b3696b0e42be855e67bfa2d5d43e/users/37670b7d636b458cbd065c11d8bcd81c/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:14.533082 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8646739c-b5a0-4f7b-8d38-e96a24143f2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0514b3696b0e42be855e67bfa2d5d43e, user_id=37670b7d636b458cbd065c11d8bcd81c, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:14.535769 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8646739c-b5a0-4f7b-8d38-e96a24143f2b admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:14.554881 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1299/2590] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:00:14 2022] PUT /identity/v3/projects/0514b3696b0e42be855e67bfa2d5d43e/users/37670b7d636b458cbd065c11d8bcd81c/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:14.567127 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ea360-1a0c-473b-b8e4-c77fb6ee98ba None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:14.567567 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ea360-1a0c-473b-b8e4-c77fb6ee98ba None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:14.567995 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ea360-1a0c-473b-b8e4-c77fb6ee98ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:14.598865 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-ee3ea360-1a0c-473b-b8e4-c77fb6ee98ba None None] MFA Rules not processed for user `37670b7d636b458cbd065c11d8bcd81c`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:14.600101 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-ee3ea360-1a0c-473b-b8e4-c77fb6ee98ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:14.682325 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1292/2591] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:00:14.684109 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646739c-b5a0-4f7b-8d38-e96a24143f2b admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:14.752877 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646739c-b5a0-4f7b-8d38-e96a24143f2b admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:14.760334 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2af2e-cbac-4769-8015-4d7784377b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:14.761113 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2af2e-cbac-4769-8015-4d7784377b99 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:14.761398 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2af2e-cbac-4769-8015-4d7784377b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:14.761700 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2af2e-cbac-4769-8015-4d7784377b99 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:14.762404 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2af2e-cbac-4769-8015-4d7784377b99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:14.764588 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2af2e-cbac-4769-8015-4d7784377b99 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:14.796097 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1300/2592] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 21:00:14 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:00:14.797623 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ea360-1a0c-473b-b8e4-c77fb6ee98ba None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:14.809242 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ea360-1a0c-473b-b8e4-c77fb6ee98ba None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:14.876127 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eea18d-56e0-4d14-a909-c4831eccdec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:14.876787 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eea18d-56e0-4d14-a909-c4831eccdec5 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:14.877113 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eea18d-56e0-4d14-a909-c4831eccdec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:14.877326 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eea18d-56e0-4d14-a909-c4831eccdec5 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:14.878026 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eea18d-56e0-4d14-a909-c4831eccdec5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:14.880077 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eea18d-56e0-4d14-a909-c4831eccdec5 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:14.909290 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1293/2593] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 21:00:14 2022] POST /identity/v3/users => generated 297 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:00:14.913343 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2af2e-cbac-4769-8015-4d7784377b99 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:14.925576 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2af2e-cbac-4769-8015-4d7784377b99 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:14.933726 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab3551-aff6-448a-aed6-dd0fcc717554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:14.934561 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab3551-aff6-448a-aed6-dd0fcc717554 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:14.934854 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab3551-aff6-448a-aed6-dd0fcc717554 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:14.935129 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab3551-aff6-448a-aed6-dd0fcc717554 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:14.937661 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab3551-aff6-448a-aed6-dd0fcc717554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:14.940132 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab3551-aff6-448a-aed6-dd0fcc717554 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:14.953422 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1301/2594] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 21:00:14.959199 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eea18d-56e0-4d14-a909-c4831eccdec5 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:14.971029 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eea18d-56e0-4d14-a909-c4831eccdec5 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:14.976283 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e720d2f-d978-46c1-9cbf-842d13e8cc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:14.977191 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e720d2f-d978-46c1-9cbf-842d13e8cc77 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:14.977467 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e720d2f-d978-46c1-9cbf-842d13e8cc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:14.977739 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e720d2f-d978-46c1-9cbf-842d13e8cc77 admin admin] PATH_INFO: `/v3/projects/e64450bba92d4983854714c125873858/users/3700d69f37454e2786053c981c451450/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:14.996846 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e720d2f-d978-46c1-9cbf-842d13e8cc77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e64450bba92d4983854714c125873858, user_id=3700d69f37454e2786053c981c451450, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:15.000301 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e720d2f-d978-46c1-9cbf-842d13e8cc77 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:15.020463 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1294/2595] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:00:14 2022] PUT /identity/v3/projects/e64450bba92d4983854714c125873858/users/3700d69f37454e2786053c981c451450/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 21:00:15.024711 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab3551-aff6-448a-aed6-dd0fcc717554 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:15.035844 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab3551-aff6-448a-aed6-dd0fcc717554 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:15.107794 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065c1ec-95c1-4f1c-b46a-79b45d3f0356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:15.109703 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065c1ec-95c1-4f1c-b46a-79b45d3f0356 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:15.109703 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065c1ec-95c1-4f1c-b46a-79b45d3f0356 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:15.109938 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065c1ec-95c1-4f1c-b46a-79b45d3f0356 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:15.110626 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065c1ec-95c1-4f1c-b46a-79b45d3f0356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:15.112254 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065c1ec-95c1-4f1c-b46a-79b45d3f0356 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:15.122653 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1302/2596] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 21:00:15.127312 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e720d2f-d978-46c1-9cbf-842d13e8cc77 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:15.138156 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e720d2f-d978-46c1-9cbf-842d13e8cc77 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:15.143073 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c4a4d-d9c6-45e6-b3e5-c7af5f306513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:15.144240 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c4a4d-d9c6-45e6-b3e5-c7af5f306513 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:15.144529 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c4a4d-d9c6-45e6-b3e5-c7af5f306513 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:15.144803 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c4a4d-d9c6-45e6-b3e5-c7af5f306513 admin admin] PATH_INFO: `/v3/projects/e64450bba92d4983854714c125873858/users/3700d69f37454e2786053c981c451450/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:15.146809 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c4a4d-d9c6-45e6-b3e5-c7af5f306513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e64450bba92d4983854714c125873858, user_id=3700d69f37454e2786053c981c451450, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:15.149659 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c4a4d-d9c6-45e6-b3e5-c7af5f306513 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:15.164351 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1295/2597] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:00:15 2022] PUT /identity/v3/projects/e64450bba92d4983854714c125873858/users/3700d69f37454e2786053c981c451450/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:15.176875 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07449629-82dc-4cd5-8cb2-1aec12dc4522 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:15.177163 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07449629-82dc-4cd5-8cb2-1aec12dc4522 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:15.177437 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07449629-82dc-4cd5-8cb2-1aec12dc4522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:15.205264 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-07449629-82dc-4cd5-8cb2-1aec12dc4522 None None] MFA Rules not processed for user `3700d69f37454e2786053c981c451450`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:15.206632 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-07449629-82dc-4cd5-8cb2-1aec12dc4522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:15.278381 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1303/2598] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:00:15.290733 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c4a4d-d9c6-45e6-b3e5-c7af5f306513 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:15.292883 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-fa0c4a4d-d9c6-45e6-b3e5-c7af5f306513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:15.359468 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c4a4d-d9c6-45e6-b3e5-c7af5f306513 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:15.363365 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4b60e-ee17-4922-b9a1-406302b48439 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:15.364082 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4b60e-ee17-4922-b9a1-406302b48439 service cinder] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:15.366357 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4b60e-ee17-4922-b9a1-406302b48439 service cinder] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:15.366357 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4b60e-ee17-4922-b9a1-406302b48439 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:15.375048 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4b60e-ee17-4922-b9a1-406302b48439 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:15.376275 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4b60e-ee17-4922-b9a1-406302b48439 service cinder] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:15.386951 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1296/2599] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:00:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:00:15.646538 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07449629-82dc-4cd5-8cb2-1aec12dc4522 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:15.648303 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-07449629-82dc-4cd5-8cb2-1aec12dc4522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:15.744103 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07449629-82dc-4cd5-8cb2-1aec12dc4522 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:15.750623 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02122bea-acfe-4147-9a70-80378f88de46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:15.751871 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02122bea-acfe-4147-9a70-80378f88de46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:15.752485 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02122bea-acfe-4147-9a70-80378f88de46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:15.752919 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02122bea-acfe-4147-9a70-80378f88de46 admin admin] PATH_INFO: `/v3/users/3301907b1caf43d9b7d9e4b80af98880` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:15.755384 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02122bea-acfe-4147-9a70-80378f88de46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3301907b1caf43d9b7d9e4b80af98880)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:15.759614 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02122bea-acfe-4147-9a70-80378f88de46 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:15.828333 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-02122bea-acfe-4147-9a70-80378f88de46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3301907b1caf43d9b7d9e4b80af98880'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:15.836923 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-02122bea-acfe-4147-9a70-80378f88de46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3301907b1caf43d9b7d9e4b80af98880'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:15.851079 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-02122bea-acfe-4147-9a70-80378f88de46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3301907b1caf43d9b7d9e4b80af98880'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:15.851770 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-02122bea-acfe-4147-9a70-80378f88de46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3301907b1caf43d9b7d9e4b80af98880'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:15.868682 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-02122bea-acfe-4147-9a70-80378f88de46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3301907b1caf43d9b7d9e4b80af98880'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:15.876354 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4b60e-ee17-4922-b9a1-406302b48439 service cinder] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:15.878000 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1304/2600] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:00:15 2022] DELETE /identity/v3/users/3301907b1caf43d9b7d9e4b80af98880 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:15.883508 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbb7a1-3b4e-4e9e-b9a9-ccee1e920049 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:15.883847 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbb7a1-3b4e-4e9e-b9a9-ccee1e920049 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:15.884179 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbb7a1-3b4e-4e9e-b9a9-ccee1e920049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:15.896069 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4b60e-ee17-4922-b9a1-406302b48439 service cinder] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:15.904624 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-74cbb7a1-3b4e-4e9e-b9a9-ccee1e920049 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:15.906405 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-74cbb7a1-3b4e-4e9e-b9a9-ccee1e920049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:15.974247 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1305/2601] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 21:00:15.986102 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbb7a1-3b4e-4e9e-b9a9-ccee1e920049 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:15.989959 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-74cbb7a1-3b4e-4e9e-b9a9-ccee1e920049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:15.993178 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab385d-977f-4d0c-8474-52e49e6ae31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:15.994076 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab385d-977f-4d0c-8474-52e49e6ae31b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:15.994354 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab385d-977f-4d0c-8474-52e49e6ae31b admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:15.994666 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab385d-977f-4d0c-8474-52e49e6ae31b admin admin] PATH_INFO: `/v3/users/37670b7d636b458cbd065c11d8bcd81c` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:15.995957 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab385d-977f-4d0c-8474-52e49e6ae31b admin admin] RBAC: Authorizing `identity:delete_user(user_id=37670b7d636b458cbd065c11d8bcd81c)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:15.997961 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab385d-977f-4d0c-8474-52e49e6ae31b admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:16.074935 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-bdab385d-977f-4d0c-8474-52e49e6ae31b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37670b7d636b458cbd065c11d8bcd81c'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:16.079495 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbb7a1-3b4e-4e9e-b9a9-ccee1e920049 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:16.083371 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40759292-95e5-4440-a763-2d85d8d4a94a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:16.084056 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40759292-95e5-4440-a763-2d85d8d4a94a service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:16.084316 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40759292-95e5-4440-a763-2d85d8d4a94a service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:16.084472 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-bdab385d-977f-4d0c-8474-52e49e6ae31b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37670b7d636b458cbd065c11d8bcd81c'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:16.084619 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40759292-95e5-4440-a763-2d85d8d4a94a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:16.085366 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-bdab385d-977f-4d0c-8474-52e49e6ae31b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37670b7d636b458cbd065c11d8bcd81c'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:16.086754 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-40759292-95e5-4440-a763-2d85d8d4a94a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:16.100018 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40759292-95e5-4440-a763-2d85d8d4a94a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:16.100410 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-bdab385d-977f-4d0c-8474-52e49e6ae31b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37670b7d636b458cbd065c11d8bcd81c'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:16.101508 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40759292-95e5-4440-a763-2d85d8d4a94a service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:16.102816 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-bdab385d-977f-4d0c-8474-52e49e6ae31b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37670b7d636b458cbd065c11d8bcd81c'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:16.112616 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1306/2602] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:00:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:00:16.119647 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1297/2603] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:00:15 2022] DELETE /identity/v3/users/37670b7d636b458cbd065c11d8bcd81c => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 21:00:16.126165 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fa89b-f5f1-4b54-bdc7-f724f66fa462 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:16.126671 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fa89b-f5f1-4b54-bdc7-f724f66fa462 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:16.127161 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fa89b-f5f1-4b54-bdc7-f724f66fa462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:16.159823 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-ad6fa89b-f5f1-4b54-bdc7-f724f66fa462 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:16.161867 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-ad6fa89b-f5f1-4b54-bdc7-f724f66fa462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:16.261887 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1307/2604] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 21:00:16.274722 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab385d-977f-4d0c-8474-52e49e6ae31b admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:16.282747 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-bdab385d-977f-4d0c-8474-52e49e6ae31b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:16.361894 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab385d-977f-4d0c-8474-52e49e6ae31b admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:16.366145 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa24d69-bb39-457d-8042-77abfcc238c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:16.366960 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa24d69-bb39-457d-8042-77abfcc238c5 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:16.367392 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa24d69-bb39-457d-8042-77abfcc238c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:16.367693 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa24d69-bb39-457d-8042-77abfcc238c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:16.379885 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa24d69-bb39-457d-8042-77abfcc238c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:16.381445 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa24d69-bb39-457d-8042-77abfcc238c5 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:16.393345 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1298/2605] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:00:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 21:00:16.493005 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6fa89b-f5f1-4b54-bdc7-f724f66fa462 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:16.495638 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-ad6fa89b-f5f1-4b54-bdc7-f724f66fa462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:16.510681 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6fa89b-f5f1-4b54-bdc7-f724f66fa462 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:16.516271 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d6f83-6810-4c86-9c9d-f05b6d35e64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:16.517303 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d6f83-6810-4c86-9c9d-f05b6d35e64b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:16.517578 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d6f83-6810-4c86-9c9d-f05b6d35e64b admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:16.517848 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d6f83-6810-4c86-9c9d-f05b6d35e64b admin admin] PATH_INFO: `/v3/projects/3394563fc3e8465c99ec388f45bc46b7` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:16.519347 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d6f83-6810-4c86-9c9d-f05b6d35e64b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3394563fc3e8465c99ec388f45bc46b7)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:16.521371 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d6f83-6810-4c86-9c9d-f05b6d35e64b admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:16.571534 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-136d6f83-6810-4c86-9c9d-f05b6d35e64b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3394563fc3e8465c99ec388f45bc46b7', 'request_id': 'req-136d6f83-6810-4c86-9c9d-f05b6d35e64b'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:16.577530 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-136d6f83-6810-4c86-9c9d-f05b6d35e64b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3394563fc3e8465c99ec388f45bc46b7', 'request_id': 'req-136d6f83-6810-4c86-9c9d-f05b6d35e64b'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:16.588025 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-136d6f83-6810-4c86-9c9d-f05b6d35e64b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3394563fc3e8465c99ec388f45bc46b7', 'request_id': 'req-136d6f83-6810-4c86-9c9d-f05b6d35e64b'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:16.602954 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-136d6f83-6810-4c86-9c9d-f05b6d35e64b admin admin] The token cache is being invalidate because project 3394563fc3e8465c99ec388f45bc46b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:00:16.603368 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-136d6f83-6810-4c86-9c9d-f05b6d35e64b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:16.604047 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-136d6f83-6810-4c86-9c9d-f05b6d35e64b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:16.605794 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1308/2606] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:00:16 2022] DELETE /identity/v3/projects/3394563fc3e8465c99ec388f45bc46b7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:16.610273 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa24d69-bb39-457d-8042-77abfcc238c5 service neutron] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:16.620868 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa24d69-bb39-457d-8042-77abfcc238c5 service neutron] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:16.686689 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11830a75-5d68-484d-8055-096df2a3ee53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:16.687584 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11830a75-5d68-484d-8055-096df2a3ee53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:16.687892 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11830a75-5d68-484d-8055-096df2a3ee53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:16.688163 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11830a75-5d68-484d-8055-096df2a3ee53 admin admin] PATH_INFO: `/v3/users/4e76811a47c3439789661f07e92fdf8a` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:16.689395 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11830a75-5d68-484d-8055-096df2a3ee53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e76811a47c3439789661f07e92fdf8a)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:16.691329 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11830a75-5d68-484d-8055-096df2a3ee53 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:16.736126 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d6f83-6810-4c86-9c9d-f05b6d35e64b admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:16.737680 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-136d6f83-6810-4c86-9c9d-f05b6d35e64b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:16.756091 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d6f83-6810-4c86-9c9d-f05b6d35e64b admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:16.766327 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f693660-e7ab-4b96-825e-415e967ea918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:16.767384 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f693660-e7ab-4b96-825e-415e967ea918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:16.767947 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f693660-e7ab-4b96-825e-415e967ea918 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:16.768318 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f693660-e7ab-4b96-825e-415e967ea918 admin admin] PATH_INFO: `/v3/projects/0514b3696b0e42be855e67bfa2d5d43e` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:16.770735 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f693660-e7ab-4b96-825e-415e967ea918 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0514b3696b0e42be855e67bfa2d5d43e)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:16.773236 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f693660-e7ab-4b96-825e-415e967ea918 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:16.777935 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-11830a75-5d68-484d-8055-096df2a3ee53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e76811a47c3439789661f07e92fdf8a'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:16.786543 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-11830a75-5d68-484d-8055-096df2a3ee53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e76811a47c3439789661f07e92fdf8a'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:16.788370 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-11830a75-5d68-484d-8055-096df2a3ee53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e76811a47c3439789661f07e92fdf8a'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:16.803196 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-11830a75-5d68-484d-8055-096df2a3ee53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e76811a47c3439789661f07e92fdf8a'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:16.804006 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-11830a75-5d68-484d-8055-096df2a3ee53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e76811a47c3439789661f07e92fdf8a'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:16.819770 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1299/2607] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:00:16 2022] DELETE /identity/v3/users/4e76811a47c3439789661f07e92fdf8a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:16.843807 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-3f693660-e7ab-4b96-825e-415e967ea918 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0514b3696b0e42be855e67bfa2d5d43e', 'request_id': 'req-3f693660-e7ab-4b96-825e-415e967ea918'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:16.849585 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-3f693660-e7ab-4b96-825e-415e967ea918 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0514b3696b0e42be855e67bfa2d5d43e', 'request_id': 'req-3f693660-e7ab-4b96-825e-415e967ea918'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:16.860024 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-3f693660-e7ab-4b96-825e-415e967ea918 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0514b3696b0e42be855e67bfa2d5d43e', 'request_id': 'req-3f693660-e7ab-4b96-825e-415e967ea918'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:16.876607 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-3f693660-e7ab-4b96-825e-415e967ea918 admin admin] The token cache is being invalidate because project 0514b3696b0e42be855e67bfa2d5d43e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:00:16.876607 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-3f693660-e7ab-4b96-825e-415e967ea918 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:16.877495 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-3f693660-e7ab-4b96-825e-415e967ea918 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:16.879028 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1309/2608] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:00:16 2022] DELETE /identity/v3/projects/0514b3696b0e42be855e67bfa2d5d43e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:16.883126 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11830a75-5d68-484d-8055-096df2a3ee53 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:16.885828 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-11830a75-5d68-484d-8055-096df2a3ee53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:16.979500 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11830a75-5d68-484d-8055-096df2a3ee53 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:17.089058 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d46d77-03e2-4a60-b92d-6e69334c2f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:17.090064 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d46d77-03e2-4a60-b92d-6e69334c2f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:17.090419 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d46d77-03e2-4a60-b92d-6e69334c2f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:17.090698 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d46d77-03e2-4a60-b92d-6e69334c2f70 admin admin] PATH_INFO: `/v3/users/3700d69f37454e2786053c981c451450` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:17.093193 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d46d77-03e2-4a60-b92d-6e69334c2f70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3700d69f37454e2786053c981c451450)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:17.096110 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d46d77-03e2-4a60-b92d-6e69334c2f70 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:17.144578 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f693660-e7ab-4b96-825e-415e967ea918 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:17.146219 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-3f693660-e7ab-4b96-825e-415e967ea918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:17.149160 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-66d46d77-03e2-4a60-b92d-6e69334c2f70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3700d69f37454e2786053c981c451450'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:17.158471 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-66d46d77-03e2-4a60-b92d-6e69334c2f70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3700d69f37454e2786053c981c451450'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:17.159241 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-66d46d77-03e2-4a60-b92d-6e69334c2f70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3700d69f37454e2786053c981c451450'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:17.175100 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-66d46d77-03e2-4a60-b92d-6e69334c2f70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3700d69f37454e2786053c981c451450'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:17.175225 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f693660-e7ab-4b96-825e-415e967ea918 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:17.176172 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-66d46d77-03e2-4a60-b92d-6e69334c2f70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3700d69f37454e2786053c981c451450'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:17.179953 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc0bd7-408e-4669-94fd-ec347b44ce21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:17.181215 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc0bd7-408e-4669-94fd-ec347b44ce21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:17.181986 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc0bd7-408e-4669-94fd-ec347b44ce21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:17.182381 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc0bd7-408e-4669-94fd-ec347b44ce21 admin admin] PATH_INFO: `/v3/projects/42740c275b7f4b5e8082d0e86256e157` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:17.184361 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc0bd7-408e-4669-94fd-ec347b44ce21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42740c275b7f4b5e8082d0e86256e157)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:17.190068 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc0bd7-408e-4669-94fd-ec347b44ce21 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:17.193054 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1300/2609] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:00:16 2022] DELETE /identity/v3/users/3700d69f37454e2786053c981c451450 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:17.256117 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-1dcc0bd7-408e-4669-94fd-ec347b44ce21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42740c275b7f4b5e8082d0e86256e157', 'request_id': 'req-1dcc0bd7-408e-4669-94fd-ec347b44ce21'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:17.265756 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-1dcc0bd7-408e-4669-94fd-ec347b44ce21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42740c275b7f4b5e8082d0e86256e157', 'request_id': 'req-1dcc0bd7-408e-4669-94fd-ec347b44ce21'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:17.277187 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-1dcc0bd7-408e-4669-94fd-ec347b44ce21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42740c275b7f4b5e8082d0e86256e157', 'request_id': 'req-1dcc0bd7-408e-4669-94fd-ec347b44ce21'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:17.292753 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-1dcc0bd7-408e-4669-94fd-ec347b44ce21 admin admin] The token cache is being invalidate because project 42740c275b7f4b5e8082d0e86256e157 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:00:17.293185 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-1dcc0bd7-408e-4669-94fd-ec347b44ce21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:17.294033 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-1dcc0bd7-408e-4669-94fd-ec347b44ce21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:17.297159 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1310/2610] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:00:17 2022] DELETE /identity/v3/projects/42740c275b7f4b5e8082d0e86256e157 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 21:00:17.301100 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d46d77-03e2-4a60-b92d-6e69334c2f70 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:17.302853 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-66d46d77-03e2-4a60-b92d-6e69334c2f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:17.401603 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d46d77-03e2-4a60-b92d-6e69334c2f70 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:17.466319 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4d37b-1ef9-45cb-9b29-a1312b1356e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:17.467843 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4d37b-1ef9-45cb-9b29-a1312b1356e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:17.468128 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4d37b-1ef9-45cb-9b29-a1312b1356e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:17.468404 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4d37b-1ef9-45cb-9b29-a1312b1356e7 admin admin] PATH_INFO: `/v3/users/9f7121c321b3450abef71237d25c0596` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:17.469784 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4d37b-1ef9-45cb-9b29-a1312b1356e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f7121c321b3450abef71237d25c0596)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:17.471832 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4d37b-1ef9-45cb-9b29-a1312b1356e7 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:17.523012 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc0bd7-408e-4669-94fd-ec347b44ce21 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:17.524644 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-1dcc0bd7-408e-4669-94fd-ec347b44ce21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:17.527637 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0eb4d37b-1ef9-45cb-9b29-a1312b1356e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f7121c321b3450abef71237d25c0596'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:17.536455 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0eb4d37b-1ef9-45cb-9b29-a1312b1356e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f7121c321b3450abef71237d25c0596'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:17.537218 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0eb4d37b-1ef9-45cb-9b29-a1312b1356e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f7121c321b3450abef71237d25c0596'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:17.544448 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc0bd7-408e-4669-94fd-ec347b44ce21 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:17.550844 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169956d5-aa92-4dcb-8a43-9e9295756a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:17.551716 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169956d5-aa92-4dcb-8a43-9e9295756a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:17.552044 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169956d5-aa92-4dcb-8a43-9e9295756a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:17.552318 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169956d5-aa92-4dcb-8a43-9e9295756a18 admin admin] PATH_INFO: `/v3/projects/e64450bba92d4983854714c125873858` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:17.553191 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0eb4d37b-1ef9-45cb-9b29-a1312b1356e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f7121c321b3450abef71237d25c0596'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:17.553545 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169956d5-aa92-4dcb-8a43-9e9295756a18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e64450bba92d4983854714c125873858)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:17.553901 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0eb4d37b-1ef9-45cb-9b29-a1312b1356e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f7121c321b3450abef71237d25c0596'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:17.555494 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169956d5-aa92-4dcb-8a43-9e9295756a18 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:17.570155 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1301/2611] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:00:17 2022] DELETE /identity/v3/users/9f7121c321b3450abef71237d25c0596 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:17.629546 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-169956d5-aa92-4dcb-8a43-9e9295756a18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e64450bba92d4983854714c125873858', 'request_id': 'req-169956d5-aa92-4dcb-8a43-9e9295756a18'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:17.636695 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-169956d5-aa92-4dcb-8a43-9e9295756a18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e64450bba92d4983854714c125873858', 'request_id': 'req-169956d5-aa92-4dcb-8a43-9e9295756a18'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:17.645689 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-169956d5-aa92-4dcb-8a43-9e9295756a18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e64450bba92d4983854714c125873858', 'request_id': 'req-169956d5-aa92-4dcb-8a43-9e9295756a18'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:17.658510 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-169956d5-aa92-4dcb-8a43-9e9295756a18 admin admin] The token cache is being invalidate because project e64450bba92d4983854714c125873858 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:00:17.658798 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-169956d5-aa92-4dcb-8a43-9e9295756a18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:17.660392 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-169956d5-aa92-4dcb-8a43-9e9295756a18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:17.662649 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1311/2612] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:00:17 2022] DELETE /identity/v3/projects/e64450bba92d4983854714c125873858 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:17.666118 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29b27d-9d15-4832-a9b0-c42c7d1a952f None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:17.666413 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29b27d-9d15-4832-a9b0-c42c7d1a952f None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:17.666718 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29b27d-9d15-4832-a9b0-c42c7d1a952f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:17.694414 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-4f29b27d-9d15-4832-a9b0-c42c7d1a952f None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:17.695880 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-4f29b27d-9d15-4832-a9b0-c42c7d1a952f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:17.787791 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1302/2613] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:00:17.798403 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36b988-bf0e-4525-937e-f4be38db3f43 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:17.798815 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36b988-bf0e-4525-937e-f4be38db3f43 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:17.799123 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36b988-bf0e-4525-937e-f4be38db3f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:17.822085 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-0d36b988-bf0e-4525-937e-f4be38db3f43 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:17.823422 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-0d36b988-bf0e-4525-937e-f4be38db3f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:17.832975 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1312/2614] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:00:17.837454 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29b27d-9d15-4832-a9b0-c42c7d1a952f None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:17.848287 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29b27d-9d15-4832-a9b0-c42c7d1a952f None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:17.853231 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a36dc9-4bf7-455e-bd51-d9f82e3c4af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:17.853901 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a36dc9-4bf7-455e-bd51-d9f82e3c4af2 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:17.854182 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a36dc9-4bf7-455e-bd51-d9f82e3c4af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:17.854502 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a36dc9-4bf7-455e-bd51-d9f82e3c4af2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:17.855243 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a36dc9-4bf7-455e-bd51-d9f82e3c4af2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 21:00:17.855554 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a36dc9-4bf7-455e-bd51-d9f82e3c4af2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:17.857409 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a36dc9-4bf7-455e-bd51-d9f82e3c4af2 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:17.874231 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1303/2615] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 21:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 21:00:17.877060 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36b988-bf0e-4525-937e-f4be38db3f43 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:17.895891 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36b988-bf0e-4525-937e-f4be38db3f43 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:17.904414 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878af9d-bd2b-4e4d-b879-8ed796e9b7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:17.906171 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878af9d-bd2b-4e4d-b879-8ed796e9b7b0 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:17.906716 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878af9d-bd2b-4e4d-b879-8ed796e9b7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:17.907032 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878af9d-bd2b-4e4d-b879-8ed796e9b7b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:17.907990 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878af9d-bd2b-4e4d-b879-8ed796e9b7b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:17.910734 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878af9d-bd2b-4e4d-b879-8ed796e9b7b0 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:17.926122 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a36dc9-4bf7-455e-bd51-d9f82e3c4af2 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:17.928386 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-c2a36dc9-4bf7-455e-bd51-d9f82e3c4af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:17.953214 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a36dc9-4bf7-455e-bd51-d9f82e3c4af2 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:17.958660 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54a3a2-c5f9-4770-a17d-5e83e907c3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:17.959571 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54a3a2-c5f9-4770-a17d-5e83e907c3a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:17.959972 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54a3a2-c5f9-4770-a17d-5e83e907c3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:17.960147 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54a3a2-c5f9-4770-a17d-5e83e907c3a1 admin admin] PATH_INFO: `/v3/projects/0a510c5277cb46c8a1b0dec856d43769` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:17.962214 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc54a3a2-c5f9-4770-a17d-5e83e907c3a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a510c5277cb46c8a1b0dec856d43769)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:17.962787 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1313/2616] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 21:00:17 2022] POST /identity/v3/projects => generated 379 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:00:17.964639 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc54a3a2-c5f9-4770-a17d-5e83e907c3a1 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:17.977069 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878af9d-bd2b-4e4d-b879-8ed796e9b7b0 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:18.020361 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-dc54a3a2-c5f9-4770-a17d-5e83e907c3a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a510c5277cb46c8a1b0dec856d43769', 'request_id': 'req-dc54a3a2-c5f9-4770-a17d-5e83e907c3a1'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:18.026560 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-dc54a3a2-c5f9-4770-a17d-5e83e907c3a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a510c5277cb46c8a1b0dec856d43769', 'request_id': 'req-dc54a3a2-c5f9-4770-a17d-5e83e907c3a1'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:18.034832 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-dc54a3a2-c5f9-4770-a17d-5e83e907c3a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a510c5277cb46c8a1b0dec856d43769', 'request_id': 'req-dc54a3a2-c5f9-4770-a17d-5e83e907c3a1'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:18.056016 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-dc54a3a2-c5f9-4770-a17d-5e83e907c3a1 admin admin] The token cache is being invalidate because project 0a510c5277cb46c8a1b0dec856d43769 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:00:18.056432 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-dc54a3a2-c5f9-4770-a17d-5e83e907c3a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:18.057303 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-dc54a3a2-c5f9-4770-a17d-5e83e907c3a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:18.059185 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1304/2617] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:00:17 2022] DELETE /identity/v3/projects/0a510c5277cb46c8a1b0dec856d43769 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:18.066564 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816c4f8-5b24-48b9-bdc9-33c865483c9d None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:18.066933 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816c4f8-5b24-48b9-bdc9-33c865483c9d None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:18.067280 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816c4f8-5b24-48b9-bdc9-33c865483c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:18.090505 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878af9d-bd2b-4e4d-b879-8ed796e9b7b0 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:18.096786 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-6816c4f8-5b24-48b9-bdc9-33c865483c9d None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:18.098373 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-6816c4f8-5b24-48b9-bdc9-33c865483c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:18.173625 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2763b0f-7f86-4089-9cb6-b69b7f1bb9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:18.175666 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2763b0f-7f86-4089-9cb6-b69b7f1bb9b2 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:18.175666 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2763b0f-7f86-4089-9cb6-b69b7f1bb9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:18.175666 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2763b0f-7f86-4089-9cb6-b69b7f1bb9b2 admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:18.175666 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2763b0f-7f86-4089-9cb6-b69b7f1bb9b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:18.177500 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2763b0f-7f86-4089-9cb6-b69b7f1bb9b2 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:18.187948 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1305/2618] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 21:00:18.194961 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09b7e2-ec6c-4056-9d6e-42cde64950df None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:18.195359 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09b7e2-ec6c-4056-9d6e-42cde64950df None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:18.195842 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09b7e2-ec6c-4056-9d6e-42cde64950df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:18.205240 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1314/2619] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 21:00:17 2022] POST /identity/v3/users => generated 290 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:00:18.209359 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2763b0f-7f86-4089-9cb6-b69b7f1bb9b2 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:18.211134 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-e2763b0f-7f86-4089-9cb6-b69b7f1bb9b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:18.217790 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-fb09b7e2-ec6c-4056-9d6e-42cde64950df None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:18.219449 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-fb09b7e2-ec6c-4056-9d6e-42cde64950df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:18.228446 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1306/2620] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 21:00:18.229926 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2763b0f-7f86-4089-9cb6-b69b7f1bb9b2 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:18.232331 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09b7e2-ec6c-4056-9d6e-42cde64950df None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:18.243490 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09b7e2-ec6c-4056-9d6e-42cde64950df None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:18.244454 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e718136-81bc-46c4-93c3-619012a559d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:18.245141 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e718136-81bc-46c4-93c3-619012a559d3 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:18.245420 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e718136-81bc-46c4-93c3-619012a559d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:18.245688 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e718136-81bc-46c4-93c3-619012a559d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:18.246418 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e718136-81bc-46c4-93c3-619012a559d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:18.248068 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e718136-81bc-46c4-93c3-619012a559d3 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:18.249472 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524c9f8-7b78-456b-b828-1dcea191f6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:18.250144 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524c9f8-7b78-456b-b828-1dcea191f6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:18.250423 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524c9f8-7b78-456b-b828-1dcea191f6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:18.250692 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524c9f8-7b78-456b-b828-1dcea191f6f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:18.251429 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524c9f8-7b78-456b-b828-1dcea191f6f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 21:00:18.251732 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524c9f8-7b78-456b-b828-1dcea191f6f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:18.253394 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524c9f8-7b78-456b-b828-1dcea191f6f7 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:18.260253 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1315/2621] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 21:00:18.264023 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e718136-81bc-46c4-93c3-619012a559d3 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:18.269206 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1307/2622] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 21:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 21:00:18.275688 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524c9f8-7b78-456b-b828-1dcea191f6f7 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:18.281765 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e718136-81bc-46c4-93c3-619012a559d3 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:18.289726 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2771d10-e0de-4123-a156-11edd046151d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:18.290921 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2771d10-e0de-4123-a156-11edd046151d admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:18.291420 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2771d10-e0de-4123-a156-11edd046151d admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:18.291832 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2771d10-e0de-4123-a156-11edd046151d admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:18.293135 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2771d10-e0de-4123-a156-11edd046151d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:18.293333 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524c9f8-7b78-456b-b828-1dcea191f6f7 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:18.297181 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2771d10-e0de-4123-a156-11edd046151d admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:18.301177 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee55e6-736d-4ba8-a381-171628f389a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:18.301687 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee55e6-736d-4ba8-a381-171628f389a4 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:18.302688 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee55e6-736d-4ba8-a381-171628f389a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:18.302688 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee55e6-736d-4ba8-a381-171628f389a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:18.308350 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee55e6-736d-4ba8-a381-171628f389a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:18.310503 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee55e6-736d-4ba8-a381-171628f389a4 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:18.316306 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1316/2623] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 21:00:18.321517 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2771d10-e0de-4123-a156-11edd046151d admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:18.336584 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2771d10-e0de-4123-a156-11edd046151d admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:18.341471 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1308/2624] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 21:00:18 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 21:00:18.344395 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794feb8-9767-4ab2-8e31-d6d88ec22fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:18.345624 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794feb8-9767-4ab2-8e31-d6d88ec22fb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:18.345982 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794feb8-9767-4ab2-8e31-d6d88ec22fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:18.346149 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee55e6-736d-4ba8-a381-171628f389a4 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:18.346308 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794feb8-9767-4ab2-8e31-d6d88ec22fb2 admin admin] PATH_INFO: `/v3/projects/004da555c1284be1a8dc4def5cc7992f/users/298f6333995b4473a93b5934f5dff164/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:18.363672 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794feb8-9767-4ab2-8e31-d6d88ec22fb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=004da555c1284be1a8dc4def5cc7992f, user_id=298f6333995b4473a93b5934f5dff164, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:18.366433 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794feb8-9767-4ab2-8e31-d6d88ec22fb2 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:18.381437 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1317/2625] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:00:18 2022] PUT /identity/v3/projects/004da555c1284be1a8dc4def5cc7992f/users/298f6333995b4473a93b5934f5dff164/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:18.399214 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0e0e1-e4e7-488e-8cba-2f871973f5e9 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:18.399494 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0e0e1-e4e7-488e-8cba-2f871973f5e9 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:18.400310 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0e0e1-e4e7-488e-8cba-2f871973f5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:18.426635 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee55e6-736d-4ba8-a381-171628f389a4 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:18.434236 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-e0f0e0e1-e4e7-488e-8cba-2f871973f5e9 None None] MFA Rules not processed for user `298f6333995b4473a93b5934f5dff164`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:18.439326 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-e0f0e0e1-e4e7-488e-8cba-2f871973f5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:18.489775 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822072b1-ad52-4408-b126-f785f017177e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:18.490454 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822072b1-ad52-4408-b126-f785f017177e admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:18.490739 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822072b1-ad52-4408-b126-f785f017177e admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:18.491016 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822072b1-ad52-4408-b126-f785f017177e admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:18.491726 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822072b1-ad52-4408-b126-f785f017177e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:18.493890 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822072b1-ad52-4408-b126-f785f017177e admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:18.515664 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1318/2626] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:00:18.520460 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1309/2627] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 21:00:18 2022] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 21:00:18.520795 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0e0e1-e4e7-488e-8cba-2f871973f5e9 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:18.525970 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822072b1-ad52-4408-b126-f785f017177e admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:18.532703 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0e0e1-e4e7-488e-8cba-2f871973f5e9 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:18.538611 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cc57c-f9fd-42b9-9236-1705f4046d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:18.539661 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cc57c-f9fd-42b9-9236-1705f4046d74 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:18.539978 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cc57c-f9fd-42b9-9236-1705f4046d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:18.540257 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cc57c-f9fd-42b9-9236-1705f4046d74 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:18.540968 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7cc57c-f9fd-42b9-9236-1705f4046d74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:18.542502 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822072b1-ad52-4408-b126-f785f017177e admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:18.542885 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7cc57c-f9fd-42b9-9236-1705f4046d74 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:18.547309 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075ebdb-2b35-4e56-aad6-3fddf122d33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:18.548001 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075ebdb-2b35-4e56-aad6-3fddf122d33a admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:18.548283 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075ebdb-2b35-4e56-aad6-3fddf122d33a admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:18.548657 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075ebdb-2b35-4e56-aad6-3fddf122d33a admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:18.549392 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075ebdb-2b35-4e56-aad6-3fddf122d33a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:18.550992 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075ebdb-2b35-4e56-aad6-3fddf122d33a admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:18.570980 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1310/2628] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:00:18.573360 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1319/2629] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 21:00:18 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 21:00:18.576167 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075ebdb-2b35-4e56-aad6-3fddf122d33a admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:18.577463 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cc57c-f9fd-42b9-9236-1705f4046d74 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:18.587169 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075ebdb-2b35-4e56-aad6-3fddf122d33a admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:18.652386 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cc57c-f9fd-42b9-9236-1705f4046d74 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:18.658063 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a62691-b1ad-4329-8f36-500d7dde4daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:18.658436 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b6bc2-8503-45ca-a439-bed53dc35173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:18.658732 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a62691-b1ad-4329-8f36-500d7dde4daf admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:18.659008 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a62691-b1ad-4329-8f36-500d7dde4daf admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:18.659166 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b6bc2-8503-45ca-a439-bed53dc35173 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:18.659263 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a62691-b1ad-4329-8f36-500d7dde4daf admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:18.659505 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b6bc2-8503-45ca-a439-bed53dc35173 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:18.659986 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b6bc2-8503-45ca-a439-bed53dc35173 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:18.660082 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a62691-b1ad-4329-8f36-500d7dde4daf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:18.661209 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b6bc2-8503-45ca-a439-bed53dc35173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:18.661937 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a62691-b1ad-4329-8f36-500d7dde4daf admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:18.664116 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b6bc2-8503-45ca-a439-bed53dc35173 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:18.679183 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1311/2630] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:00:18.680502 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b6bc2-8503-45ca-a439-bed53dc35173 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:18.690755 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1320/2631] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 21:00:18 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 21:00:18.691391 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b6bc2-8503-45ca-a439-bed53dc35173 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:18.692236 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a62691-b1ad-4329-8f36-500d7dde4daf admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:18.697170 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5f825-50df-4e8e-89ca-49cd9fd2805e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:18.698225 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5f825-50df-4e8e-89ca-49cd9fd2805e admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:18.698521 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5f825-50df-4e8e-89ca-49cd9fd2805e admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:18.698773 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5f825-50df-4e8e-89ca-49cd9fd2805e admin admin] PATH_INFO: `/v3/projects/5b937a6b38f345d39d4ac5001b6de458/users/7e44824990d04a949d276d4514f03350/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:18.704494 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a62691-b1ad-4329-8f36-500d7dde4daf admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:18.711100 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da703631-d7a2-454d-8d54-1ec0dee9b3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:18.712277 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da703631-d7a2-454d-8d54-1ec0dee9b3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:18.712765 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da703631-d7a2-454d-8d54-1ec0dee9b3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:18.713240 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da703631-d7a2-454d-8d54-1ec0dee9b3f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:18.714588 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da703631-d7a2-454d-8d54-1ec0dee9b3f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:18.719226 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da703631-d7a2-454d-8d54-1ec0dee9b3f0 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:18.720374 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc5f825-50df-4e8e-89ca-49cd9fd2805e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b937a6b38f345d39d4ac5001b6de458, user_id=7e44824990d04a949d276d4514f03350, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:18.723440 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc5f825-50df-4e8e-89ca-49cd9fd2805e admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:18.737227 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1312/2632] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:00:18 2022] PUT /identity/v3/projects/5b937a6b38f345d39d4ac5001b6de458/users/7e44824990d04a949d276d4514f03350/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 21:00:18.742535 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1321/2633] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 21:00:18.744215 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5f825-50df-4e8e-89ca-49cd9fd2805e admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:18.749786 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05021261-38f5-4fcb-a9eb-e1cd3498513c None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:18.750077 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05021261-38f5-4fcb-a9eb-e1cd3498513c None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:18.750356 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05021261-38f5-4fcb-a9eb-e1cd3498513c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:18.781973 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-05021261-38f5-4fcb-a9eb-e1cd3498513c None None] MFA Rules not processed for user `7e44824990d04a949d276d4514f03350`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:18.783125 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-05021261-38f5-4fcb-a9eb-e1cd3498513c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:18.830733 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5f825-50df-4e8e-89ca-49cd9fd2805e admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:18.835808 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2d7ea-a85e-45e7-8548-e52493e44b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:18.836490 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2d7ea-a85e-45e7-8548-e52493e44b3e admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:18.836766 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2d7ea-a85e-45e7-8548-e52493e44b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:18.837037 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2d7ea-a85e-45e7-8548-e52493e44b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:18.837770 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2d7ea-a85e-45e7-8548-e52493e44b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:18.839414 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2d7ea-a85e-45e7-8548-e52493e44b3e admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:18.852783 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1313/2634] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 21:00:18.857515 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2d7ea-a85e-45e7-8548-e52493e44b3e admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:18.863578 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1322/2635] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 21:00:18.876713 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2d7ea-a85e-45e7-8548-e52493e44b3e admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:18.879117 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05021261-38f5-4fcb-a9eb-e1cd3498513c None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:18.882842 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def99007-a561-4e75-9a2b-1f14846d006b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:18.883434 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-05021261-38f5-4fcb-a9eb-e1cd3498513c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:18.884346 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def99007-a561-4e75-9a2b-1f14846d006b admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:18.884784 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def99007-a561-4e75-9a2b-1f14846d006b admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:18.885218 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def99007-a561-4e75-9a2b-1f14846d006b admin admin] PATH_INFO: `/v3/projects/9fec772b2d204e2795a43df868db2eb6/users/0522b423e0374cd1a484e570c70a14ce/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:18.903950 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def99007-a561-4e75-9a2b-1f14846d006b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fec772b2d204e2795a43df868db2eb6, user_id=0522b423e0374cd1a484e570c70a14ce, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:18.907231 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def99007-a561-4e75-9a2b-1f14846d006b admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:18.922530 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1314/2636] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:00:18 2022] PUT /identity/v3/projects/9fec772b2d204e2795a43df868db2eb6/users/0522b423e0374cd1a484e570c70a14ce/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 21:00:18.933988 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab85058-dd27-4708-a7d8-9e4cd1304d3a None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:18.934271 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab85058-dd27-4708-a7d8-9e4cd1304d3a None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:18.934549 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab85058-dd27-4708-a7d8-9e4cd1304d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:18.949007 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05021261-38f5-4fcb-a9eb-e1cd3498513c None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:18.971688 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-4ab85058-dd27-4708-a7d8-9e4cd1304d3a None None] MFA Rules not processed for user `0522b423e0374cd1a484e570c70a14ce`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:18.973822 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-4ab85058-dd27-4708-a7d8-9e4cd1304d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:19.001923 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254565a5-d30e-478a-be8e-d07921ffa9ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:19.002573 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254565a5-d30e-478a-be8e-d07921ffa9ad service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:19.002856 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254565a5-d30e-478a-be8e-d07921ffa9ad service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:19.003130 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254565a5-d30e-478a-be8e-d07921ffa9ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:19.061488 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1315/2637] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 21:00:19.062669 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab85058-dd27-4708-a7d8-9e4cd1304d3a None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:19.077243 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254565a5-d30e-478a-be8e-d07921ffa9ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:19.079640 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254565a5-d30e-478a-be8e-d07921ffa9ad service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:19.094471 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1323/2638] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:00:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:00:19.160767 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab85058-dd27-4708-a7d8-9e4cd1304d3a None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:19.167930 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb278d1-b5f0-4610-bfbf-761997ae5b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:19.168991 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb278d1-b5f0-4610-bfbf-761997ae5b31 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:19.169419 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb278d1-b5f0-4610-bfbf-761997ae5b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:19.169871 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb278d1-b5f0-4610-bfbf-761997ae5b31 admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:19.170906 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb278d1-b5f0-4610-bfbf-761997ae5b31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:19.174304 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb278d1-b5f0-4610-bfbf-761997ae5b31 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:19.216692 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1316/2639] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 21:00:19 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:00:19.227397 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254565a5-d30e-478a-be8e-d07921ffa9ad service cinder] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:19.247064 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254565a5-d30e-478a-be8e-d07921ffa9ad service cinder] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:19.323434 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7342c-3550-4178-84f3-4d4fa0f6725f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:19.324116 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7342c-3550-4178-84f3-4d4fa0f6725f admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:19.324326 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7342c-3550-4178-84f3-4d4fa0f6725f admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:19.324622 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7342c-3550-4178-84f3-4d4fa0f6725f admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:19.325299 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d7342c-3550-4178-84f3-4d4fa0f6725f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:19.327863 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d7342c-3550-4178-84f3-4d4fa0f6725f admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:19.351817 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1324/2640] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 21:00:19 2022] POST /identity/v3/users => generated 299 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:00:19.356188 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb278d1-b5f0-4610-bfbf-761997ae5b31 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:19.367647 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb278d1-b5f0-4610-bfbf-761997ae5b31 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:19.372785 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbdb92-c6ee-4896-9ee1-e55a734d8f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:19.373521 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbdb92-c6ee-4896-9ee1-e55a734d8f33 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:19.373797 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbdb92-c6ee-4896-9ee1-e55a734d8f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:19.374067 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbdb92-c6ee-4896-9ee1-e55a734d8f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:19.374912 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cbdb92-c6ee-4896-9ee1-e55a734d8f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:19.376577 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cbdb92-c6ee-4896-9ee1-e55a734d8f33 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:19.392012 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1317/2641] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:00:19.395373 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7342c-3550-4178-84f3-4d4fa0f6725f admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:19.406921 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7342c-3550-4178-84f3-4d4fa0f6725f admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:19.411698 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b11580-6063-46da-bcdd-bdc09e51b8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:19.412717 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b11580-6063-46da-bcdd-bdc09e51b8bc admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:19.413069 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b11580-6063-46da-bcdd-bdc09e51b8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:19.413405 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b11580-6063-46da-bcdd-bdc09e51b8bc admin admin] PATH_INFO: `/v3/projects/193ebd8629b741dda79fe56eebeaa495/users/91494fe44f68402aa06cd2be0ba6c8bf/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:19.436801 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b11580-6063-46da-bcdd-bdc09e51b8bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=193ebd8629b741dda79fe56eebeaa495, user_id=91494fe44f68402aa06cd2be0ba6c8bf, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:19.439779 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b11580-6063-46da-bcdd-bdc09e51b8bc admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:19.455778 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1325/2642] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:00:19 2022] PUT /identity/v3/projects/193ebd8629b741dda79fe56eebeaa495/users/91494fe44f68402aa06cd2be0ba6c8bf/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:19.463805 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbdb92-c6ee-4896-9ee1-e55a734d8f33 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:19.475260 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbdb92-c6ee-4896-9ee1-e55a734d8f33 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:19.540389 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5662e-4317-4f91-8e28-dba392386eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:19.541085 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5662e-4317-4f91-8e28-dba392386eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:19.541358 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5662e-4317-4f91-8e28-dba392386eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:19.541625 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5662e-4317-4f91-8e28-dba392386eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:19.542344 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5662e-4317-4f91-8e28-dba392386eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:19.543960 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5662e-4317-4f91-8e28-dba392386eb7 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:19.554828 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1318/2643] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 21:00:19.558966 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b11580-6063-46da-bcdd-bdc09e51b8bc admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:19.570116 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b11580-6063-46da-bcdd-bdc09e51b8bc admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:19.575030 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1524e80-f78b-4610-a85a-41efed04c670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:19.575910 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1524e80-f78b-4610-a85a-41efed04c670 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:19.576210 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1524e80-f78b-4610-a85a-41efed04c670 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:19.576590 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1524e80-f78b-4610-a85a-41efed04c670 admin admin] PATH_INFO: `/v3/projects/193ebd8629b741dda79fe56eebeaa495/users/91494fe44f68402aa06cd2be0ba6c8bf/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:19.578985 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1524e80-f78b-4610-a85a-41efed04c670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=193ebd8629b741dda79fe56eebeaa495, user_id=91494fe44f68402aa06cd2be0ba6c8bf, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:19.581664 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1524e80-f78b-4610-a85a-41efed04c670 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:19.592891 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1326/2644] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:00:19 2022] PUT /identity/v3/projects/193ebd8629b741dda79fe56eebeaa495/users/91494fe44f68402aa06cd2be0ba6c8bf/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:19.603530 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0131e47-46bb-4b47-9998-7822d1d2f7d2 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:19.603883 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0131e47-46bb-4b47-9998-7822d1d2f7d2 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:19.604168 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0131e47-46bb-4b47-9998-7822d1d2f7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:19.634197 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-f0131e47-46bb-4b47-9998-7822d1d2f7d2 None None] MFA Rules not processed for user `91494fe44f68402aa06cd2be0ba6c8bf`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:19.635420 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-f0131e47-46bb-4b47-9998-7822d1d2f7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:19.705248 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1319/2645] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:00:19.717239 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1524e80-f78b-4610-a85a-41efed04c670 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:19.789414 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1524e80-f78b-4610-a85a-41efed04c670 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:19.793150 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa6038-09bc-44e5-82ff-16141b223928 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:19.793810 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa6038-09bc-44e5-82ff-16141b223928 service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:19.794086 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa6038-09bc-44e5-82ff-16141b223928 service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:19.794362 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa6038-09bc-44e5-82ff-16141b223928 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:19.854067 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa6038-09bc-44e5-82ff-16141b223928 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:19.855442 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa6038-09bc-44e5-82ff-16141b223928 service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:19.865113 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1327/2646] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:00:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:00:21.456891 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0131e47-46bb-4b47-9998-7822d1d2f7d2 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:21.470879 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0131e47-46bb-4b47-9998-7822d1d2f7d2 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:21.475457 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ff20f-e952-42e9-9a99-f36437bc5ebb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:21.476161 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ff20f-e952-42e9-9a99-f36437bc5ebb service cinder] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:21.476438 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ff20f-e952-42e9-9a99-f36437bc5ebb service cinder] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:21.476715 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ff20f-e952-42e9-9a99-f36437bc5ebb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:21.543920 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ff20f-e952-42e9-9a99-f36437bc5ebb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:21.545540 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ff20f-e952-42e9-9a99-f36437bc5ebb service cinder] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:21.556212 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1320/2647] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:00:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 21:00:22.141918 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa6038-09bc-44e5-82ff-16141b223928 service cinder] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:22.153715 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa6038-09bc-44e5-82ff-16141b223928 service cinder] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:22.159129 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fc923-d0e6-414e-a42b-7fd430c17a8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:22.160209 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fc923-d0e6-414e-a42b-7fd430c17a8a service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:22.160683 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fc923-d0e6-414e-a42b-7fd430c17a8a service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:22.161141 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fc923-d0e6-414e-a42b-7fd430c17a8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:22.174110 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fc923-d0e6-414e-a42b-7fd430c17a8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:22.175602 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fc923-d0e6-414e-a42b-7fd430c17a8a service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:22.187696 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1328/2648] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:00:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:00:22.240820 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ff20f-e952-42e9-9a99-f36437bc5ebb service cinder] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:22.324732 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ff20f-e952-42e9-9a99-f36437bc5ebb service cinder] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:22.333545 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb225a-97d0-412f-9837-40321ec4cccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:22.334463 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb225a-97d0-412f-9837-40321ec4cccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:22.334737 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb225a-97d0-412f-9837-40321ec4cccc admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:22.335003 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb225a-97d0-412f-9837-40321ec4cccc admin admin] PATH_INFO: `/v3/users/7e44824990d04a949d276d4514f03350` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:22.336259 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fb225a-97d0-412f-9837-40321ec4cccc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e44824990d04a949d276d4514f03350)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:22.338175 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fb225a-97d0-412f-9837-40321ec4cccc admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:22.398822 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-b9fb225a-97d0-412f-9837-40321ec4cccc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e44824990d04a949d276d4514f03350'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:22.406362 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-b9fb225a-97d0-412f-9837-40321ec4cccc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e44824990d04a949d276d4514f03350'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:22.407096 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-b9fb225a-97d0-412f-9837-40321ec4cccc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e44824990d04a949d276d4514f03350'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:22.419588 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-b9fb225a-97d0-412f-9837-40321ec4cccc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e44824990d04a949d276d4514f03350'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:22.420934 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-b9fb225a-97d0-412f-9837-40321ec4cccc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e44824990d04a949d276d4514f03350'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:22.436925 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1321/2649] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:00:22 2022] DELETE /identity/v3/users/7e44824990d04a949d276d4514f03350 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:22.442580 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffcaf78-8599-45cf-993e-19a6f51f6ca7 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:22.442869 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffcaf78-8599-45cf-993e-19a6f51f6ca7 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:22.443146 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffcaf78-8599-45cf-993e-19a6f51f6ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:22.462509 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-5ffcaf78-8599-45cf-993e-19a6f51f6ca7 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:22.463792 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-5ffcaf78-8599-45cf-993e-19a6f51f6ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:22.529343 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1329/2650] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:00:22.540714 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb225a-97d0-412f-9837-40321ec4cccc admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:22.542088 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-b9fb225a-97d0-412f-9837-40321ec4cccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:22.609974 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb225a-97d0-412f-9837-40321ec4cccc admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:22.613649 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07025a11-b98b-46e7-8e80-378321e3b0f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:22.614316 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07025a11-b98b-46e7-8e80-378321e3b0f8 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:22.614575 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07025a11-b98b-46e7-8e80-378321e3b0f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:22.614843 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07025a11-b98b-46e7-8e80-378321e3b0f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:22.624856 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07025a11-b98b-46e7-8e80-378321e3b0f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:22.627097 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07025a11-b98b-46e7-8e80-378321e3b0f8 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:22.638545 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1322/2651] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:00:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:00:22.948094 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffcaf78-8599-45cf-993e-19a6f51f6ca7 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:22.952183 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-5ffcaf78-8599-45cf-993e-19a6f51f6ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:22.986809 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffcaf78-8599-45cf-993e-19a6f51f6ca7 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:22.994324 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59769626-b0b4-475f-95cb-1179b02419c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:22.995381 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59769626-b0b4-475f-95cb-1179b02419c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:22.995866 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59769626-b0b4-475f-95cb-1179b02419c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:22.996287 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59769626-b0b4-475f-95cb-1179b02419c9 admin admin] PATH_INFO: `/v3/projects/5b937a6b38f345d39d4ac5001b6de458` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:22.998065 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59769626-b0b4-475f-95cb-1179b02419c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b937a6b38f345d39d4ac5001b6de458)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:23.000597 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59769626-b0b4-475f-95cb-1179b02419c9 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:23.053272 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-59769626-b0b4-475f-95cb-1179b02419c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b937a6b38f345d39d4ac5001b6de458', 'request_id': 'req-59769626-b0b4-475f-95cb-1179b02419c9'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:23.059356 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-59769626-b0b4-475f-95cb-1179b02419c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b937a6b38f345d39d4ac5001b6de458', 'request_id': 'req-59769626-b0b4-475f-95cb-1179b02419c9'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:23.067719 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-59769626-b0b4-475f-95cb-1179b02419c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b937a6b38f345d39d4ac5001b6de458', 'request_id': 'req-59769626-b0b4-475f-95cb-1179b02419c9'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:23.080572 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-59769626-b0b4-475f-95cb-1179b02419c9 admin admin] The token cache is being invalidate because project 5b937a6b38f345d39d4ac5001b6de458 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:00:23.080862 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-59769626-b0b4-475f-95cb-1179b02419c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:23.081848 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-59769626-b0b4-475f-95cb-1179b02419c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:23.083369 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1330/2652] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:00:22 2022] DELETE /identity/v3/projects/5b937a6b38f345d39d4ac5001b6de458 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:23.091433 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856faf9f-2753-48a8-83d1-171113d26dce None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:23.091991 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856faf9f-2753-48a8-83d1-171113d26dce None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:23.092969 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856faf9f-2753-48a8-83d1-171113d26dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:23.115341 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-856faf9f-2753-48a8-83d1-171113d26dce None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:23.116629 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-856faf9f-2753-48a8-83d1-171113d26dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:23.185422 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1323/2653] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:00:23.194840 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26aabe-dea7-4ea7-899b-fa30d46fafd8 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:23.195633 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26aabe-dea7-4ea7-899b-fa30d46fafd8 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:23.195633 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26aabe-dea7-4ea7-899b-fa30d46fafd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:23.215606 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-7c26aabe-dea7-4ea7-899b-fa30d46fafd8 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:23.216792 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-7c26aabe-dea7-4ea7-899b-fa30d46fafd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:23.225711 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1331/2654] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 21:00:23.230635 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856faf9f-2753-48a8-83d1-171113d26dce None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:23.241303 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856faf9f-2753-48a8-83d1-171113d26dce None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:23.246165 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597c5c2-675f-465a-a2ee-618ad451e1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:23.246868 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597c5c2-675f-465a-a2ee-618ad451e1b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:23.247143 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597c5c2-675f-465a-a2ee-618ad451e1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:23.247415 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597c5c2-675f-465a-a2ee-618ad451e1b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:23.249224 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597c5c2-675f-465a-a2ee-618ad451e1b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 21:00:23.249545 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597c5c2-675f-465a-a2ee-618ad451e1b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:23.257910 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597c5c2-675f-465a-a2ee-618ad451e1b8 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:23.264822 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1324/2655] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 21:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 21:00:23.269568 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26aabe-dea7-4ea7-899b-fa30d46fafd8 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:23.279078 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26aabe-dea7-4ea7-899b-fa30d46fafd8 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:23.284533 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f92ac6-e618-4777-b55f-38610c08186c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:23.285081 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f92ac6-e618-4777-b55f-38610c08186c admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:23.285929 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f92ac6-e618-4777-b55f-38610c08186c admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:23.285929 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f92ac6-e618-4777-b55f-38610c08186c admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:23.286513 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f92ac6-e618-4777-b55f-38610c08186c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:23.288265 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f92ac6-e618-4777-b55f-38610c08186c admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:23.317314 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1332/2656] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 21:00:23 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:00:23.321493 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597c5c2-675f-465a-a2ee-618ad451e1b8 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:23.332108 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597c5c2-675f-465a-a2ee-618ad451e1b8 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:23.400291 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b8dce-d93a-437a-a9df-068f3f9692db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:23.400977 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b8dce-d93a-437a-a9df-068f3f9692db admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:23.401255 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b8dce-d93a-437a-a9df-068f3f9692db admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:23.401527 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b8dce-d93a-437a-a9df-068f3f9692db admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:23.402211 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b8dce-d93a-437a-a9df-068f3f9692db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:23.404177 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b8dce-d93a-437a-a9df-068f3f9692db admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:23.427713 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1325/2657] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 21:00:23 2022] POST /identity/v3/users => generated 296 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:00:23.431901 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f92ac6-e618-4777-b55f-38610c08186c admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:23.442510 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f92ac6-e618-4777-b55f-38610c08186c admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:23.447185 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7e410-5fc2-4da0-b43e-d32df76f5597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:23.447866 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7e410-5fc2-4da0-b43e-d32df76f5597 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:23.448146 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7e410-5fc2-4da0-b43e-d32df76f5597 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:23.448418 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7e410-5fc2-4da0-b43e-d32df76f5597 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:23.449147 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7e410-5fc2-4da0-b43e-d32df76f5597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:23.450735 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7e410-5fc2-4da0-b43e-d32df76f5597 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:23.462150 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1333/2658] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:00:23.468883 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b8dce-d93a-437a-a9df-068f3f9692db admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:23.479214 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b8dce-d93a-437a-a9df-068f3f9692db admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:23.484937 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68df51b-f5ac-4510-8cbf-afc4f1204a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:23.485612 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68df51b-f5ac-4510-8cbf-afc4f1204a07 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:23.485887 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68df51b-f5ac-4510-8cbf-afc4f1204a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:23.486163 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68df51b-f5ac-4510-8cbf-afc4f1204a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:23.486908 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68df51b-f5ac-4510-8cbf-afc4f1204a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:23.488638 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68df51b-f5ac-4510-8cbf-afc4f1204a07 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:23.500660 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1326/2659] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 21:00:23.505452 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7e410-5fc2-4da0-b43e-d32df76f5597 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:23.516619 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7e410-5fc2-4da0-b43e-d32df76f5597 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:23.523106 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3109fb3-e1d7-471b-8665-de3e4f89da7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:23.524241 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3109fb3-e1d7-471b-8665-de3e4f89da7a admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:23.524589 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3109fb3-e1d7-471b-8665-de3e4f89da7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:23.524936 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3109fb3-e1d7-471b-8665-de3e4f89da7a admin admin] PATH_INFO: `/v3/projects/00577c1f18014c8b9f5bf7ab29802c98/users/111964d1b2904405a463848a7ab1c610/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:23.540572 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3109fb3-e1d7-471b-8665-de3e4f89da7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=00577c1f18014c8b9f5bf7ab29802c98, user_id=111964d1b2904405a463848a7ab1c610, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:23.543222 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3109fb3-e1d7-471b-8665-de3e4f89da7a admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:23.559000 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1334/2660] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:00:23 2022] PUT /identity/v3/projects/00577c1f18014c8b9f5bf7ab29802c98/users/111964d1b2904405a463848a7ab1c610/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:23.571517 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ce6a2-78c0-47d1-9a0a-6052a1e3bad1 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:23.572361 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ce6a2-78c0-47d1-9a0a-6052a1e3bad1 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:23.572361 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ce6a2-78c0-47d1-9a0a-6052a1e3bad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:23.602168 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-661ce6a2-78c0-47d1-9a0a-6052a1e3bad1 None None] MFA Rules not processed for user `111964d1b2904405a463848a7ab1c610`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:23.603454 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-661ce6a2-78c0-47d1-9a0a-6052a1e3bad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:23.676476 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1327/2661] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:00:23.688606 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3109fb3-e1d7-471b-8665-de3e4f89da7a admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:23.690344 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-a3109fb3-e1d7-471b-8665-de3e4f89da7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:23.751187 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3109fb3-e1d7-471b-8665-de3e4f89da7a admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:23.755475 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8be9bb-c051-4677-94ab-279d8c09e0f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:23.756378 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8be9bb-c051-4677-94ab-279d8c09e0f0 service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:23.756716 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8be9bb-c051-4677-94ab-279d8c09e0f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:23.757063 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8be9bb-c051-4677-94ab-279d8c09e0f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:23.768156 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8be9bb-c051-4677-94ab-279d8c09e0f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:23.769860 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8be9bb-c051-4677-94ab-279d8c09e0f0 service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:23.779295 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1335/2662] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:00:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:00:26.190767 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ce6a2-78c0-47d1-9a0a-6052a1e3bad1 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:26.192278 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-661ce6a2-78c0-47d1-9a0a-6052a1e3bad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:26.259747 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ce6a2-78c0-47d1-9a0a-6052a1e3bad1 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:26.265115 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7281cb-367f-4422-a899-c1f8fa94635b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:26.265996 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7281cb-367f-4422-a899-c1f8fa94635b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:26.266276 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7281cb-367f-4422-a899-c1f8fa94635b admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:26.266549 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7281cb-367f-4422-a899-c1f8fa94635b admin admin] PATH_INFO: `/v3/users/298f6333995b4473a93b5934f5dff164` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:26.267834 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7281cb-367f-4422-a899-c1f8fa94635b admin admin] RBAC: Authorizing `identity:delete_user(user_id=298f6333995b4473a93b5934f5dff164)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:26.270112 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7281cb-367f-4422-a899-c1f8fa94635b admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:26.323726 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-7b7281cb-367f-4422-a899-c1f8fa94635b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '298f6333995b4473a93b5934f5dff164'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:26.331370 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-7b7281cb-367f-4422-a899-c1f8fa94635b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '298f6333995b4473a93b5934f5dff164'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:26.332075 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-7b7281cb-367f-4422-a899-c1f8fa94635b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '298f6333995b4473a93b5934f5dff164'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:26.344231 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-7b7281cb-367f-4422-a899-c1f8fa94635b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '298f6333995b4473a93b5934f5dff164'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:26.344933 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-7b7281cb-367f-4422-a899-c1f8fa94635b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '298f6333995b4473a93b5934f5dff164'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:26.358037 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1328/2663] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:00:26 2022] DELETE /identity/v3/users/298f6333995b4473a93b5934f5dff164 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:26.363404 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abb9b3-ba83-43df-9a5f-9690bcaca1f0 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:26.363927 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abb9b3-ba83-43df-9a5f-9690bcaca1f0 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:26.364160 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abb9b3-ba83-43df-9a5f-9690bcaca1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:26.383085 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-33abb9b3-ba83-43df-9a5f-9690bcaca1f0 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:26.384245 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-33abb9b3-ba83-43df-9a5f-9690bcaca1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:26.447940 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1336/2664] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:00:26.458559 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7281cb-367f-4422-a899-c1f8fa94635b admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:26.459998 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-7b7281cb-367f-4422-a899-c1f8fa94635b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:26.520027 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7281cb-367f-4422-a899-c1f8fa94635b admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:26.526126 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a598d-bdfe-4441-a093-fe23d8db8f2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:26.527217 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a598d-bdfe-4441-a093-fe23d8db8f2e service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:26.527720 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a598d-bdfe-4441-a093-fe23d8db8f2e service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:26.528317 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a598d-bdfe-4441-a093-fe23d8db8f2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:26.541644 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a598d-bdfe-4441-a093-fe23d8db8f2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:26.543118 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a598d-bdfe-4441-a093-fe23d8db8f2e service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:26.554384 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1329/2665] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:00:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:00:26.870067 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abb9b3-ba83-43df-9a5f-9690bcaca1f0 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:26.871565 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-33abb9b3-ba83-43df-9a5f-9690bcaca1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:26.894504 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abb9b3-ba83-43df-9a5f-9690bcaca1f0 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:26.900086 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28aefda-d6e3-442e-9c34-02d3bc6caeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:26.901178 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28aefda-d6e3-442e-9c34-02d3bc6caeb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:26.901522 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28aefda-d6e3-442e-9c34-02d3bc6caeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:26.901783 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28aefda-d6e3-442e-9c34-02d3bc6caeb2 admin admin] PATH_INFO: `/v3/projects/004da555c1284be1a8dc4def5cc7992f` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:26.903112 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28aefda-d6e3-442e-9c34-02d3bc6caeb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=004da555c1284be1a8dc4def5cc7992f)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:26.905169 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28aefda-d6e3-442e-9c34-02d3bc6caeb2 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:26.958112 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-f28aefda-d6e3-442e-9c34-02d3bc6caeb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '004da555c1284be1a8dc4def5cc7992f', 'request_id': 'req-f28aefda-d6e3-442e-9c34-02d3bc6caeb2'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:26.963862 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-f28aefda-d6e3-442e-9c34-02d3bc6caeb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '004da555c1284be1a8dc4def5cc7992f', 'request_id': 'req-f28aefda-d6e3-442e-9c34-02d3bc6caeb2'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:26.972040 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-f28aefda-d6e3-442e-9c34-02d3bc6caeb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '004da555c1284be1a8dc4def5cc7992f', 'request_id': 'req-f28aefda-d6e3-442e-9c34-02d3bc6caeb2'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:26.984222 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-f28aefda-d6e3-442e-9c34-02d3bc6caeb2 admin admin] The token cache is being invalidate because project 004da555c1284be1a8dc4def5cc7992f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:00:26.984512 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-f28aefda-d6e3-442e-9c34-02d3bc6caeb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:26.985169 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-f28aefda-d6e3-442e-9c34-02d3bc6caeb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:26.986727 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1337/2666] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:00:26 2022] DELETE /identity/v3/projects/004da555c1284be1a8dc4def5cc7992f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:26.990742 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a598d-bdfe-4441-a093-fe23d8db8f2e service neutron] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:27.001681 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a598d-bdfe-4441-a093-fe23d8db8f2e service neutron] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:27.072635 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1e520-7657-48d6-8998-f12be291e943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:27.074058 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1e520-7657-48d6-8998-f12be291e943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:27.074555 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1e520-7657-48d6-8998-f12be291e943 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:27.075011 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1e520-7657-48d6-8998-f12be291e943 admin admin] PATH_INFO: `/v3/users/0522b423e0374cd1a484e570c70a14ce` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:27.077082 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1e520-7657-48d6-8998-f12be291e943 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0522b423e0374cd1a484e570c70a14ce)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:27.079462 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1e520-7657-48d6-8998-f12be291e943 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:27.132455 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-49a1e520-7657-48d6-8998-f12be291e943 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0522b423e0374cd1a484e570c70a14ce'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:27.139577 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-49a1e520-7657-48d6-8998-f12be291e943 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0522b423e0374cd1a484e570c70a14ce'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:27.140313 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-49a1e520-7657-48d6-8998-f12be291e943 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0522b423e0374cd1a484e570c70a14ce'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:27.152997 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-49a1e520-7657-48d6-8998-f12be291e943 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0522b423e0374cd1a484e570c70a14ce'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:27.153714 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-49a1e520-7657-48d6-8998-f12be291e943 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0522b423e0374cd1a484e570c70a14ce'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:27.167861 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1330/2667] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:00:26 2022] DELETE /identity/v3/users/0522b423e0374cd1a484e570c70a14ce => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:27.461644 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28aefda-d6e3-442e-9c34-02d3bc6caeb2 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:27.464024 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-f28aefda-d6e3-442e-9c34-02d3bc6caeb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:27.484834 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28aefda-d6e3-442e-9c34-02d3bc6caeb2 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:27.552489 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cf1b1-25ac-47b5-a53d-c3652816568d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:27.553743 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cf1b1-25ac-47b5-a53d-c3652816568d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:27.554391 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cf1b1-25ac-47b5-a53d-c3652816568d admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:27.554868 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cf1b1-25ac-47b5-a53d-c3652816568d admin admin] PATH_INFO: `/v3/projects/9fec772b2d204e2795a43df868db2eb6` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:27.557093 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653cf1b1-25ac-47b5-a53d-c3652816568d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fec772b2d204e2795a43df868db2eb6)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:27.560862 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653cf1b1-25ac-47b5-a53d-c3652816568d admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:27.621077 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-653cf1b1-25ac-47b5-a53d-c3652816568d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fec772b2d204e2795a43df868db2eb6', 'request_id': 'req-653cf1b1-25ac-47b5-a53d-c3652816568d'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:27.627634 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-653cf1b1-25ac-47b5-a53d-c3652816568d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fec772b2d204e2795a43df868db2eb6', 'request_id': 'req-653cf1b1-25ac-47b5-a53d-c3652816568d'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:27.637642 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-653cf1b1-25ac-47b5-a53d-c3652816568d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fec772b2d204e2795a43df868db2eb6', 'request_id': 'req-653cf1b1-25ac-47b5-a53d-c3652816568d'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:27.651593 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-653cf1b1-25ac-47b5-a53d-c3652816568d admin admin] The token cache is being invalidate because project 9fec772b2d204e2795a43df868db2eb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:00:27.651914 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-653cf1b1-25ac-47b5-a53d-c3652816568d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:27.652585 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-653cf1b1-25ac-47b5-a53d-c3652816568d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:27.654119 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1338/2668] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:00:27 2022] DELETE /identity/v3/projects/9fec772b2d204e2795a43df868db2eb6 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:27.658944 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1e520-7657-48d6-8998-f12be291e943 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:27.660735 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-49a1e520-7657-48d6-8998-f12be291e943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:27.674799 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1e520-7657-48d6-8998-f12be291e943 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:27.735589 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c0ff8-7179-400c-bc2e-48c58dc7310e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:27.736443 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c0ff8-7179-400c-bc2e-48c58dc7310e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:27.736743 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c0ff8-7179-400c-bc2e-48c58dc7310e admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:27.737010 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c0ff8-7179-400c-bc2e-48c58dc7310e admin admin] PATH_INFO: `/v3/users/91494fe44f68402aa06cd2be0ba6c8bf` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:27.738247 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c0ff8-7179-400c-bc2e-48c58dc7310e admin admin] RBAC: Authorizing `identity:delete_user(user_id=91494fe44f68402aa06cd2be0ba6c8bf)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:27.740244 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c0ff8-7179-400c-bc2e-48c58dc7310e admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:27.796103 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-160c0ff8-7179-400c-bc2e-48c58dc7310e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91494fe44f68402aa06cd2be0ba6c8bf'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:27.809187 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-160c0ff8-7179-400c-bc2e-48c58dc7310e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91494fe44f68402aa06cd2be0ba6c8bf'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:27.809954 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-160c0ff8-7179-400c-bc2e-48c58dc7310e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91494fe44f68402aa06cd2be0ba6c8bf'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:27.823274 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-160c0ff8-7179-400c-bc2e-48c58dc7310e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91494fe44f68402aa06cd2be0ba6c8bf'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:27.824073 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-160c0ff8-7179-400c-bc2e-48c58dc7310e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91494fe44f68402aa06cd2be0ba6c8bf'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:27.840226 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1331/2669] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:00:27 2022] DELETE /identity/v3/users/91494fe44f68402aa06cd2be0ba6c8bf => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:28.198842 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cf1b1-25ac-47b5-a53d-c3652816568d admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:28.200824 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-653cf1b1-25ac-47b5-a53d-c3652816568d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:28.230618 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cf1b1-25ac-47b5-a53d-c3652816568d admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:28.294354 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149fb84a-2f66-4626-bf04-ed5f2b2ff62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:28.295623 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fb84a-2f66-4626-bf04-ed5f2b2ff62c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:28.296379 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fb84a-2f66-4626-bf04-ed5f2b2ff62c admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:28.296379 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fb84a-2f66-4626-bf04-ed5f2b2ff62c admin admin] PATH_INFO: `/v3/projects/193ebd8629b741dda79fe56eebeaa495` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:28.297671 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149fb84a-2f66-4626-bf04-ed5f2b2ff62c admin admin] RBAC: Authorizing `identity:delete_project(project_id=193ebd8629b741dda79fe56eebeaa495)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:28.299590 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149fb84a-2f66-4626-bf04-ed5f2b2ff62c admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:28.351604 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-149fb84a-2f66-4626-bf04-ed5f2b2ff62c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '193ebd8629b741dda79fe56eebeaa495', 'request_id': 'req-149fb84a-2f66-4626-bf04-ed5f2b2ff62c'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:28.359930 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-149fb84a-2f66-4626-bf04-ed5f2b2ff62c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '193ebd8629b741dda79fe56eebeaa495', 'request_id': 'req-149fb84a-2f66-4626-bf04-ed5f2b2ff62c'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:28.368275 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-149fb84a-2f66-4626-bf04-ed5f2b2ff62c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '193ebd8629b741dda79fe56eebeaa495', 'request_id': 'req-149fb84a-2f66-4626-bf04-ed5f2b2ff62c'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:28.382317 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-149fb84a-2f66-4626-bf04-ed5f2b2ff62c admin admin] The token cache is being invalidate because project 193ebd8629b741dda79fe56eebeaa495 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:00:28.382602 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-149fb84a-2f66-4626-bf04-ed5f2b2ff62c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:28.383247 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-149fb84a-2f66-4626-bf04-ed5f2b2ff62c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:28.384850 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1339/2670] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:00:28 2022] DELETE /identity/v3/projects/193ebd8629b741dda79fe56eebeaa495 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:28.390474 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23d6f7-8bcc-4364-8c49-6c651c83989b None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:28.390753 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23d6f7-8bcc-4364-8c49-6c651c83989b None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:28.391026 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23d6f7-8bcc-4364-8c49-6c651c83989b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:28.414509 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-cb23d6f7-8bcc-4364-8c49-6c651c83989b None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:28.415806 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-cb23d6f7-8bcc-4364-8c49-6c651c83989b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:28.494424 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1332/2671] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 21:00:28.564048 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a81ee6-9af9-4b13-ab7c-c2cb834a43b2 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:28.564810 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a81ee6-9af9-4b13-ab7c-c2cb834a43b2 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:28.564810 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a81ee6-9af9-4b13-ab7c-c2cb834a43b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:28.585475 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-87a81ee6-9af9-4b13-ab7c-c2cb834a43b2 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:28.586976 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-87a81ee6-9af9-4b13-ab7c-c2cb834a43b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:28.596686 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1340/2672] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:00:28.600902 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23d6f7-8bcc-4364-8c49-6c651c83989b None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:28.611323 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23d6f7-8bcc-4364-8c49-6c651c83989b None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:28.616013 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4be93-15ef-442e-8567-31a281b5d619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:28.616656 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4be93-15ef-442e-8567-31a281b5d619 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:28.616931 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4be93-15ef-442e-8567-31a281b5d619 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:28.617199 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4be93-15ef-442e-8567-31a281b5d619 admin admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:28.617923 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4be93-15ef-442e-8567-31a281b5d619 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 21:00:28.618223 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4be93-15ef-442e-8567-31a281b5d619 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:28.619860 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4be93-15ef-442e-8567-31a281b5d619 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:28.636110 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1333/2673] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 21:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 21:00:28.637253 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a81ee6-9af9-4b13-ab7c-c2cb834a43b2 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:28.648268 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a81ee6-9af9-4b13-ab7c-c2cb834a43b2 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:28.653424 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7fc04-aa93-4b63-b540-0fe689e19201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:28.654166 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7fc04-aa93-4b63-b540-0fe689e19201 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:28.655211 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7fc04-aa93-4b63-b540-0fe689e19201 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:28.655505 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7fc04-aa93-4b63-b540-0fe689e19201 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:28.656293 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7fc04-aa93-4b63-b540-0fe689e19201 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:28.658331 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7fc04-aa93-4b63-b540-0fe689e19201 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:28.686380 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1341/2674] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 21:00:28 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:00:28.690681 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4be93-15ef-442e-8567-31a281b5d619 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:28.701784 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4be93-15ef-442e-8567-31a281b5d619 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:28.806851 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77e17e-63e8-4276-ba36-89ab758c3690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:28.807640 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77e17e-63e8-4276-ba36-89ab758c3690 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:28.808046 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77e17e-63e8-4276-ba36-89ab758c3690 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:28.808325 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77e17e-63e8-4276-ba36-89ab758c3690 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:28.809045 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77e17e-63e8-4276-ba36-89ab758c3690 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:28.811588 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77e17e-63e8-4276-ba36-89ab758c3690 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:28.840526 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1334/2675] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 21:00:28 2022] POST /identity/v3/users => generated 287 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:00:28.842514 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7fc04-aa93-4b63-b540-0fe689e19201 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:28.858062 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7fc04-aa93-4b63-b540-0fe689e19201 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:28.867086 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db2aad-869b-43fe-adb6-b4bc748fc4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:28.868004 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db2aad-869b-43fe-adb6-b4bc748fc4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:28.868373 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db2aad-869b-43fe-adb6-b4bc748fc4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:28.868747 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db2aad-869b-43fe-adb6-b4bc748fc4d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:28.869665 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db2aad-869b-43fe-adb6-b4bc748fc4d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:28.871433 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db2aad-869b-43fe-adb6-b4bc748fc4d5 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:28.895881 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1342/2676] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:00:28.897274 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77e17e-63e8-4276-ba36-89ab758c3690 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:28.910071 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77e17e-63e8-4276-ba36-89ab758c3690 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:28.915778 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655cf5e-1d1f-448f-80f2-0c93fabba8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:28.916442 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655cf5e-1d1f-448f-80f2-0c93fabba8f3 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:28.916719 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655cf5e-1d1f-448f-80f2-0c93fabba8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:28.916992 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655cf5e-1d1f-448f-80f2-0c93fabba8f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:28.917741 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655cf5e-1d1f-448f-80f2-0c93fabba8f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:28.919445 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655cf5e-1d1f-448f-80f2-0c93fabba8f3 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:28.931493 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1335/2677] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 21:00:28.936470 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db2aad-869b-43fe-adb6-b4bc748fc4d5 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:28.946910 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db2aad-869b-43fe-adb6-b4bc748fc4d5 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:28.952672 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ca770-ad59-418a-9bd2-ed52701b56fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:28.953587 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ca770-ad59-418a-9bd2-ed52701b56fa admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:28.953935 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ca770-ad59-418a-9bd2-ed52701b56fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:28.954204 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ca770-ad59-418a-9bd2-ed52701b56fa admin admin] PATH_INFO: `/v3/projects/bb3b9f179ad24392a4858db70f6b4dc0/users/1774f109538d481fbe180c72ef200940/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:28.972269 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ca770-ad59-418a-9bd2-ed52701b56fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb3b9f179ad24392a4858db70f6b4dc0, user_id=1774f109538d481fbe180c72ef200940, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:28.975003 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ca770-ad59-418a-9bd2-ed52701b56fa admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:28.989936 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1343/2678] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:00:28 2022] PUT /identity/v3/projects/bb3b9f179ad24392a4858db70f6b4dc0/users/1774f109538d481fbe180c72ef200940/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:28.994958 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474e465-dbf6-4e3c-b30a-84e138926246 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:28.995334 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474e465-dbf6-4e3c-b30a-84e138926246 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:28.995676 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474e465-dbf6-4e3c-b30a-84e138926246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:29.016838 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-9474e465-dbf6-4e3c-b30a-84e138926246 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:29.018067 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-9474e465-dbf6-4e3c-b30a-84e138926246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:29.093646 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1336/2679] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:00:29.105089 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ca770-ad59-418a-9bd2-ed52701b56fa admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:29.107151 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-b23ca770-ad59-418a-9bd2-ed52701b56fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:29.192237 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ca770-ad59-418a-9bd2-ed52701b56fa admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:29.195938 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec41e05-8aff-4356-9c6c-da5fb575ed3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:29.196596 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec41e05-8aff-4356-9c6c-da5fb575ed3f service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:29.196872 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec41e05-8aff-4356-9c6c-da5fb575ed3f service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:29.197146 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec41e05-8aff-4356-9c6c-da5fb575ed3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:29.207954 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec41e05-8aff-4356-9c6c-da5fb575ed3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:29.209445 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec41e05-8aff-4356-9c6c-da5fb575ed3f service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:29.231968 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1344/2680] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:00:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:00:30.205146 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadeb559-b557-4189-9266-5c7278dfab16 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:30.205719 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadeb559-b557-4189-9266-5c7278dfab16 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:30.206011 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadeb559-b557-4189-9266-5c7278dfab16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:30.245133 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-eadeb559-b557-4189-9266-5c7278dfab16 None None] MFA Rules not processed for user `1774f109538d481fbe180c72ef200940`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:30.246598 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-eadeb559-b557-4189-9266-5c7278dfab16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:30.342213 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1337/2681] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:00:30.357421 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec41e05-8aff-4356-9c6c-da5fb575ed3f service neutron] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:30.359643 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-eec41e05-8aff-4356-9c6c-da5fb575ed3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:30.441953 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec41e05-8aff-4356-9c6c-da5fb575ed3f service neutron] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:30.450108 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844fb5d-b098-4386-9256-92fc67710a8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:30.451054 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844fb5d-b098-4386-9256-92fc67710a8e service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:30.451601 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844fb5d-b098-4386-9256-92fc67710a8e service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:30.452112 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844fb5d-b098-4386-9256-92fc67710a8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:30.466873 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844fb5d-b098-4386-9256-92fc67710a8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:30.468753 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844fb5d-b098-4386-9256-92fc67710a8e service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:30.479688 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1345/2682] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:00:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:00:39.595003 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08539e7d-2828-40bb-b9d3-fc8dcbe3c5da None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:39.596333 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08539e7d-2828-40bb-b9d3-fc8dcbe3c5da None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:39.596804 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08539e7d-2828-40bb-b9d3-fc8dcbe3c5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:39.631424 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-08539e7d-2828-40bb-b9d3-fc8dcbe3c5da None None] MFA Rules not processed for user `1774f109538d481fbe180c72ef200940`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:39.634169 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-08539e7d-2828-40bb-b9d3-fc8dcbe3c5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:39.647162 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1338/2683] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:00:46.952333 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844fb5d-b098-4386-9256-92fc67710a8e service cinder] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:46.967939 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844fb5d-b098-4386-9256-92fc67710a8e service cinder] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:46.973785 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43f989-a400-49bd-b63a-38188b0919bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:46.974471 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43f989-a400-49bd-b63a-38188b0919bb service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:46.974755 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43f989-a400-49bd-b63a-38188b0919bb service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:46.975032 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43f989-a400-49bd-b63a-38188b0919bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:46.977064 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-9f43f989-a400-49bd-b63a-38188b0919bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:46.993509 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43f989-a400-49bd-b63a-38188b0919bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:46.995076 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43f989-a400-49bd-b63a-38188b0919bb service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:47.008124 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1346/2684] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:00:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:00:49.056931 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08539e7d-2828-40bb-b9d3-fc8dcbe3c5da None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:49.058645 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-08539e7d-2828-40bb-b9d3-fc8dcbe3c5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:49.073973 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08539e7d-2828-40bb-b9d3-fc8dcbe3c5da None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:49.079588 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2c75d-88f9-42d4-b950-2e15cb1a8c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:49.080471 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2c75d-88f9-42d4-b950-2e15cb1a8c31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:49.080755 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2c75d-88f9-42d4-b950-2e15cb1a8c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:49.081033 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2c75d-88f9-42d4-b950-2e15cb1a8c31 admin admin] PATH_INFO: `/v3/users/111964d1b2904405a463848a7ab1c610` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:49.082359 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2c75d-88f9-42d4-b950-2e15cb1a8c31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=111964d1b2904405a463848a7ab1c610)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:49.084390 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2c75d-88f9-42d4-b950-2e15cb1a8c31 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:49.161286 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-96d2c75d-88f9-42d4-b950-2e15cb1a8c31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '111964d1b2904405a463848a7ab1c610'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:49.174983 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-96d2c75d-88f9-42d4-b950-2e15cb1a8c31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '111964d1b2904405a463848a7ab1c610'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:49.176133 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-96d2c75d-88f9-42d4-b950-2e15cb1a8c31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '111964d1b2904405a463848a7ab1c610'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:49.197438 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-96d2c75d-88f9-42d4-b950-2e15cb1a8c31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '111964d1b2904405a463848a7ab1c610'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:49.198568 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-96d2c75d-88f9-42d4-b950-2e15cb1a8c31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '111964d1b2904405a463848a7ab1c610'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:49.221864 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1339/2685] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:00:49 2022] DELETE /identity/v3/users/111964d1b2904405a463848a7ab1c610 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 21:00:49.229242 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ff654-8595-421c-bd0b-0ec692ee5c4d None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:49.230040 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ff654-8595-421c-bd0b-0ec692ee5c4d None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:49.230040 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ff654-8595-421c-bd0b-0ec692ee5c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:49.253806 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-481ff654-8595-421c-bd0b-0ec692ee5c4d None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:49.255360 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-481ff654-8595-421c-bd0b-0ec692ee5c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:49.349892 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1347/2686] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:00:49.361793 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2c75d-88f9-42d4-b950-2e15cb1a8c31 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:49.363286 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-96d2c75d-88f9-42d4-b950-2e15cb1a8c31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:49.485398 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ff654-8595-421c-bd0b-0ec692ee5c4d None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:49.487821 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-481ff654-8595-421c-bd0b-0ec692ee5c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:49.495786 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2c75d-88f9-42d4-b950-2e15cb1a8c31 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:49.503589 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a9525-db53-4bd8-bf25-e039faf5d62c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:49.505585 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a9525-db53-4bd8-bf25-e039faf5d62c service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:49.506381 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a9525-db53-4bd8-bf25-e039faf5d62c service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:49.507140 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a9525-db53-4bd8-bf25-e039faf5d62c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:49.528239 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a9525-db53-4bd8-bf25-e039faf5d62c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:49.532822 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a9525-db53-4bd8-bf25-e039faf5d62c service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:49.564159 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1340/2687] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:00:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:00:49.661376 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ff654-8595-421c-bd0b-0ec692ee5c4d None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:49.684853 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fcae4-4806-4147-b585-98f13c6ae1f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '938634e835b94a75af698aef6941958f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:49.687799 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fcae4-4806-4147-b585-98f13c6ae1f6 service placement] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:49.688134 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fcae4-4806-4147-b585-98f13c6ae1f6 service placement] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:49.688351 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fcae4-4806-4147-b585-98f13c6ae1f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:49.694679 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-219fcae4-4806-4147-b585-98f13c6ae1f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:49.716311 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219fcae4-4806-4147-b585-98f13c6ae1f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:49.719836 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219fcae4-4806-4147-b585-98f13c6ae1f6 service placement] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:49.740151 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1348/2688] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:00:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 21:00:50.548624 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a9525-db53-4bd8-bf25-e039faf5d62c service neutron] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:50.551591 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-f82a9525-db53-4bd8-bf25-e039faf5d62c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:50.573721 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a9525-db53-4bd8-bf25-e039faf5d62c service neutron] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:50.590152 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ef826-258c-4a34-a60c-3e7a74da73f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:50.593937 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ef826-258c-4a34-a60c-3e7a74da73f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:50.595142 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ef826-258c-4a34-a60c-3e7a74da73f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:50.596171 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ef826-258c-4a34-a60c-3e7a74da73f9 admin admin] PATH_INFO: `/v3/projects/00577c1f18014c8b9f5bf7ab29802c98` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:50.598909 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ef826-258c-4a34-a60c-3e7a74da73f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00577c1f18014c8b9f5bf7ab29802c98)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:50.604704 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ef826-258c-4a34-a60c-3e7a74da73f9 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:50.702105 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-ee7ef826-258c-4a34-a60c-3e7a74da73f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00577c1f18014c8b9f5bf7ab29802c98', 'request_id': 'req-ee7ef826-258c-4a34-a60c-3e7a74da73f9'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:50.710149 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-ee7ef826-258c-4a34-a60c-3e7a74da73f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00577c1f18014c8b9f5bf7ab29802c98', 'request_id': 'req-ee7ef826-258c-4a34-a60c-3e7a74da73f9'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:50.721253 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-ee7ef826-258c-4a34-a60c-3e7a74da73f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00577c1f18014c8b9f5bf7ab29802c98', 'request_id': 'req-ee7ef826-258c-4a34-a60c-3e7a74da73f9'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:50.744913 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-ee7ef826-258c-4a34-a60c-3e7a74da73f9 admin admin] The token cache is being invalidate because project 00577c1f18014c8b9f5bf7ab29802c98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:00:50.745917 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-ee7ef826-258c-4a34-a60c-3e7a74da73f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:50.747100 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-ee7ef826-258c-4a34-a60c-3e7a74da73f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:50.754237 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1341/2689] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:00:50 2022] DELETE /identity/v3/projects/00577c1f18014c8b9f5bf7ab29802c98 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:50.756701 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3201bc-ed62-43df-b326-3fb7a123acd9 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:50.756701 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3201bc-ed62-43df-b326-3fb7a123acd9 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:50.757348 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3201bc-ed62-43df-b326-3fb7a123acd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:50.785797 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-3b3201bc-ed62-43df-b326-3fb7a123acd9 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:50.787296 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-3b3201bc-ed62-43df-b326-3fb7a123acd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:50.866251 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1349/2690] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 21:00:50.876716 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921b73d-ef60-4a2f-bf57-e41cc2e28c3b None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:50.877556 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921b73d-ef60-4a2f-bf57-e41cc2e28c3b None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:50.878363 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921b73d-ef60-4a2f-bf57-e41cc2e28c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:50.926351 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-b921b73d-ef60-4a2f-bf57-e41cc2e28c3b None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:50.928217 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-b921b73d-ef60-4a2f-bf57-e41cc2e28c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:50.943860 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1342/2691] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:00:50.951452 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3201bc-ed62-43df-b326-3fb7a123acd9 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:50.991853 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3201bc-ed62-43df-b326-3fb7a123acd9 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:50.999680 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0116bb-2fc4-4de4-8f9c-e3b97af0e8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:51.000963 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0116bb-2fc4-4de4-8f9c-e3b97af0e8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:51.001474 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0116bb-2fc4-4de4-8f9c-e3b97af0e8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:51.001939 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0116bb-2fc4-4de4-8f9c-e3b97af0e8d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:51.003080 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0116bb-2fc4-4de4-8f9c-e3b97af0e8d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 21:00:51.003650 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0116bb-2fc4-4de4-8f9c-e3b97af0e8d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:51.005837 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0116bb-2fc4-4de4-8f9c-e3b97af0e8d0 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:51.029335 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1350/2692] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 21:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 21:00:51.037572 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921b73d-ef60-4a2f-bf57-e41cc2e28c3b None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:51.051459 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921b73d-ef60-4a2f-bf57-e41cc2e28c3b None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:51.058363 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ed6ef-bbc4-4d85-8b69-edeb69ac7930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:51.059066 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ed6ef-bbc4-4d85-8b69-edeb69ac7930 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:51.060688 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ed6ef-bbc4-4d85-8b69-edeb69ac7930 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:51.061180 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ed6ef-bbc4-4d85-8b69-edeb69ac7930 admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:51.062302 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ed6ef-bbc4-4d85-8b69-edeb69ac7930 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:51.064725 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ed6ef-bbc4-4d85-8b69-edeb69ac7930 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:51.110163 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1343/2693] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 21:00:51 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 21:00:51.124166 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0116bb-2fc4-4de4-8f9c-e3b97af0e8d0 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:51.141948 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0116bb-2fc4-4de4-8f9c-e3b97af0e8d0 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:51.253719 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943190a2-d7d9-4c73-b106-5c4be14bfa75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:51.255411 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943190a2-d7d9-4c73-b106-5c4be14bfa75 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:51.255853 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943190a2-d7d9-4c73-b106-5c4be14bfa75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:51.256266 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943190a2-d7d9-4c73-b106-5c4be14bfa75 admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:51.257171 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943190a2-d7d9-4c73-b106-5c4be14bfa75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:51.261315 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943190a2-d7d9-4c73-b106-5c4be14bfa75 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:51.299186 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ed6ef-bbc4-4d85-8b69-edeb69ac7930 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:51.307024 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1351/2694] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 21:00:51 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:00:51.312148 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ed6ef-bbc4-4d85-8b69-edeb69ac7930 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:51.317419 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7df38-bd7b-4d35-86a7-11108503cfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:51.318109 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7df38-bd7b-4d35-86a7-11108503cfb1 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:51.318384 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7df38-bd7b-4d35-86a7-11108503cfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:51.318652 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7df38-bd7b-4d35-86a7-11108503cfb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:51.319405 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7df38-bd7b-4d35-86a7-11108503cfb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:51.321167 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7df38-bd7b-4d35-86a7-11108503cfb1 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:51.334735 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1344/2695] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:00:51.339002 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943190a2-d7d9-4c73-b106-5c4be14bfa75 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:51.354762 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943190a2-d7d9-4c73-b106-5c4be14bfa75 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:51.362663 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9c1fd-e237-464c-a0c8-c65c2156606e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:51.363533 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9c1fd-e237-464c-a0c8-c65c2156606e admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:51.363903 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9c1fd-e237-464c-a0c8-c65c2156606e admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:51.364477 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9c1fd-e237-464c-a0c8-c65c2156606e admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:51.365251 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9c1fd-e237-464c-a0c8-c65c2156606e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:51.367573 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9c1fd-e237-464c-a0c8-c65c2156606e admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:51.387977 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7df38-bd7b-4d35-86a7-11108503cfb1 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:51.389365 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1352/2696] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:00:51.419694 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7df38-bd7b-4d35-86a7-11108503cfb1 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:51.444302 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c6ae2-a1d8-4f2f-b868-352dc4d3f202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:51.445814 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c6ae2-a1d8-4f2f-b868-352dc4d3f202 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:51.446643 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c6ae2-a1d8-4f2f-b868-352dc4d3f202 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:51.446835 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c6ae2-a1d8-4f2f-b868-352dc4d3f202 admin admin] PATH_INFO: `/v3/projects/a2ca6052d1b140e5a90e38d9252d5fd6/users/37094f974c164d50890b46d0581ebf9c/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:51.480018 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c6ae2-a1d8-4f2f-b868-352dc4d3f202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2ca6052d1b140e5a90e38d9252d5fd6, user_id=37094f974c164d50890b46d0581ebf9c, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:51.483960 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c6ae2-a1d8-4f2f-b868-352dc4d3f202 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:51.503960 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1345/2697] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:00:51 2022] PUT /identity/v3/projects/a2ca6052d1b140e5a90e38d9252d5fd6/users/37094f974c164d50890b46d0581ebf9c/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:51.510865 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe4eb1-f912-4cb0-8482-57006362a7af None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:51.511511 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe4eb1-f912-4cb0-8482-57006362a7af None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:51.512225 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe4eb1-f912-4cb0-8482-57006362a7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:51.564820 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-c6fe4eb1-f912-4cb0-8482-57006362a7af None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:51.567155 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-c6fe4eb1-f912-4cb0-8482-57006362a7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:51.715340 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1353/2698] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:00:51.738210 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c6ae2-a1d8-4f2f-b868-352dc4d3f202 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:51.742061 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-0a7c6ae2-a1d8-4f2f-b868-352dc4d3f202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:51.866124 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c6ae2-a1d8-4f2f-b868-352dc4d3f202 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:51.870969 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927fa68-953d-4767-86ac-d693ec51e1ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:51.871647 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927fa68-953d-4767-86ac-d693ec51e1ca service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:51.871997 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927fa68-953d-4767-86ac-d693ec51e1ca service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:51.872358 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927fa68-953d-4767-86ac-d693ec51e1ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:51.885580 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927fa68-953d-4767-86ac-d693ec51e1ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:51.888449 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927fa68-953d-4767-86ac-d693ec51e1ca service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:51.908172 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1346/2699] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:00:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:00:53.163114 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe4eb1-f912-4cb0-8482-57006362a7af None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:53.165622 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-c6fe4eb1-f912-4cb0-8482-57006362a7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:53.274972 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927fa68-953d-4767-86ac-d693ec51e1ca service neutron] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:53.279141 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-b927fa68-953d-4767-86ac-d693ec51e1ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:53.311589 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe4eb1-f912-4cb0-8482-57006362a7af None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:53.331893 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927fa68-953d-4767-86ac-d693ec51e1ca service neutron] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:53.334778 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff5d68-c96a-40dc-918e-900de7a38ce0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '938634e835b94a75af698aef6941958f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:53.335472 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff5d68-c96a-40dc-918e-900de7a38ce0 service placement] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:53.335784 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff5d68-c96a-40dc-918e-900de7a38ce0 service placement] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:53.336257 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff5d68-c96a-40dc-918e-900de7a38ce0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:53.338620 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-7dff5d68-c96a-40dc-918e-900de7a38ce0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:53.341770 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ac040-4f8b-41b2-b3ac-ef68c7a306a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:53.344771 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ac040-4f8b-41b2-b3ac-ef68c7a306a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:53.345379 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ac040-4f8b-41b2-b3ac-ef68c7a306a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:53.346733 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ac040-4f8b-41b2-b3ac-ef68c7a306a7 admin admin] PATH_INFO: `/v3/users/7781cf44c6cb47a8adac1e187e9a8dac` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:53.351367 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ac040-4f8b-41b2-b3ac-ef68c7a306a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7781cf44c6cb47a8adac1e187e9a8dac)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:53.356586 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ac040-4f8b-41b2-b3ac-ef68c7a306a7 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:53.357989 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff5d68-c96a-40dc-918e-900de7a38ce0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:53.360293 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff5d68-c96a-40dc-918e-900de7a38ce0 service placement] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:53.376274 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1354/2700] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:00:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 21:00:53.465265 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-1f6ac040-4f8b-41b2-b3ac-ef68c7a306a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7781cf44c6cb47a8adac1e187e9a8dac'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:53.486582 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-1f6ac040-4f8b-41b2-b3ac-ef68c7a306a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7781cf44c6cb47a8adac1e187e9a8dac'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:53.488225 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-1f6ac040-4f8b-41b2-b3ac-ef68c7a306a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7781cf44c6cb47a8adac1e187e9a8dac'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:53.511213 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-1f6ac040-4f8b-41b2-b3ac-ef68c7a306a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7781cf44c6cb47a8adac1e187e9a8dac'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:53.512281 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-1f6ac040-4f8b-41b2-b3ac-ef68c7a306a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7781cf44c6cb47a8adac1e187e9a8dac'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:53.534406 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1347/2701] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:00:53 2022] DELETE /identity/v3/users/7781cf44c6cb47a8adac1e187e9a8dac => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 21:00:54.048233 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff5d68-c96a-40dc-918e-900de7a38ce0 service placement] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:54.066831 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff5d68-c96a-40dc-918e-900de7a38ce0 service placement] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:54.215732 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccddb1b-a853-4d9f-990f-a9b773f819ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:54.217981 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccddb1b-a853-4d9f-990f-a9b773f819ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:54.218754 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccddb1b-a853-4d9f-990f-a9b773f819ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:54.219508 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccddb1b-a853-4d9f-990f-a9b773f819ca admin admin] PATH_INFO: `/v3/projects/908c94b386f2491aa46bed4be1d5ea84` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:54.222153 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccddb1b-a853-4d9f-990f-a9b773f819ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=908c94b386f2491aa46bed4be1d5ea84)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:54.228167 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccddb1b-a853-4d9f-990f-a9b773f819ca admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:54.378545 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-fccddb1b-a853-4d9f-990f-a9b773f819ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '908c94b386f2491aa46bed4be1d5ea84', 'request_id': 'req-fccddb1b-a853-4d9f-990f-a9b773f819ca'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:54.403673 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-fccddb1b-a853-4d9f-990f-a9b773f819ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '908c94b386f2491aa46bed4be1d5ea84', 'request_id': 'req-fccddb1b-a853-4d9f-990f-a9b773f819ca'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:54.422035 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-fccddb1b-a853-4d9f-990f-a9b773f819ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '908c94b386f2491aa46bed4be1d5ea84', 'request_id': 'req-fccddb1b-a853-4d9f-990f-a9b773f819ca'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:54.439429 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-fccddb1b-a853-4d9f-990f-a9b773f819ca admin admin] The token cache is being invalidate because project 908c94b386f2491aa46bed4be1d5ea84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:00:54.440020 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-fccddb1b-a853-4d9f-990f-a9b773f819ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:54.441000 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-fccddb1b-a853-4d9f-990f-a9b773f819ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:00:54.443925 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1355/2702] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:00:54 2022] DELETE /identity/v3/projects/908c94b386f2491aa46bed4be1d5ea84 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:00:54.450073 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c35f5-106c-4817-9a50-599baddddf5d None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:54.451472 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c35f5-106c-4817-9a50-599baddddf5d None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:54.451969 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c35f5-106c-4817-9a50-599baddddf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:54.544104 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-a62c35f5-106c-4817-9a50-599baddddf5d None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:54.559219 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-a62c35f5-106c-4817-9a50-599baddddf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:54.718851 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1348/2703] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:00:54.727415 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2ee3e-fcd7-4fa0-8f27-4c50fec380a1 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:54.727700 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2ee3e-fcd7-4fa0-8f27-4c50fec380a1 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:54.728203 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2ee3e-fcd7-4fa0-8f27-4c50fec380a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:54.751192 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-03e2ee3e-fcd7-4fa0-8f27-4c50fec380a1 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:54.752507 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-03e2ee3e-fcd7-4fa0-8f27-4c50fec380a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:54.761829 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1356/2704] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:00:54.767607 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c35f5-106c-4817-9a50-599baddddf5d None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:54.778805 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c35f5-106c-4817-9a50-599baddddf5d None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:54.785302 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbe0ed-a2bf-4307-b9f8-6f9843eb809c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:54.786425 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbe0ed-a2bf-4307-b9f8-6f9843eb809c admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:54.786873 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbe0ed-a2bf-4307-b9f8-6f9843eb809c admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:54.787305 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbe0ed-a2bf-4307-b9f8-6f9843eb809c admin admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:54.789078 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbe0ed-a2bf-4307-b9f8-6f9843eb809c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 21:00:54.789596 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbe0ed-a2bf-4307-b9f8-6f9843eb809c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:54.793749 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbe0ed-a2bf-4307-b9f8-6f9843eb809c admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:54.812297 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1349/2705] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 21:00:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 21:00:54.817147 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2ee3e-fcd7-4fa0-8f27-4c50fec380a1 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:54.827840 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2ee3e-fcd7-4fa0-8f27-4c50fec380a1 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:54.833328 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff9bfd-f9d7-44f1-a1ea-72596d77c5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:54.834339 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff9bfd-f9d7-44f1-a1ea-72596d77c5f7 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:54.834853 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff9bfd-f9d7-44f1-a1ea-72596d77c5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:54.835336 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff9bfd-f9d7-44f1-a1ea-72596d77c5f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:54.836311 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff9bfd-f9d7-44f1-a1ea-72596d77c5f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:54.838537 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff9bfd-f9d7-44f1-a1ea-72596d77c5f7 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:54.894346 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1357/2706] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 21:00:54 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:00:54.896173 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbe0ed-a2bf-4307-b9f8-6f9843eb809c admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:54.924476 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbe0ed-a2bf-4307-b9f8-6f9843eb809c admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:55.019769 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f775cb-fbfe-4634-965b-b7bf80bc808c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:55.020820 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f775cb-fbfe-4634-965b-b7bf80bc808c admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:55.020820 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f775cb-fbfe-4634-965b-b7bf80bc808c admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:55.021035 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f775cb-fbfe-4634-965b-b7bf80bc808c admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:55.021714 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f775cb-fbfe-4634-965b-b7bf80bc808c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:55.024079 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f775cb-fbfe-4634-965b-b7bf80bc808c admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:55.055657 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1350/2707] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 21:00:54 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:00:55.057056 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff9bfd-f9d7-44f1-a1ea-72596d77c5f7 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:55.068974 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff9bfd-f9d7-44f1-a1ea-72596d77c5f7 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:55.076756 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0cc0a3-c967-4a56-bdb6-c13c0f80c7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:55.078111 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cc0a3-c967-4a56-bdb6-c13c0f80c7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:55.078596 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cc0a3-c967-4a56-bdb6-c13c0f80c7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:55.078941 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cc0a3-c967-4a56-bdb6-c13c0f80c7a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:55.080341 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0cc0a3-c967-4a56-bdb6-c13c0f80c7a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:55.083542 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0cc0a3-c967-4a56-bdb6-c13c0f80c7a8 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:55.106439 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1358/2708] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 21:00:55.110270 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f775cb-fbfe-4634-965b-b7bf80bc808c admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:55.124109 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f775cb-fbfe-4634-965b-b7bf80bc808c admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:55.132368 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b628e-8b93-4eda-a607-e321eb596f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:55.133984 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b628e-8b93-4eda-a607-e321eb596f79 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:55.134732 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b628e-8b93-4eda-a607-e321eb596f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:55.135179 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b628e-8b93-4eda-a607-e321eb596f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:55.136675 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b628e-8b93-4eda-a607-e321eb596f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:55.140905 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b628e-8b93-4eda-a607-e321eb596f79 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:55.167797 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1351/2709] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 21:00:55.171545 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0cc0a3-c967-4a56-bdb6-c13c0f80c7a8 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:55.200096 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0cc0a3-c967-4a56-bdb6-c13c0f80c7a8 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:55.207275 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56751a9-4262-4455-b9f9-bbc3aeb59865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:55.208507 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56751a9-4262-4455-b9f9-bbc3aeb59865 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:55.208983 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56751a9-4262-4455-b9f9-bbc3aeb59865 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:55.209440 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56751a9-4262-4455-b9f9-bbc3aeb59865 admin admin] PATH_INFO: `/v3/projects/a641154296d443e6896c6762b8288c3b/users/3b10b7b43da44aa795ce9679123fe0a7/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:55.240270 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56751a9-4262-4455-b9f9-bbc3aeb59865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a641154296d443e6896c6762b8288c3b, user_id=3b10b7b43da44aa795ce9679123fe0a7, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:55.245604 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56751a9-4262-4455-b9f9-bbc3aeb59865 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:55.270566 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1359/2710] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:00:55 2022] PUT /identity/v3/projects/a641154296d443e6896c6762b8288c3b/users/3b10b7b43da44aa795ce9679123fe0a7/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 21:00:55.296994 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9895b-191b-495a-aaf7-afe7530198c4 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:55.297861 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9895b-191b-495a-aaf7-afe7530198c4 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:55.309149 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9895b-191b-495a-aaf7-afe7530198c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:55.361245 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-61b9895b-191b-495a-aaf7-afe7530198c4 None None] MFA Rules not processed for user `3b10b7b43da44aa795ce9679123fe0a7`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:55.363140 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-61b9895b-191b-495a-aaf7-afe7530198c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:55.511950 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1352/2711] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:00:55.525733 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56751a9-4262-4455-b9f9-bbc3aeb59865 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:55.527562 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-a56751a9-4262-4455-b9f9-bbc3aeb59865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:55.733806 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56751a9-4262-4455-b9f9-bbc3aeb59865 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:55.755421 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87392c6f-17b4-40be-9967-433f7f8a9914 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:55.757116 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87392c6f-17b4-40be-9967-433f7f8a9914 service nova] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:55.757812 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87392c6f-17b4-40be-9967-433f7f8a9914 service nova] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:55.758439 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87392c6f-17b4-40be-9967-433f7f8a9914 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:55.780484 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87392c6f-17b4-40be-9967-433f7f8a9914 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:55.782290 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87392c6f-17b4-40be-9967-433f7f8a9914 service nova] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:55.805525 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1360/2712] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:00:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 21:00:59.208239 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9895b-191b-495a-aaf7-afe7530198c4 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:59.211416 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-61b9895b-191b-495a-aaf7-afe7530198c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:59.218598 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b323597-a4fb-4cae-9853-7893ebc5d0f8 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:59.228234 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b323597-a4fb-4cae-9853-7893ebc5d0f8 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:59.228813 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b323597-a4fb-4cae-9853-7893ebc5d0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:59.305890 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-9b323597-a4fb-4cae-9853-7893ebc5d0f8 None None] MFA Rules not processed for user `37094f974c164d50890b46d0581ebf9c`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:00:59.308083 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-9b323597-a4fb-4cae-9853-7893ebc5d0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:59.375082 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9895b-191b-495a-aaf7-afe7530198c4 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:59.382275 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181db8cb-dbb4-4ec9-96fa-acf12a627231 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:59.384046 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181db8cb-dbb4-4ec9-96fa-acf12a627231 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:59.384767 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181db8cb-dbb4-4ec9-96fa-acf12a627231 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:59.385478 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181db8cb-dbb4-4ec9-96fa-acf12a627231 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:59.389442 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-181db8cb-dbb4-4ec9-96fa-acf12a627231 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:59.540811 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1361/2713] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:00:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:00:59.545340 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b323597-a4fb-4cae-9853-7893ebc5d0f8 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:59.548258 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-9b323597-a4fb-4cae-9853-7893ebc5d0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:00:59.585969 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181db8cb-dbb4-4ec9-96fa-acf12a627231 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:59.589426 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181db8cb-dbb4-4ec9-96fa-acf12a627231 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:59.612839 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1353/2714] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:00:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:00:59.779308 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b323597-a4fb-4cae-9853-7893ebc5d0f8 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:00:59.789632 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc09668-0863-4a2e-a5b9-65be0b26ba40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:00:59.791588 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc09668-0863-4a2e-a5b9-65be0b26ba40 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:00:59.795103 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc09668-0863-4a2e-a5b9-65be0b26ba40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:00:59.796401 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc09668-0863-4a2e-a5b9-65be0b26ba40 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:00:59.798290 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc09668-0863-4a2e-a5b9-65be0b26ba40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:00:59.804491 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc09668-0863-4a2e-a5b9-65be0b26ba40 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:00:59.884617 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181db8cb-dbb4-4ec9-96fa-acf12a627231 service neutron] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:00:59.897335 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1362/2715] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 21:00:59 2022] POST /identity/v3/projects => generated 383 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 21:00:59.905388 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181db8cb-dbb4-4ec9-96fa-acf12a627231 service neutron] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:00.113787 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f30fe0-0157-4f2e-8cf4-8f93ac6e3f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:00.115138 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f30fe0-0157-4f2e-8cf4-8f93ac6e3f5d admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:00.115626 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f30fe0-0157-4f2e-8cf4-8f93ac6e3f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:00.116147 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f30fe0-0157-4f2e-8cf4-8f93ac6e3f5d admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:00.117463 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f30fe0-0157-4f2e-8cf4-8f93ac6e3f5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:00.121185 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f30fe0-0157-4f2e-8cf4-8f93ac6e3f5d admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:00.163962 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1354/2716] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 21:00:59 2022] POST /identity/v3/users => generated 298 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 21:01:00.167945 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc09668-0863-4a2e-a5b9-65be0b26ba40 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:00.184365 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc09668-0863-4a2e-a5b9-65be0b26ba40 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:00.199852 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7849a-83ae-4363-b77c-7f2425987aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:00.201126 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7849a-83ae-4363-b77c-7f2425987aca admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:00.201403 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7849a-83ae-4363-b77c-7f2425987aca admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:00.201669 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7849a-83ae-4363-b77c-7f2425987aca admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:00.202411 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a7849a-83ae-4363-b77c-7f2425987aca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:00.204098 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a7849a-83ae-4363-b77c-7f2425987aca admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:00.232963 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1363/2717] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:01:00.241533 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f30fe0-0157-4f2e-8cf4-8f93ac6e3f5d admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:00.264806 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f30fe0-0157-4f2e-8cf4-8f93ac6e3f5d admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:00.294760 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d8bc9-f96a-4274-a344-748c08c20003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:00.296867 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d8bc9-f96a-4274-a344-748c08c20003 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:00.297657 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d8bc9-f96a-4274-a344-748c08c20003 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:00.298397 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d8bc9-f96a-4274-a344-748c08c20003 admin admin] PATH_INFO: `/v3/projects/97611f6926764d3c89aa0dfbf332330e/users/2403d027c96b4e689c06443518cd19aa/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:00.333007 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7d8bc9-f96a-4274-a344-748c08c20003 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97611f6926764d3c89aa0dfbf332330e, user_id=2403d027c96b4e689c06443518cd19aa, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:00.336338 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7d8bc9-f96a-4274-a344-748c08c20003 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:00.372560 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1355/2718] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:01:00 2022] PUT /identity/v3/projects/97611f6926764d3c89aa0dfbf332330e/users/2403d027c96b4e689c06443518cd19aa/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 21:01:00.374310 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7849a-83ae-4363-b77c-7f2425987aca admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:00.391337 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7849a-83ae-4363-b77c-7f2425987aca admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:00.475283 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6588cc-0a74-41aa-9a64-dc96068a4c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:00.476218 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6588cc-0a74-41aa-9a64-dc96068a4c79 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:00.476547 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6588cc-0a74-41aa-9a64-dc96068a4c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:00.476786 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6588cc-0a74-41aa-9a64-dc96068a4c79 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:00.478258 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6588cc-0a74-41aa-9a64-dc96068a4c79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:00.483840 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6588cc-0a74-41aa-9a64-dc96068a4c79 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:00.526124 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1364/2719] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:01:00.537445 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d8bc9-f96a-4274-a344-748c08c20003 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:00.583641 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d8bc9-f96a-4274-a344-748c08c20003 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:00.593414 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9ae36-1a70-4826-b6f8-eb3cf23cd692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:00.595274 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9ae36-1a70-4826-b6f8-eb3cf23cd692 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:00.596033 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9ae36-1a70-4826-b6f8-eb3cf23cd692 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:00.597045 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9ae36-1a70-4826-b6f8-eb3cf23cd692 admin admin] PATH_INFO: `/v3/projects/97611f6926764d3c89aa0dfbf332330e/users/2403d027c96b4e689c06443518cd19aa/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:00.603227 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9ae36-1a70-4826-b6f8-eb3cf23cd692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97611f6926764d3c89aa0dfbf332330e, user_id=2403d027c96b4e689c06443518cd19aa, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:00.608338 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9ae36-1a70-4826-b6f8-eb3cf23cd692 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:00.636448 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1356/2720] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:01:00 2022] PUT /identity/v3/projects/97611f6926764d3c89aa0dfbf332330e/users/2403d027c96b4e689c06443518cd19aa/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:01:07.284290 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69913c1d-a450-4eb0-a77c-d0ca6e28b9ec None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:07.285179 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69913c1d-a450-4eb0-a77c-d0ca6e28b9ec None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:07.285179 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69913c1d-a450-4eb0-a77c-d0ca6e28b9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:07.306693 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-69913c1d-a450-4eb0-a77c-d0ca6e28b9ec None None] MFA Rules not processed for user `0e7a065d7e5f442fb841328777b64d51`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:01:07.308050 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-69913c1d-a450-4eb0-a77c-d0ca6e28b9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:01:07.393730 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1365/2721] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:01:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:01:08.802413 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159929a-3f4a-4b87-9a27-79e231a7e85f None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:08.803300 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159929a-3f4a-4b87-9a27-79e231a7e85f None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:08.803877 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159929a-3f4a-4b87-9a27-79e231a7e85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:08.866095 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-2159929a-3f4a-4b87-9a27-79e231a7e85f None None] MFA Rules not processed for user `2403d027c96b4e689c06443518cd19aa`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:01:08.867836 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-2159929a-3f4a-4b87-9a27-79e231a7e85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:01:08.991110 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1357/2722] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:01:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 21:01:09.013318 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69913c1d-a450-4eb0-a77c-d0ca6e28b9ec None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:09.016057 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-69913c1d-a450-4eb0-a77c-d0ca6e28b9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:01:09.079956 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010ab2b-5f33-4e6f-b570-9ed1829b1807 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:09.081010 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010ab2b-5f33-4e6f-b570-9ed1829b1807 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:09.081348 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010ab2b-5f33-4e6f-b570-9ed1829b1807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:09.122890 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-6010ab2b-5f33-4e6f-b570-9ed1829b1807 None None] MFA Rules not processed for user `1774f109538d481fbe180c72ef200940`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:01:09.125571 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-6010ab2b-5f33-4e6f-b570-9ed1829b1807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:01:09.164066 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69913c1d-a450-4eb0-a77c-d0ca6e28b9ec None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:09.169820 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc35231-de37-43f8-84e5-2bccc6b32909 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05029a41bd2b42febfd5ce91a3f28c24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:09.171285 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc35231-de37-43f8-84e5-2bccc6b32909 service glance] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:09.171851 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc35231-de37-43f8-84e5-2bccc6b32909 service glance] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:09.172362 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc35231-de37-43f8-84e5-2bccc6b32909 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:09.322221 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1358/2723] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:01:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 21:01:09.346367 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc35231-de37-43f8-84e5-2bccc6b32909 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:09.349231 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc35231-de37-43f8-84e5-2bccc6b32909 service glance] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:09.386192 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1366/2724] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:01:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:01:09.549839 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce81742-a418-428d-a33f-a721e892bb41 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:09.550080 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce81742-a418-428d-a33f-a721e892bb41 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:09.550586 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce81742-a418-428d-a33f-a721e892bb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:09.604287 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-fce81742-a418-428d-a33f-a721e892bb41 None None] MFA Rules not processed for user `78cde480dd8b4a85ac30895026bfc406`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:01:09.607443 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-fce81742-a418-428d-a33f-a721e892bb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:01:09.728265 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1359/2725] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Oct 28 21:01:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:01:09.795621 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc35231-de37-43f8-84e5-2bccc6b32909 service glance] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:09.802272 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-6cc35231-de37-43f8-84e5-2bccc6b32909 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:01:09.987841 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc35231-de37-43f8-84e5-2bccc6b32909 service glance] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:09.995942 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecdbeb5-e467-45af-9ea7-07edbadbec5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d70db11d2d4923943bc6479bc49206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:09.996772 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdbeb5-e467-45af-9ea7-07edbadbec5f service swift] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:09.997882 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdbeb5-e467-45af-9ea7-07edbadbec5f service swift] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:09.998321 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdbeb5-e467-45af-9ea7-07edbadbec5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:10.009097 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecdbeb5-e467-45af-9ea7-07edbadbec5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:10.011224 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecdbeb5-e467-45af-9ea7-07edbadbec5f service swift] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:10.022780 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1367/2726] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Oct 28 21:01:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 21:01:10.332209 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce81742-a418-428d-a33f-a721e892bb41 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:10.435373 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce81742-a418-428d-a33f-a721e892bb41 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:10.443328 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c902d-8dc6-4a1d-bc0d-da285978b797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:10.444984 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c902d-8dc6-4a1d-bc0d-da285978b797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:10.445259 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c902d-8dc6-4a1d-bc0d-da285978b797 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:10.445718 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c902d-8dc6-4a1d-bc0d-da285978b797 admin admin] PATH_INFO: `/v3/users/3b10b7b43da44aa795ce9679123fe0a7` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:10.447391 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c902d-8dc6-4a1d-bc0d-da285978b797 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b10b7b43da44aa795ce9679123fe0a7)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:10.449913 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c902d-8dc6-4a1d-bc0d-da285978b797 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:10.533898 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-203c902d-8dc6-4a1d-bc0d-da285978b797 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b10b7b43da44aa795ce9679123fe0a7'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:01:10.553255 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-203c902d-8dc6-4a1d-bc0d-da285978b797 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b10b7b43da44aa795ce9679123fe0a7'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:01:10.560457 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-203c902d-8dc6-4a1d-bc0d-da285978b797 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b10b7b43da44aa795ce9679123fe0a7'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:01:10.603153 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-203c902d-8dc6-4a1d-bc0d-da285978b797 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b10b7b43da44aa795ce9679123fe0a7'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:01:10.604363 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-203c902d-8dc6-4a1d-bc0d-da285978b797 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b10b7b43da44aa795ce9679123fe0a7'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:01:10.647220 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1360/2727] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:01:10 2022] DELETE /identity/v3/users/3b10b7b43da44aa795ce9679123fe0a7 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:01:10.652224 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb6718-bad3-4988-b50d-e986401ea507 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:10.652549 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb6718-bad3-4988-b50d-e986401ea507 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:10.652768 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb6718-bad3-4988-b50d-e986401ea507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:10.681412 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-9cdb6718-bad3-4988-b50d-e986401ea507 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:01:10.683022 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-9cdb6718-bad3-4988-b50d-e986401ea507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:01:10.803725 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1368/2728] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:01:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:01:10.816371 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c902d-8dc6-4a1d-bc0d-da285978b797 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:10.819379 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-203c902d-8dc6-4a1d-bc0d-da285978b797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:01:10.996638 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c902d-8dc6-4a1d-bc0d-da285978b797 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:11.008988 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa86f23-75f0-473c-b85e-c134e6298b2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:11.009717 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa86f23-75f0-473c-b85e-c134e6298b2d service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:11.010249 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa86f23-75f0-473c-b85e-c134e6298b2d service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:11.010446 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa86f23-75f0-473c-b85e-c134e6298b2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:11.042042 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa86f23-75f0-473c-b85e-c134e6298b2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:11.044571 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa86f23-75f0-473c-b85e-c134e6298b2d service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:11.059296 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1361/2729] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:01:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 21:01:12.348420 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb6718-bad3-4988-b50d-e986401ea507 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:12.350138 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-9cdb6718-bad3-4988-b50d-e986401ea507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:01:12.383008 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb6718-bad3-4988-b50d-e986401ea507 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:12.395430 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa86f23-75f0-473c-b85e-c134e6298b2d service neutron] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:12.397633 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-7fa86f23-75f0-473c-b85e-c134e6298b2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:01:12.421202 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa86f23-75f0-473c-b85e-c134e6298b2d service neutron] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:12.424297 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0e48b-ce50-4aca-8818-eb993e182a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:12.432551 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0e48b-ce50-4aca-8818-eb993e182a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:12.435505 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0e48b-ce50-4aca-8818-eb993e182a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:12.436235 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0e48b-ce50-4aca-8818-eb993e182a34 admin admin] PATH_INFO: `/v3/projects/a641154296d443e6896c6762b8288c3b` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:12.437424 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fb10c-008c-4364-8bbb-24ead7285e62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:12.438148 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fb10c-008c-4364-8bbb-24ead7285e62 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:12.438455 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fb10c-008c-4364-8bbb-24ead7285e62 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:12.438748 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fb10c-008c-4364-8bbb-24ead7285e62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:12.440430 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0e48b-ce50-4aca-8818-eb993e182a34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a641154296d443e6896c6762b8288c3b)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:12.445726 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-e20fb10c-008c-4364-8bbb-24ead7285e62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:01:12.447811 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0e48b-ce50-4aca-8818-eb993e182a34 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:12.471386 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20fb10c-008c-4364-8bbb-24ead7285e62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:12.477578 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20fb10c-008c-4364-8bbb-24ead7285e62 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:12.501517 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1362/2730] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:01:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:01:12.610260 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-fbb0e48b-ce50-4aca-8818-eb993e182a34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a641154296d443e6896c6762b8288c3b', 'request_id': 'req-fbb0e48b-ce50-4aca-8818-eb993e182a34'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:01:12.643895 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-fbb0e48b-ce50-4aca-8818-eb993e182a34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a641154296d443e6896c6762b8288c3b', 'request_id': 'req-fbb0e48b-ce50-4aca-8818-eb993e182a34'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:01:12.662335 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-fbb0e48b-ce50-4aca-8818-eb993e182a34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a641154296d443e6896c6762b8288c3b', 'request_id': 'req-fbb0e48b-ce50-4aca-8818-eb993e182a34'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:01:12.716785 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-fbb0e48b-ce50-4aca-8818-eb993e182a34 admin admin] The token cache is being invalidate because project a641154296d443e6896c6762b8288c3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:01:12.719187 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-fbb0e48b-ce50-4aca-8818-eb993e182a34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:01:12.726422 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-fbb0e48b-ce50-4aca-8818-eb993e182a34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:01:12.736236 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1369/2731] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:01:12 2022] DELETE /identity/v3/projects/a641154296d443e6896c6762b8288c3b => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:01:12.742861 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7dde7-a42b-423d-a3c5-e6dc43b27eda None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:12.743185 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7dde7-a42b-423d-a3c5-e6dc43b27eda None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:12.743484 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7dde7-a42b-423d-a3c5-e6dc43b27eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:12.828257 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-f9e7dde7-a42b-423d-a3c5-e6dc43b27eda None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:01:12.832058 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-f9e7dde7-a42b-423d-a3c5-e6dc43b27eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:01:13.137250 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1363/2732] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:01:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:01:13.145871 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097c257-949d-47a7-9503-059a6020afde None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:13.146593 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097c257-949d-47a7-9503-059a6020afde None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:13.147555 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097c257-949d-47a7-9503-059a6020afde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:13.254083 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-3097c257-949d-47a7-9503-059a6020afde None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:01:13.255605 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-3097c257-949d-47a7-9503-059a6020afde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:01:13.285792 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1370/2733] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:01:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:01:13.291691 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7dde7-a42b-423d-a3c5-e6dc43b27eda None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:13.306639 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7dde7-a42b-423d-a3c5-e6dc43b27eda None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:13.320689 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0079c7c-badf-4ca7-a0d7-e607d9124471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:13.321402 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0079c7c-badf-4ca7-a0d7-e607d9124471 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:13.321894 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0079c7c-badf-4ca7-a0d7-e607d9124471 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:13.322175 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0079c7c-badf-4ca7-a0d7-e607d9124471 admin admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:13.322975 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0079c7c-badf-4ca7-a0d7-e607d9124471 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 21:01:13.326746 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0079c7c-badf-4ca7-a0d7-e607d9124471 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:13.326746 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0079c7c-badf-4ca7-a0d7-e607d9124471 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:13.369916 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1364/2734] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 21:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 21:01:13.371363 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097c257-949d-47a7-9503-059a6020afde None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:13.387925 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097c257-949d-47a7-9503-059a6020afde None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:13.407309 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad04964-c4e3-4405-a2c0-4b9d7eed2032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:13.408170 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad04964-c4e3-4405-a2c0-4b9d7eed2032 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:13.408448 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad04964-c4e3-4405-a2c0-4b9d7eed2032 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:13.409068 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad04964-c4e3-4405-a2c0-4b9d7eed2032 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:13.410141 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad04964-c4e3-4405-a2c0-4b9d7eed2032 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:13.416056 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad04964-c4e3-4405-a2c0-4b9d7eed2032 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:13.486419 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1371/2735] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 21:01:13 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 21:01:13.492768 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0079c7c-badf-4ca7-a0d7-e607d9124471 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:13.518014 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0079c7c-badf-4ca7-a0d7-e607d9124471 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:13.758259 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b223561-8eb0-4515-9fb6-5dcdac5c7a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:13.759597 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b223561-8eb0-4515-9fb6-5dcdac5c7a5e admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:13.759932 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b223561-8eb0-4515-9fb6-5dcdac5c7a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:13.762094 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b223561-8eb0-4515-9fb6-5dcdac5c7a5e admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:13.763137 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b223561-8eb0-4515-9fb6-5dcdac5c7a5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:13.772676 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b223561-8eb0-4515-9fb6-5dcdac5c7a5e admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:13.850104 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1365/2736] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 21:01:13 2022] POST /identity/v3/users => generated 287 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 21:01:13.856451 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad04964-c4e3-4405-a2c0-4b9d7eed2032 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:13.885288 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad04964-c4e3-4405-a2c0-4b9d7eed2032 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:13.904763 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d647b4-9170-42e3-805b-b5e0e9c6ea43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:13.906193 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d647b4-9170-42e3-805b-b5e0e9c6ea43 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:13.906887 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d647b4-9170-42e3-805b-b5e0e9c6ea43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:13.907580 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d647b4-9170-42e3-805b-b5e0e9c6ea43 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:13.909891 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d647b4-9170-42e3-805b-b5e0e9c6ea43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:13.913334 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d647b4-9170-42e3-805b-b5e0e9c6ea43 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:13.944715 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1372/2737] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:01:13.951618 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b223561-8eb0-4515-9fb6-5dcdac5c7a5e admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:13.984872 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b223561-8eb0-4515-9fb6-5dcdac5c7a5e admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:13.996115 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397ddb1-2423-4718-ad14-f8edb00d7222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:13.998086 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397ddb1-2423-4718-ad14-f8edb00d7222 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:13.998677 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397ddb1-2423-4718-ad14-f8edb00d7222 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:13.999245 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397ddb1-2423-4718-ad14-f8edb00d7222 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:14.001088 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397ddb1-2423-4718-ad14-f8edb00d7222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:14.005014 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397ddb1-2423-4718-ad14-f8edb00d7222 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:14.030955 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1366/2738] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:01:14.038089 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d647b4-9170-42e3-805b-b5e0e9c6ea43 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:14.113687 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d647b4-9170-42e3-805b-b5e0e9c6ea43 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:14.165140 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea68ce0-3f7c-4bc2-9a5a-070c3d04e359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:14.167560 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea68ce0-3f7c-4bc2-9a5a-070c3d04e359 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:14.168530 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea68ce0-3f7c-4bc2-9a5a-070c3d04e359 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:14.169456 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea68ce0-3f7c-4bc2-9a5a-070c3d04e359 admin admin] PATH_INFO: `/v3/projects/77ad7fb7120245c788cf2949ad07fa42/users/38328581332f4302a354dbf707a9abfa/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:14.228453 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea68ce0-3f7c-4bc2-9a5a-070c3d04e359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77ad7fb7120245c788cf2949ad07fa42, user_id=38328581332f4302a354dbf707a9abfa, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:14.240327 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea68ce0-3f7c-4bc2-9a5a-070c3d04e359 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:14.318323 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1373/2739] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:01:14 2022] PUT /identity/v3/projects/77ad7fb7120245c788cf2949ad07fa42/users/38328581332f4302a354dbf707a9abfa/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:01:14.345114 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26147a51-5095-4ae6-acf0-00b6bfc28698 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:14.346847 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26147a51-5095-4ae6-acf0-00b6bfc28698 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:14.346847 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26147a51-5095-4ae6-acf0-00b6bfc28698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:14.480461 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-26147a51-5095-4ae6-acf0-00b6bfc28698 None None] MFA Rules not processed for user `38328581332f4302a354dbf707a9abfa`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:01:14.482571 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-26147a51-5095-4ae6-acf0-00b6bfc28698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:01:14.593870 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1367/2740] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:01:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:01:14.599609 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea68ce0-3f7c-4bc2-9a5a-070c3d04e359 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:15.000226 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea68ce0-3f7c-4bc2-9a5a-070c3d04e359 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:15.041321 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e66a3-f428-43ea-bfcc-8c390594d72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:15.044769 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e66a3-f428-43ea-bfcc-8c390594d72e admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:15.045591 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e66a3-f428-43ea-bfcc-8c390594d72e admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:15.046083 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e66a3-f428-43ea-bfcc-8c390594d72e admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:15.047145 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e66a3-f428-43ea-bfcc-8c390594d72e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:15.052979 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e66a3-f428-43ea-bfcc-8c390594d72e admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:15.141681 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1374/2741] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 21:01:14 2022] POST /identity/v3/projects => generated 371 bytes in 543 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:01:15.150055 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26147a51-5095-4ae6-acf0-00b6bfc28698 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:15.205828 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26147a51-5095-4ae6-acf0-00b6bfc28698 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:15.453502 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674fecb1-a013-408f-8f1b-adc1d951cf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:15.454201 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fecb1-a013-408f-8f1b-adc1d951cf7d admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:15.454524 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fecb1-a013-408f-8f1b-adc1d951cf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:15.454842 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fecb1-a013-408f-8f1b-adc1d951cf7d admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:15.455613 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674fecb1-a013-408f-8f1b-adc1d951cf7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:15.463184 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674fecb1-a013-408f-8f1b-adc1d951cf7d admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:15.511967 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1368/2742] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 21:01:15 2022] POST /identity/v3/users => generated 292 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 21:01:15.517054 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e66a3-f428-43ea-bfcc-8c390594d72e admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:15.547492 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e66a3-f428-43ea-bfcc-8c390594d72e admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:15.580031 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52e2b1-6bfc-478a-a03f-258fd0e65451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:15.581324 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52e2b1-6bfc-478a-a03f-258fd0e65451 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:15.581914 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52e2b1-6bfc-478a-a03f-258fd0e65451 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:15.582513 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52e2b1-6bfc-478a-a03f-258fd0e65451 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:15.591611 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc52e2b1-6bfc-478a-a03f-258fd0e65451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:15.595216 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc52e2b1-6bfc-478a-a03f-258fd0e65451 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:15.631596 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1375/2743] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 21:01:15.632613 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674fecb1-a013-408f-8f1b-adc1d951cf7d admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:15.667297 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674fecb1-a013-408f-8f1b-adc1d951cf7d admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:15.692096 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22117604-2ece-40f8-b063-b7e979d50874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:15.694103 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22117604-2ece-40f8-b063-b7e979d50874 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:15.696172 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22117604-2ece-40f8-b063-b7e979d50874 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:15.711237 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22117604-2ece-40f8-b063-b7e979d50874 admin admin] PATH_INFO: `/v3/projects/90ae53ebd41d40c8b3c4d7f2859b0418/users/d8a8920b206b44eb80dfa86bec151913/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:15.776126 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22117604-2ece-40f8-b063-b7e979d50874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90ae53ebd41d40c8b3c4d7f2859b0418, user_id=d8a8920b206b44eb80dfa86bec151913, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:15.781922 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22117604-2ece-40f8-b063-b7e979d50874 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:15.857489 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52e2b1-6bfc-478a-a03f-258fd0e65451 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:15.858622 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1369/2744] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:01:15 2022] PUT /identity/v3/projects/90ae53ebd41d40c8b3c4d7f2859b0418/users/d8a8920b206b44eb80dfa86bec151913/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 21:01:15.883831 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52e2b1-6bfc-478a-a03f-258fd0e65451 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:16.121099 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2954d-1dd4-44f4-b2fd-5d7bdc32fead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:16.123057 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2954d-1dd4-44f4-b2fd-5d7bdc32fead admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:16.123686 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2954d-1dd4-44f4-b2fd-5d7bdc32fead admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:16.124320 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2954d-1dd4-44f4-b2fd-5d7bdc32fead admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:16.125871 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d2954d-1dd4-44f4-b2fd-5d7bdc32fead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:16.129137 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d2954d-1dd4-44f4-b2fd-5d7bdc32fead admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:16.177631 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22117604-2ece-40f8-b063-b7e979d50874 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:16.192320 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1376/2745] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 21:01:16.208167 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22117604-2ece-40f8-b063-b7e979d50874 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:16.258156 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402974b3-552f-4b8d-91fe-d774e4c2526b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:16.261827 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402974b3-552f-4b8d-91fe-d774e4c2526b admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:16.261827 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402974b3-552f-4b8d-91fe-d774e4c2526b admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:16.263020 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402974b3-552f-4b8d-91fe-d774e4c2526b admin admin] PATH_INFO: `/v3/projects/90ae53ebd41d40c8b3c4d7f2859b0418/users/d8a8920b206b44eb80dfa86bec151913/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:16.277441 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402974b3-552f-4b8d-91fe-d774e4c2526b admin admin] RBAC: Authorizing `identity:create_grant(project_id=90ae53ebd41d40c8b3c4d7f2859b0418, user_id=d8a8920b206b44eb80dfa86bec151913, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:16.281342 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402974b3-552f-4b8d-91fe-d774e4c2526b admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:16.312481 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1370/2746] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:01:16 2022] PUT /identity/v3/projects/90ae53ebd41d40c8b3c4d7f2859b0418/users/d8a8920b206b44eb80dfa86bec151913/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:01:16.324199 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1116fe-fdb7-4fbb-879f-34c76542e096 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:16.324623 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1116fe-fdb7-4fbb-879f-34c76542e096 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:16.325228 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1116fe-fdb7-4fbb-879f-34c76542e096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:16.389014 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-ab1116fe-fdb7-4fbb-879f-34c76542e096 None None] MFA Rules not processed for user `d8a8920b206b44eb80dfa86bec151913`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:01:16.390620 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-ab1116fe-fdb7-4fbb-879f-34c76542e096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:01:16.581581 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1377/2747] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:01:16 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:01:16.595497 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402974b3-552f-4b8d-91fe-d774e4c2526b admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:16.597608 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-402974b3-552f-4b8d-91fe-d774e4c2526b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:01:16.748333 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402974b3-552f-4b8d-91fe-d774e4c2526b admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:16.768799 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af4042-1fdd-480e-8c4d-369f01e93e2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:16.770169 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af4042-1fdd-480e-8c4d-369f01e93e2e service cinder] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:16.770787 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af4042-1fdd-480e-8c4d-369f01e93e2e service cinder] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:16.771647 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af4042-1fdd-480e-8c4d-369f01e93e2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:16.810118 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af4042-1fdd-480e-8c4d-369f01e93e2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:16.813262 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af4042-1fdd-480e-8c4d-369f01e93e2e service cinder] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:16.872167 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1371/2748] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:01:16 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 21:01:17.051408 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1116fe-fdb7-4fbb-879f-34c76542e096 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:17.086142 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1116fe-fdb7-4fbb-879f-34c76542e096 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:17.107227 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a7dba-7092-4ea5-bc3f-677a4cc1856a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:17.109124 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a7dba-7092-4ea5-bc3f-677a4cc1856a service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:17.109788 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a7dba-7092-4ea5-bc3f-677a4cc1856a service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:17.110418 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a7dba-7092-4ea5-bc3f-677a4cc1856a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:17.284863 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a7dba-7092-4ea5-bc3f-677a4cc1856a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:17.287464 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a7dba-7092-4ea5-bc3f-677a4cc1856a service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:17.324052 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1378/2749] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:01:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 21:01:28.624107 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10e6d5-4a1a-4d96-b298-fa5faf42b083 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:28.625030 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10e6d5-4a1a-4d96-b298-fa5faf42b083 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:28.625619 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10e6d5-4a1a-4d96-b298-fa5faf42b083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:28.666087 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-bc10e6d5-4a1a-4d96-b298-fa5faf42b083 None None] MFA Rules not processed for user `37094f974c164d50890b46d0581ebf9c`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:01:28.668831 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-bc10e6d5-4a1a-4d96-b298-fa5faf42b083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:01:28.752059 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1372/2750] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:01:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:01:29.254859 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a7dba-7092-4ea5-bc3f-677a4cc1856a service cinder] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:29.256370 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-1b1a7dba-7092-4ea5-bc3f-677a4cc1856a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:01:29.310281 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10e6d5-4a1a-4d96-b298-fa5faf42b083 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:29.311725 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-bc10e6d5-4a1a-4d96-b298-fa5faf42b083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:01:29.334670 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a7dba-7092-4ea5-bc3f-677a4cc1856a service cinder] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:29.340040 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f36c9-cbe0-4a2d-904f-3ef0fcc7c873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:29.342014 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f36c9-cbe0-4a2d-904f-3ef0fcc7c873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:29.342393 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f36c9-cbe0-4a2d-904f-3ef0fcc7c873 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:29.342762 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f36c9-cbe0-4a2d-904f-3ef0fcc7c873 admin admin] PATH_INFO: `/v3/users/f4f5265b9b47425fb6e57f2448209927` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:29.344150 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f36c9-cbe0-4a2d-904f-3ef0fcc7c873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4f5265b9b47425fb6e57f2448209927)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:29.346183 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f36c9-cbe0-4a2d-904f-3ef0fcc7c873 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:29.384575 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10e6d5-4a1a-4d96-b298-fa5faf42b083 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:29.390514 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e298c-c1ae-408d-a2e5-ff38b998bf02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:29.391273 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e298c-c1ae-408d-a2e5-ff38b998bf02 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:29.391629 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e298c-c1ae-408d-a2e5-ff38b998bf02 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:29.392040 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e298c-c1ae-408d-a2e5-ff38b998bf02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:29.394922 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-f16e298c-c1ae-408d-a2e5-ff38b998bf02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:01:29.405062 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-407f36c9-cbe0-4a2d-904f-3ef0fcc7c873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4f5265b9b47425fb6e57f2448209927'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:01:29.405602 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e298c-c1ae-408d-a2e5-ff38b998bf02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:29.407280 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e298c-c1ae-408d-a2e5-ff38b998bf02 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:29.412469 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-407f36c9-cbe0-4a2d-904f-3ef0fcc7c873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4f5265b9b47425fb6e57f2448209927'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:01:29.415963 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1373/2751] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:01:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 21:01:29.421699 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-407f36c9-cbe0-4a2d-904f-3ef0fcc7c873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4f5265b9b47425fb6e57f2448209927'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:01:29.422505 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-407f36c9-cbe0-4a2d-904f-3ef0fcc7c873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4f5265b9b47425fb6e57f2448209927'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:01:29.438991 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-407f36c9-cbe0-4a2d-904f-3ef0fcc7c873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4f5265b9b47425fb6e57f2448209927'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:01:29.444572 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1379/2752] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:01:29 2022] DELETE /identity/v3/users/f4f5265b9b47425fb6e57f2448209927 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:01:29.681265 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e298c-c1ae-408d-a2e5-ff38b998bf02 service neutron] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:29.709609 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e298c-c1ae-408d-a2e5-ff38b998bf02 service neutron] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:29.809638 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35436676-6f24-4c01-8242-168b08b50215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:29.810844 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35436676-6f24-4c01-8242-168b08b50215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:29.811124 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35436676-6f24-4c01-8242-168b08b50215 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:29.811405 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35436676-6f24-4c01-8242-168b08b50215 admin admin] PATH_INFO: `/v3/projects/803952ec317943c68a52064ca0c2535a` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:29.812809 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35436676-6f24-4c01-8242-168b08b50215 admin admin] RBAC: Authorizing `identity:delete_project(project_id=803952ec317943c68a52064ca0c2535a)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:29.815001 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35436676-6f24-4c01-8242-168b08b50215 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:29.891727 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-35436676-6f24-4c01-8242-168b08b50215 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '803952ec317943c68a52064ca0c2535a', 'request_id': 'req-35436676-6f24-4c01-8242-168b08b50215'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:01:29.898665 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-35436676-6f24-4c01-8242-168b08b50215 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '803952ec317943c68a52064ca0c2535a', 'request_id': 'req-35436676-6f24-4c01-8242-168b08b50215'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:01:29.906631 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-35436676-6f24-4c01-8242-168b08b50215 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '803952ec317943c68a52064ca0c2535a', 'request_id': 'req-35436676-6f24-4c01-8242-168b08b50215'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:01:29.930059 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-35436676-6f24-4c01-8242-168b08b50215 admin admin] The token cache is being invalidate because project 803952ec317943c68a52064ca0c2535a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:01:29.930647 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-35436676-6f24-4c01-8242-168b08b50215 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:01:29.931680 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-35436676-6f24-4c01-8242-168b08b50215 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:01:29.933763 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1374/2753] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:01:29 2022] DELETE /identity/v3/projects/803952ec317943c68a52064ca0c2535a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:01:29.938765 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f36c9-cbe0-4a2d-904f-3ef0fcc7c873 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:29.940633 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-407f36c9-cbe0-4a2d-904f-3ef0fcc7c873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:01:29.962442 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f36c9-cbe0-4a2d-904f-3ef0fcc7c873 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:30.068841 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d6697-c7d0-4b6a-ac62-8a7d122e3e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:30.070130 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d6697-c7d0-4b6a-ac62-8a7d122e3e97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:30.070524 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d6697-c7d0-4b6a-ac62-8a7d122e3e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:30.070982 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d6697-c7d0-4b6a-ac62-8a7d122e3e97 admin admin] PATH_INFO: `/v3/users/62f1caee714d494c95c0f6c76ab510d3` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:30.072540 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d6697-c7d0-4b6a-ac62-8a7d122e3e97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62f1caee714d494c95c0f6c76ab510d3)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:30.074569 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d6697-c7d0-4b6a-ac62-8a7d122e3e97 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:30.146710 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ff2d6697-c7d0-4b6a-ac62-8a7d122e3e97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62f1caee714d494c95c0f6c76ab510d3'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:01:30.155540 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ff2d6697-c7d0-4b6a-ac62-8a7d122e3e97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62f1caee714d494c95c0f6c76ab510d3'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:01:30.179027 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ff2d6697-c7d0-4b6a-ac62-8a7d122e3e97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62f1caee714d494c95c0f6c76ab510d3'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:01:30.180273 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ff2d6697-c7d0-4b6a-ac62-8a7d122e3e97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62f1caee714d494c95c0f6c76ab510d3'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:01:30.196456 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-ff2d6697-c7d0-4b6a-ac62-8a7d122e3e97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62f1caee714d494c95c0f6c76ab510d3'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:01:30.205204 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1380/2754] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:01:29 2022] DELETE /identity/v3/users/62f1caee714d494c95c0f6c76ab510d3 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:01:30.502554 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35436676-6f24-4c01-8242-168b08b50215 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:30.504729 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-35436676-6f24-4c01-8242-168b08b50215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:01:30.524008 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35436676-6f24-4c01-8242-168b08b50215 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:30.599010 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10652635-f1ed-4b53-a4db-a754b9f3d38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:30.599909 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10652635-f1ed-4b53-a4db-a754b9f3d38d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:30.600191 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10652635-f1ed-4b53-a4db-a754b9f3d38d admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:30.600460 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10652635-f1ed-4b53-a4db-a754b9f3d38d admin admin] PATH_INFO: `/v3/projects/c22913a3602f4ae3a2cd3425a87aa345` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:30.602569 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10652635-f1ed-4b53-a4db-a754b9f3d38d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c22913a3602f4ae3a2cd3425a87aa345)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:30.606530 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10652635-f1ed-4b53-a4db-a754b9f3d38d admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:30.669907 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-10652635-f1ed-4b53-a4db-a754b9f3d38d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c22913a3602f4ae3a2cd3425a87aa345', 'request_id': 'req-10652635-f1ed-4b53-a4db-a754b9f3d38d'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:01:30.675706 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-10652635-f1ed-4b53-a4db-a754b9f3d38d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c22913a3602f4ae3a2cd3425a87aa345', 'request_id': 'req-10652635-f1ed-4b53-a4db-a754b9f3d38d'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:01:30.682751 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-10652635-f1ed-4b53-a4db-a754b9f3d38d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c22913a3602f4ae3a2cd3425a87aa345', 'request_id': 'req-10652635-f1ed-4b53-a4db-a754b9f3d38d'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:01:30.702963 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-10652635-f1ed-4b53-a4db-a754b9f3d38d admin admin] The token cache is being invalidate because project c22913a3602f4ae3a2cd3425a87aa345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:01:30.703920 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-10652635-f1ed-4b53-a4db-a754b9f3d38d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:01:30.705092 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-10652635-f1ed-4b53-a4db-a754b9f3d38d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:01:30.707536 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1375/2755] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:01:30 2022] DELETE /identity/v3/projects/c22913a3602f4ae3a2cd3425a87aa345 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 21:01:30.713344 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0daae17-e637-43dc-af26-c98a07c45bd9 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:30.713969 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0daae17-e637-43dc-af26-c98a07c45bd9 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:30.713969 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0daae17-e637-43dc-af26-c98a07c45bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:30.738706 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-c0daae17-e637-43dc-af26-c98a07c45bd9 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:01:30.740013 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-c0daae17-e637-43dc-af26-c98a07c45bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:01:30.811831 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1381/2756] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:01:30.821084 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daebc7f-dacb-43b7-b825-0cc7583b72cf None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:30.821367 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daebc7f-dacb-43b7-b825-0cc7583b72cf None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:30.821641 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daebc7f-dacb-43b7-b825-0cc7583b72cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:30.841585 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-4daebc7f-dacb-43b7-b825-0cc7583b72cf None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:01:30.842850 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-4daebc7f-dacb-43b7-b825-0cc7583b72cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:01:30.851977 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1376/2757] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:01:30.857697 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0daae17-e637-43dc-af26-c98a07c45bd9 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:30.869714 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0daae17-e637-43dc-af26-c98a07c45bd9 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:30.875199 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fac46f-b681-464f-a2e7-0b111ea08d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:30.875919 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fac46f-b681-464f-a2e7-0b111ea08d3e admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:30.876204 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fac46f-b681-464f-a2e7-0b111ea08d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:30.876477 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fac46f-b681-464f-a2e7-0b111ea08d3e admin admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:30.877201 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fac46f-b681-464f-a2e7-0b111ea08d3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 21:01:30.877512 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fac46f-b681-464f-a2e7-0b111ea08d3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:30.879108 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fac46f-b681-464f-a2e7-0b111ea08d3e admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:30.893947 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1382/2758] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 21:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 21:01:30.898427 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daebc7f-dacb-43b7-b825-0cc7583b72cf None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:30.908460 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daebc7f-dacb-43b7-b825-0cc7583b72cf None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:30.913056 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf56bd7-d5b6-41f7-beb4-fd0b290f738f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:30.913708 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf56bd7-d5b6-41f7-beb4-fd0b290f738f admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:30.913983 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf56bd7-d5b6-41f7-beb4-fd0b290f738f admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:30.914253 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf56bd7-d5b6-41f7-beb4-fd0b290f738f admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:30.914972 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf56bd7-d5b6-41f7-beb4-fd0b290f738f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:30.916914 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf56bd7-d5b6-41f7-beb4-fd0b290f738f admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:30.946570 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1377/2759] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 21:01:30 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 21:01:30.948379 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fac46f-b681-464f-a2e7-0b111ea08d3e admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:30.959926 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fac46f-b681-464f-a2e7-0b111ea08d3e admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:31.046331 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa7434-3d89-4605-b120-dbe03c7e8220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:31.047327 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa7434-3d89-4605-b120-dbe03c7e8220 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:31.047611 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa7434-3d89-4605-b120-dbe03c7e8220 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:31.047916 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa7434-3d89-4605-b120-dbe03c7e8220 admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:31.048703 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa7434-3d89-4605-b120-dbe03c7e8220 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:31.050654 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa7434-3d89-4605-b120-dbe03c7e8220 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:31.085122 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1383/2760] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 21:01:30 2022] POST /identity/v3/users => generated 290 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:01:31.089096 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf56bd7-d5b6-41f7-beb4-fd0b290f738f admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:31.106630 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf56bd7-d5b6-41f7-beb4-fd0b290f738f admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:31.115153 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39717687-341c-41d8-b539-30f4375e223c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:31.116790 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39717687-341c-41d8-b539-30f4375e223c admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:31.117331 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39717687-341c-41d8-b539-30f4375e223c admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:31.117834 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39717687-341c-41d8-b539-30f4375e223c admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:31.120036 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39717687-341c-41d8-b539-30f4375e223c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:31.122894 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39717687-341c-41d8-b539-30f4375e223c admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:31.139345 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1378/2761] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:01:31.144099 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa7434-3d89-4605-b120-dbe03c7e8220 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:31.158119 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa7434-3d89-4605-b120-dbe03c7e8220 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:31.164357 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee26ece-d055-4d01-b0db-bc52d7780b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:31.165103 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee26ece-d055-4d01-b0db-bc52d7780b93 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:31.165385 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee26ece-d055-4d01-b0db-bc52d7780b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:31.165829 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee26ece-d055-4d01-b0db-bc52d7780b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:31.166972 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee26ece-d055-4d01-b0db-bc52d7780b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:31.168967 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee26ece-d055-4d01-b0db-bc52d7780b93 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:31.182247 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1384/2762] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:01:31.187180 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39717687-341c-41d8-b539-30f4375e223c admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:31.199164 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39717687-341c-41d8-b539-30f4375e223c admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:31.205400 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746395f1-ac28-4f73-b600-07af65ad6a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:31.206580 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746395f1-ac28-4f73-b600-07af65ad6a94 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:31.206885 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746395f1-ac28-4f73-b600-07af65ad6a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:31.207189 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746395f1-ac28-4f73-b600-07af65ad6a94 admin admin] PATH_INFO: `/v3/projects/fa451a74d7364a499fa109c6e840ce23/users/de477cdd9c8b4ad49c6eac58f107318a/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:31.242504 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746395f1-ac28-4f73-b600-07af65ad6a94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa451a74d7364a499fa109c6e840ce23, user_id=de477cdd9c8b4ad49c6eac58f107318a, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:31.248518 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746395f1-ac28-4f73-b600-07af65ad6a94 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:31.275158 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1379/2763] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:01:31 2022] PUT /identity/v3/projects/fa451a74d7364a499fa109c6e840ce23/users/de477cdd9c8b4ad49c6eac58f107318a/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:01:31.281742 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d980666-0572-401f-ba87-3ad1009ebecb None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:31.282242 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d980666-0572-401f-ba87-3ad1009ebecb None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:31.282535 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d980666-0572-401f-ba87-3ad1009ebecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:31.302509 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-2d980666-0572-401f-ba87-3ad1009ebecb None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:01:31.303943 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-2d980666-0572-401f-ba87-3ad1009ebecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:01:31.417485 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1385/2764] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:01:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:01:31.429768 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746395f1-ac28-4f73-b600-07af65ad6a94 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:31.431667 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-746395f1-ac28-4f73-b600-07af65ad6a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:01:31.466929 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aa086-c88f-4937-a67d-24e687d6d671 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:31.467336 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aa086-c88f-4937-a67d-24e687d6d671 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:31.467665 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aa086-c88f-4937-a67d-24e687d6d671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:31.492340 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-ff4aa086-c88f-4937-a67d-24e687d6d671 None None] MFA Rules not processed for user `78cde480dd8b4a85ac30895026bfc406`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:01:31.494084 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-ff4aa086-c88f-4937-a67d-24e687d6d671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:01:31.514476 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746395f1-ac28-4f73-b600-07af65ad6a94 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:31.519731 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f97f16-4f3f-4130-a1c6-e71076d38afa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:31.520443 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f97f16-4f3f-4130-a1c6-e71076d38afa service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:31.520716 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f97f16-4f3f-4130-a1c6-e71076d38afa service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:31.520980 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f97f16-4f3f-4130-a1c6-e71076d38afa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:31.533027 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f97f16-4f3f-4130-a1c6-e71076d38afa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:31.534515 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f97f16-4f3f-4130-a1c6-e71076d38afa service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:31.549393 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1380/2765] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:01:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:01:31.567909 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1386/2766] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Oct 28 21:01:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:01:31.585953 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f97f16-4f3f-4130-a1c6-e71076d38afa service neutron] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:31.588085 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-d4f97f16-4f3f-4130-a1c6-e71076d38afa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:01:31.686436 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f97f16-4f3f-4130-a1c6-e71076d38afa service neutron] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:31.694533 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206313cc-298a-4a5c-923a-e0d20529527b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d70db11d2d4923943bc6479bc49206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:31.695208 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206313cc-298a-4a5c-923a-e0d20529527b service swift] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:31.695509 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206313cc-298a-4a5c-923a-e0d20529527b service swift] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:31.695972 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206313cc-298a-4a5c-923a-e0d20529527b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:31.713293 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206313cc-298a-4a5c-923a-e0d20529527b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:31.715488 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206313cc-298a-4a5c-923a-e0d20529527b service swift] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:31.728015 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1381/2767] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Oct 28 21:01:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 21:01:40.828451 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377e104-db26-4b49-b345-f6169a155f7a None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:40.829172 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377e104-db26-4b49-b345-f6169a155f7a None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:40.829172 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377e104-db26-4b49-b345-f6169a155f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:40.858930 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-6377e104-db26-4b49-b345-f6169a155f7a None None] MFA Rules not processed for user `de477cdd9c8b4ad49c6eac58f107318a`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:01:40.860180 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-6377e104-db26-4b49-b345-f6169a155f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:01:40.935275 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1387/2768] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:01:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:01:40.939442 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206313cc-298a-4a5c-923a-e0d20529527b service swift] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:40.956474 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206313cc-298a-4a5c-923a-e0d20529527b service swift] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:40.962562 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f85185-6ba9-4c05-836c-777253b060d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:40.963618 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f85185-6ba9-4c05-836c-777253b060d9 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:40.964555 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f85185-6ba9-4c05-836c-777253b060d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:40.965668 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f85185-6ba9-4c05-836c-777253b060d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:40.966958 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f85185-6ba9-4c05-836c-777253b060d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:40.969485 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f85185-6ba9-4c05-836c-777253b060d9 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:41.001407 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1382/2769] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 21:01:40 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 21:01:41.005262 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377e104-db26-4b49-b345-f6169a155f7a None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:41.029573 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377e104-db26-4b49-b345-f6169a155f7a None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:41.100628 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b6327-a2f8-4159-bff7-7c7f7cbfb926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:41.101303 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b6327-a2f8-4159-bff7-7c7f7cbfb926 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:41.101580 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b6327-a2f8-4159-bff7-7c7f7cbfb926 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:41.101851 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b6327-a2f8-4159-bff7-7c7f7cbfb926 admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:41.102595 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b6327-a2f8-4159-bff7-7c7f7cbfb926 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:41.107828 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b6327-a2f8-4159-bff7-7c7f7cbfb926 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:41.146208 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1388/2770] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 21:01:41 2022] POST /identity/v3/users => generated 296 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 21:01:41.150196 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f85185-6ba9-4c05-836c-777253b060d9 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:41.161891 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f85185-6ba9-4c05-836c-777253b060d9 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:41.176411 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc7f90-ab51-4724-a4e8-09fa7464d846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:41.177416 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc7f90-ab51-4724-a4e8-09fa7464d846 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:41.177912 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc7f90-ab51-4724-a4e8-09fa7464d846 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:41.178416 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc7f90-ab51-4724-a4e8-09fa7464d846 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:41.179230 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc7f90-ab51-4724-a4e8-09fa7464d846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:41.180967 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc7f90-ab51-4724-a4e8-09fa7464d846 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:41.200827 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b6327-a2f8-4159-bff7-7c7f7cbfb926 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:41.212649 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1383/2771] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 21:01:41.216121 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b6327-a2f8-4159-bff7-7c7f7cbfb926 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:41.233088 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec7b15-a373-41b4-9337-69b0778ac559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:41.236198 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec7b15-a373-41b4-9337-69b0778ac559 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:41.236698 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec7b15-a373-41b4-9337-69b0778ac559 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:41.237142 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec7b15-a373-41b4-9337-69b0778ac559 admin admin] PATH_INFO: `/v3/projects/01c6be4239274a17996adbefbf96ff1c/users/60d0ed1f71c3433c8afe8668bee0b836/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:41.255437 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec7b15-a373-41b4-9337-69b0778ac559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01c6be4239274a17996adbefbf96ff1c, user_id=60d0ed1f71c3433c8afe8668bee0b836, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:41.258138 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec7b15-a373-41b4-9337-69b0778ac559 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:41.279444 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1389/2772] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:01:41 2022] PUT /identity/v3/projects/01c6be4239274a17996adbefbf96ff1c/users/60d0ed1f71c3433c8afe8668bee0b836/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:01:41.280237 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc7f90-ab51-4724-a4e8-09fa7464d846 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:41.295626 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc7f90-ab51-4724-a4e8-09fa7464d846 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:41.380227 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c3836-f29f-49be-90d1-478525b5048d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:41.380906 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c3836-f29f-49be-90d1-478525b5048d admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:41.381183 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c3836-f29f-49be-90d1-478525b5048d admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:41.381456 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c3836-f29f-49be-90d1-478525b5048d admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:41.382196 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c3836-f29f-49be-90d1-478525b5048d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:41.384250 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c3836-f29f-49be-90d1-478525b5048d admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:41.397638 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1384/2773] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:01:41.409403 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec7b15-a373-41b4-9337-69b0778ac559 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:41.420409 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec7b15-a373-41b4-9337-69b0778ac559 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:41.430549 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4db000-864e-4c19-ac73-0ba57fd785bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:41.432185 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4db000-864e-4c19-ac73-0ba57fd785bc admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:41.432657 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4db000-864e-4c19-ac73-0ba57fd785bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:41.433282 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4db000-864e-4c19-ac73-0ba57fd785bc admin admin] PATH_INFO: `/v3/projects/01c6be4239274a17996adbefbf96ff1c/users/60d0ed1f71c3433c8afe8668bee0b836/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:41.436019 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4db000-864e-4c19-ac73-0ba57fd785bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=01c6be4239274a17996adbefbf96ff1c, user_id=60d0ed1f71c3433c8afe8668bee0b836, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:41.438966 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4db000-864e-4c19-ac73-0ba57fd785bc admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:41.451712 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1390/2774] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:01:41 2022] PUT /identity/v3/projects/01c6be4239274a17996adbefbf96ff1c/users/60d0ed1f71c3433c8afe8668bee0b836/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:01:46.882764 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe80e5-a018-49d6-9d2b-e0f5980e980e None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:46.883374 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe80e5-a018-49d6-9d2b-e0f5980e980e None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:46.883374 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe80e5-a018-49d6-9d2b-e0f5980e980e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:46.912445 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-3cbe80e5-a018-49d6-9d2b-e0f5980e980e None None] MFA Rules not processed for user `60d0ed1f71c3433c8afe8668bee0b836`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:01:46.913674 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-3cbe80e5-a018-49d6-9d2b-e0f5980e980e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:01:46.989997 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1385/2775] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:01:46 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:01:47.004690 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4db000-864e-4c19-ac73-0ba57fd785bc admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:47.006370 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-2b4db000-864e-4c19-ac73-0ba57fd785bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:01:47.083397 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4db000-864e-4c19-ac73-0ba57fd785bc admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:47.089029 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb659f0-68a6-4a3b-976a-ac481c58a118 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:47.089713 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb659f0-68a6-4a3b-976a-ac481c58a118 service nova] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:47.090064 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb659f0-68a6-4a3b-976a-ac481c58a118 service nova] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:47.090335 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb659f0-68a6-4a3b-976a-ac481c58a118 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:47.154914 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb659f0-68a6-4a3b-976a-ac481c58a118 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:47.156568 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb659f0-68a6-4a3b-976a-ac481c58a118 service nova] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:47.165993 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1391/2776] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:01:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:01:53.126088 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcba88-b1b8-41e4-bf69-7d0c1110d5eb None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:53.126606 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcba88-b1b8-41e4-bf69-7d0c1110d5eb None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:53.126727 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcba88-b1b8-41e4-bf69-7d0c1110d5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:53.144444 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-98bcba88-b1b8-41e4-bf69-7d0c1110d5eb None None] MFA Rules not processed for user `78cde480dd8b4a85ac30895026bfc406`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:01:53.145642 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-98bcba88-b1b8-41e4-bf69-7d0c1110d5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:01:53.220657 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1386/2777] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Oct 28 21:01:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:01:53.234569 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb659f0-68a6-4a3b-976a-ac481c58a118 service nova] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:01:53.309879 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb659f0-68a6-4a3b-976a-ac481c58a118 service nova] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:01:53.315573 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86405c-0021-4383-ae4f-6d0f9b7f6cf6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d70db11d2d4923943bc6479bc49206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:01:53.316255 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86405c-0021-4383-ae4f-6d0f9b7f6cf6 service swift] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:01:53.316522 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86405c-0021-4383-ae4f-6d0f9b7f6cf6 service swift] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:01:53.316799 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86405c-0021-4383-ae4f-6d0f9b7f6cf6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:01:53.326332 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86405c-0021-4383-ae4f-6d0f9b7f6cf6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:01:53.328277 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86405c-0021-4383-ae4f-6d0f9b7f6cf6 service swift] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:01:53.337976 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1392/2778] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Oct 28 21:01:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 21:02:11.813669 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bcba88-b1b8-41e4-bf69-7d0c1110d5eb None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:11.815994 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-98bcba88-b1b8-41e4-bf69-7d0c1110d5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:11.909793 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bcba88-b1b8-41e4-bf69-7d0c1110d5eb None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:11.917029 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7910555-d6e8-4e11-922f-c6b341fec4be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:11.917983 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7910555-d6e8-4e11-922f-c6b341fec4be service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:11.918445 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7910555-d6e8-4e11-922f-c6b341fec4be service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:11.918944 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7910555-d6e8-4e11-922f-c6b341fec4be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:11.921713 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-b7910555-d6e8-4e11-922f-c6b341fec4be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:12.019501 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7910555-d6e8-4e11-922f-c6b341fec4be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:12.021881 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7910555-d6e8-4e11-922f-c6b341fec4be service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:12.034258 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1387/2779] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:02:11 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:02:12.087659 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86405c-0021-4383-ae4f-6d0f9b7f6cf6 service swift] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:12.090800 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-cc86405c-0021-4383-ae4f-6d0f9b7f6cf6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:12.183852 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86405c-0021-4383-ae4f-6d0f9b7f6cf6 service swift] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:12.189886 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752b493-6a11-4508-8d42-af33b2f322ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:12.191204 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752b493-6a11-4508-8d42-af33b2f322ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:12.191734 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752b493-6a11-4508-8d42-af33b2f322ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:12.192263 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752b493-6a11-4508-8d42-af33b2f322ff admin admin] PATH_INFO: `/v3/users/38328581332f4302a354dbf707a9abfa` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:12.193862 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752b493-6a11-4508-8d42-af33b2f322ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=38328581332f4302a354dbf707a9abfa)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:12.196464 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752b493-6a11-4508-8d42-af33b2f322ff admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:12.260267 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-4752b493-6a11-4508-8d42-af33b2f322ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38328581332f4302a354dbf707a9abfa'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:12.269865 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-4752b493-6a11-4508-8d42-af33b2f322ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38328581332f4302a354dbf707a9abfa'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:12.286369 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-4752b493-6a11-4508-8d42-af33b2f322ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38328581332f4302a354dbf707a9abfa'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:12.287458 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-4752b493-6a11-4508-8d42-af33b2f322ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38328581332f4302a354dbf707a9abfa'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:12.312205 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-4752b493-6a11-4508-8d42-af33b2f322ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38328581332f4302a354dbf707a9abfa'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:12.320046 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1393/2780] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:02:12 2022] DELETE /identity/v3/users/38328581332f4302a354dbf707a9abfa => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 21:02:12.326260 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffaf58c-8104-485c-b6fc-10b5dc74fae4 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:12.326581 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffaf58c-8104-485c-b6fc-10b5dc74fae4 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:12.326879 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffaf58c-8104-485c-b6fc-10b5dc74fae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:12.352536 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-8ffaf58c-8104-485c-b6fc-10b5dc74fae4 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:02:12.355054 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-8ffaf58c-8104-485c-b6fc-10b5dc74fae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:12.462565 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1388/2781] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:02:12.471158 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752b493-6a11-4508-8d42-af33b2f322ff admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:12.472841 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-4752b493-6a11-4508-8d42-af33b2f322ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:12.562229 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752b493-6a11-4508-8d42-af33b2f322ff admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:12.566405 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f56be-36c3-46e2-b902-ddddb09a99af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:12.567097 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f56be-36c3-46e2-b902-ddddb09a99af service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:12.567397 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f56be-36c3-46e2-b902-ddddb09a99af service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:12.567681 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f56be-36c3-46e2-b902-ddddb09a99af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:12.579218 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f56be-36c3-46e2-b902-ddddb09a99af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:12.581045 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f56be-36c3-46e2-b902-ddddb09a99af service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:12.593256 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1394/2782] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:02:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:02:12.992259 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffaf58c-8104-485c-b6fc-10b5dc74fae4 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:12.994336 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-8ffaf58c-8104-485c-b6fc-10b5dc74fae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:13.043168 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffaf58c-8104-485c-b6fc-10b5dc74fae4 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:13.060394 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ea7a9-a663-443c-8095-cdc92328151c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:13.062455 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ea7a9-a663-443c-8095-cdc92328151c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:13.063220 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ea7a9-a663-443c-8095-cdc92328151c admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:13.066206 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ea7a9-a663-443c-8095-cdc92328151c admin admin] PATH_INFO: `/v3/projects/77ad7fb7120245c788cf2949ad07fa42` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:13.073030 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ea7a9-a663-443c-8095-cdc92328151c admin admin] RBAC: Authorizing `identity:delete_project(project_id=77ad7fb7120245c788cf2949ad07fa42)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:13.076131 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ea7a9-a663-443c-8095-cdc92328151c admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:13.183384 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-f46ea7a9-a663-443c-8095-cdc92328151c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77ad7fb7120245c788cf2949ad07fa42', 'request_id': 'req-f46ea7a9-a663-443c-8095-cdc92328151c'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:13.189863 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-f46ea7a9-a663-443c-8095-cdc92328151c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77ad7fb7120245c788cf2949ad07fa42', 'request_id': 'req-f46ea7a9-a663-443c-8095-cdc92328151c'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:13.196905 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-f46ea7a9-a663-443c-8095-cdc92328151c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77ad7fb7120245c788cf2949ad07fa42', 'request_id': 'req-f46ea7a9-a663-443c-8095-cdc92328151c'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:13.222875 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-f46ea7a9-a663-443c-8095-cdc92328151c admin admin] The token cache is being invalidate because project 77ad7fb7120245c788cf2949ad07fa42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:02:13.223179 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-f46ea7a9-a663-443c-8095-cdc92328151c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:13.230015 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-f46ea7a9-a663-443c-8095-cdc92328151c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:13.232059 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1389/2783] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:02:12 2022] DELETE /identity/v3/projects/77ad7fb7120245c788cf2949ad07fa42 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:02:13.236143 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f56be-36c3-46e2-b902-ddddb09a99af service neutron] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:13.257331 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f56be-36c3-46e2-b902-ddddb09a99af service neutron] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:13.359308 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b1b8a-012e-43d0-8d8e-421e23a124fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:13.360613 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b1b8a-012e-43d0-8d8e-421e23a124fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:13.361123 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b1b8a-012e-43d0-8d8e-421e23a124fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:13.361603 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b1b8a-012e-43d0-8d8e-421e23a124fb admin admin] PATH_INFO: `/v3/users/d8a8920b206b44eb80dfa86bec151913` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:13.363014 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b1b8a-012e-43d0-8d8e-421e23a124fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8a8920b206b44eb80dfa86bec151913)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:13.365613 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b1b8a-012e-43d0-8d8e-421e23a124fb admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:13.434022 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-028b1b8a-012e-43d0-8d8e-421e23a124fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8a8920b206b44eb80dfa86bec151913'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:13.458043 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-028b1b8a-012e-43d0-8d8e-421e23a124fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8a8920b206b44eb80dfa86bec151913'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:13.471690 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-028b1b8a-012e-43d0-8d8e-421e23a124fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8a8920b206b44eb80dfa86bec151913'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:13.472503 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-028b1b8a-012e-43d0-8d8e-421e23a124fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8a8920b206b44eb80dfa86bec151913'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:13.494461 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-028b1b8a-012e-43d0-8d8e-421e23a124fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8a8920b206b44eb80dfa86bec151913'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:13.505766 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1395/2784] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:02:13 2022] DELETE /identity/v3/users/d8a8920b206b44eb80dfa86bec151913 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:02:13.944559 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ea7a9-a663-443c-8095-cdc92328151c admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:13.946025 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-f46ea7a9-a663-443c-8095-cdc92328151c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:13.976401 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ea7a9-a663-443c-8095-cdc92328151c admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:14.065637 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a7166-0d7e-4ce8-b1af-12ca8111628a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:14.066438 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a7166-0d7e-4ce8-b1af-12ca8111628a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:14.066716 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a7166-0d7e-4ce8-b1af-12ca8111628a admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:14.067239 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a7166-0d7e-4ce8-b1af-12ca8111628a admin admin] PATH_INFO: `/v3/projects/90ae53ebd41d40c8b3c4d7f2859b0418` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:14.070914 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a7166-0d7e-4ce8-b1af-12ca8111628a admin admin] RBAC: Authorizing `identity:delete_project(project_id=90ae53ebd41d40c8b3c4d7f2859b0418)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:14.072944 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a7166-0d7e-4ce8-b1af-12ca8111628a admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:14.160050 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-873a7166-0d7e-4ce8-b1af-12ca8111628a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90ae53ebd41d40c8b3c4d7f2859b0418', 'request_id': 'req-873a7166-0d7e-4ce8-b1af-12ca8111628a'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:14.167196 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-873a7166-0d7e-4ce8-b1af-12ca8111628a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90ae53ebd41d40c8b3c4d7f2859b0418', 'request_id': 'req-873a7166-0d7e-4ce8-b1af-12ca8111628a'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:14.175982 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-873a7166-0d7e-4ce8-b1af-12ca8111628a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90ae53ebd41d40c8b3c4d7f2859b0418', 'request_id': 'req-873a7166-0d7e-4ce8-b1af-12ca8111628a'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:14.192489 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-873a7166-0d7e-4ce8-b1af-12ca8111628a admin admin] The token cache is being invalidate because project 90ae53ebd41d40c8b3c4d7f2859b0418 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:02:14.193084 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-873a7166-0d7e-4ce8-b1af-12ca8111628a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:14.193857 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-873a7166-0d7e-4ce8-b1af-12ca8111628a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:14.199088 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1390/2785] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:02:13 2022] DELETE /identity/v3/projects/90ae53ebd41d40c8b3c4d7f2859b0418 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:02:14.201520 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca12e2-018f-48e5-acdc-d1ea3da218dd None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:14.201520 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca12e2-018f-48e5-acdc-d1ea3da218dd None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:14.201732 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca12e2-018f-48e5-acdc-d1ea3da218dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:14.223684 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-c1ca12e2-018f-48e5-acdc-d1ea3da218dd None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:02:14.225124 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-c1ca12e2-018f-48e5-acdc-d1ea3da218dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:14.296730 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1396/2786] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:02:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 21:02:14.306737 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e61c2c-cc25-4c88-9fd0-a306508bd819 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:14.307031 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e61c2c-cc25-4c88-9fd0-a306508bd819 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:14.307302 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e61c2c-cc25-4c88-9fd0-a306508bd819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:14.337453 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-08e61c2c-cc25-4c88-9fd0-a306508bd819 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:02:14.339465 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-08e61c2c-cc25-4c88-9fd0-a306508bd819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:14.349480 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1391/2787] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:02:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:02:14.353540 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca12e2-018f-48e5-acdc-d1ea3da218dd None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:14.374221 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca12e2-018f-48e5-acdc-d1ea3da218dd None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:14.388351 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e456a9-c03b-483c-890e-191b005f190d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:14.389410 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e456a9-c03b-483c-890e-191b005f190d admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:14.389909 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e456a9-c03b-483c-890e-191b005f190d admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:14.390410 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e456a9-c03b-483c-890e-191b005f190d admin admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:14.391368 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e456a9-c03b-483c-890e-191b005f190d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 21:02:14.391928 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e456a9-c03b-483c-890e-191b005f190d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:14.395048 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e456a9-c03b-483c-890e-191b005f190d admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:14.416033 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1397/2788] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 21:02:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 21:02:14.420865 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e61c2c-cc25-4c88-9fd0-a306508bd819 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:14.453124 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e61c2c-cc25-4c88-9fd0-a306508bd819 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:14.460181 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58bf53-5b6e-4664-821a-805b858f8a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:14.461326 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58bf53-5b6e-4664-821a-805b858f8a9d admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:14.461617 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58bf53-5b6e-4664-821a-805b858f8a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:14.461894 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58bf53-5b6e-4664-821a-805b858f8a9d admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:14.462611 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58bf53-5b6e-4664-821a-805b858f8a9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:14.464639 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58bf53-5b6e-4664-821a-805b858f8a9d admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:14.509330 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1392/2789] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 21:02:14 2022] POST /identity/v3/projects => generated 387 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:02:14.511091 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e456a9-c03b-483c-890e-191b005f190d admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:14.524678 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e456a9-c03b-483c-890e-191b005f190d admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:14.614915 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff6304-3e29-4f76-b4e0-9b5c98b49659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:14.615317 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff6304-3e29-4f76-b4e0-9b5c98b49659 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:14.616045 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff6304-3e29-4f76-b4e0-9b5c98b49659 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:14.616356 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff6304-3e29-4f76-b4e0-9b5c98b49659 admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:14.617037 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff6304-3e29-4f76-b4e0-9b5c98b49659 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:14.620208 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff6304-3e29-4f76-b4e0-9b5c98b49659 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:14.669257 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1398/2790] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 21:02:14 2022] POST /identity/v3/users => generated 294 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:02:14.671389 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58bf53-5b6e-4664-821a-805b858f8a9d admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:14.686968 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58bf53-5b6e-4664-821a-805b858f8a9d admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:14.699128 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e74325-5e64-430d-bd03-6b571eb9f4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:14.700447 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e74325-5e64-430d-bd03-6b571eb9f4ce admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:14.700768 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e74325-5e64-430d-bd03-6b571eb9f4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:14.701084 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e74325-5e64-430d-bd03-6b571eb9f4ce admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:14.701989 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e74325-5e64-430d-bd03-6b571eb9f4ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:14.703646 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e74325-5e64-430d-bd03-6b571eb9f4ce admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:14.749803 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1393/2791] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:02:14.770642 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff6304-3e29-4f76-b4e0-9b5c98b49659 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:14.804425 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff6304-3e29-4f76-b4e0-9b5c98b49659 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:14.850185 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c67c784-1064-425b-8114-589db68e2827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:14.850888 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67c784-1064-425b-8114-589db68e2827 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:14.851173 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67c784-1064-425b-8114-589db68e2827 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:14.851446 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67c784-1064-425b-8114-589db68e2827 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:14.852283 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c67c784-1064-425b-8114-589db68e2827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:14.853950 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c67c784-1064-425b-8114-589db68e2827 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:14.898145 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1399/2792] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:02:14.904389 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e74325-5e64-430d-bd03-6b571eb9f4ce admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:14.944435 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e74325-5e64-430d-bd03-6b571eb9f4ce admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:14.972434 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018a22b-dac0-4fad-a9cb-29c0a0ee4f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:14.972434 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018a22b-dac0-4fad-a9cb-29c0a0ee4f5a admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:14.977015 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018a22b-dac0-4fad-a9cb-29c0a0ee4f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:14.977015 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018a22b-dac0-4fad-a9cb-29c0a0ee4f5a admin admin] PATH_INFO: `/v3/projects/05babfc2bee8451caf6f17544c0fcda9/users/97ffd98342dd473097560e3a3afe0bbc/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:14.998969 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8018a22b-dac0-4fad-a9cb-29c0a0ee4f5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=05babfc2bee8451caf6f17544c0fcda9, user_id=97ffd98342dd473097560e3a3afe0bbc, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:15.002445 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8018a22b-dac0-4fad-a9cb-29c0a0ee4f5a admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:15.022027 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1394/2793] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:02:14 2022] PUT /identity/v3/projects/05babfc2bee8451caf6f17544c0fcda9/users/97ffd98342dd473097560e3a3afe0bbc/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:02:15.033517 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa3f2c-f3d9-4bde-a8fb-e79adabdc659 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:15.033853 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa3f2c-f3d9-4bde-a8fb-e79adabdc659 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:15.034076 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa3f2c-f3d9-4bde-a8fb-e79adabdc659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:15.095997 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-bdaa3f2c-f3d9-4bde-a8fb-e79adabdc659 None None] MFA Rules not processed for user `97ffd98342dd473097560e3a3afe0bbc`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:02:15.097580 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-bdaa3f2c-f3d9-4bde-a8fb-e79adabdc659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:15.216047 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1400/2794] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:02:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:02:15.221106 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018a22b-dac0-4fad-a9cb-29c0a0ee4f5a admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:15.347431 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018a22b-dac0-4fad-a9cb-29c0a0ee4f5a admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:15.360244 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb68cd-d94e-4a8e-88de-a9bc1dc3e761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:15.362323 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb68cd-d94e-4a8e-88de-a9bc1dc3e761 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:15.362618 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb68cd-d94e-4a8e-88de-a9bc1dc3e761 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:15.362898 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb68cd-d94e-4a8e-88de-a9bc1dc3e761 admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:15.363664 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb68cd-d94e-4a8e-88de-a9bc1dc3e761 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:15.368761 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb68cd-d94e-4a8e-88de-a9bc1dc3e761 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:15.434784 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1395/2795] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 21:02:15 2022] POST /identity/v3/projects => generated 387 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 21:02:15.439165 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa3f2c-f3d9-4bde-a8fb-e79adabdc659 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:15.453720 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa3f2c-f3d9-4bde-a8fb-e79adabdc659 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:15.538200 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a8f8e-b2df-482b-8b5c-c93cd8554ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:15.538886 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a8f8e-b2df-482b-8b5c-c93cd8554ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:15.539162 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a8f8e-b2df-482b-8b5c-c93cd8554ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:15.539429 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a8f8e-b2df-482b-8b5c-c93cd8554ae3 admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:15.540194 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a8f8e-b2df-482b-8b5c-c93cd8554ae3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:15.543820 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a8f8e-b2df-482b-8b5c-c93cd8554ae3 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:15.574126 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1401/2796] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 21:02:15 2022] POST /identity/v3/users => generated 300 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:02:15.577374 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb68cd-d94e-4a8e-88de-a9bc1dc3e761 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:15.593719 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb68cd-d94e-4a8e-88de-a9bc1dc3e761 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:15.599651 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b18dd4-7aec-411c-a78f-58f1373c0604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:15.601769 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b18dd4-7aec-411c-a78f-58f1373c0604 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:15.604860 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b18dd4-7aec-411c-a78f-58f1373c0604 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:15.615119 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b18dd4-7aec-411c-a78f-58f1373c0604 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:15.616044 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b18dd4-7aec-411c-a78f-58f1373c0604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:15.618008 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b18dd4-7aec-411c-a78f-58f1373c0604 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:15.644537 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1396/2797] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:02:15.645672 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a8f8e-b2df-482b-8b5c-c93cd8554ae3 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:15.662715 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a8f8e-b2df-482b-8b5c-c93cd8554ae3 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:15.684118 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7136da-bb5b-4edc-b333-70d3ff8cedc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:15.686175 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7136da-bb5b-4edc-b333-70d3ff8cedc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:15.686559 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7136da-bb5b-4edc-b333-70d3ff8cedc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:15.686896 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7136da-bb5b-4edc-b333-70d3ff8cedc8 admin admin] PATH_INFO: `/v3/projects/11a1bde408454e039bedd62e6217f83b/users/f94855a1c3a14689ba6e0f29fa512034/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:15.707685 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7136da-bb5b-4edc-b333-70d3ff8cedc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11a1bde408454e039bedd62e6217f83b, user_id=f94855a1c3a14689ba6e0f29fa512034, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:15.711148 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7136da-bb5b-4edc-b333-70d3ff8cedc8 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:15.741352 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1402/2798] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:02:15 2022] PUT /identity/v3/projects/11a1bde408454e039bedd62e6217f83b/users/f94855a1c3a14689ba6e0f29fa512034/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:02:15.745048 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b18dd4-7aec-411c-a78f-58f1373c0604 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:15.759716 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b18dd4-7aec-411c-a78f-58f1373c0604 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:15.873460 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ce103-0d8a-42bb-b6b0-b7faf1d5fa22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:15.874135 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ce103-0d8a-42bb-b6b0-b7faf1d5fa22 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:15.874378 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ce103-0d8a-42bb-b6b0-b7faf1d5fa22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:15.874655 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ce103-0d8a-42bb-b6b0-b7faf1d5fa22 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:15.875683 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ce103-0d8a-42bb-b6b0-b7faf1d5fa22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:15.877980 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ce103-0d8a-42bb-b6b0-b7faf1d5fa22 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:15.894999 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1397/2799] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:02:15.895862 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7136da-bb5b-4edc-b333-70d3ff8cedc8 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:15.909977 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7136da-bb5b-4edc-b333-70d3ff8cedc8 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:15.923256 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22965674-0222-4dbc-9dbf-00250c6a9a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:15.924858 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22965674-0222-4dbc-9dbf-00250c6a9a99 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:15.925700 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22965674-0222-4dbc-9dbf-00250c6a9a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:15.926269 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22965674-0222-4dbc-9dbf-00250c6a9a99 admin admin] PATH_INFO: `/v3/projects/11a1bde408454e039bedd62e6217f83b/users/f94855a1c3a14689ba6e0f29fa512034/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:15.929815 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22965674-0222-4dbc-9dbf-00250c6a9a99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11a1bde408454e039bedd62e6217f83b, user_id=f94855a1c3a14689ba6e0f29fa512034, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:15.942482 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22965674-0222-4dbc-9dbf-00250c6a9a99 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:15.955342 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1403/2800] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:02:15 2022] PUT /identity/v3/projects/11a1bde408454e039bedd62e6217f83b/users/f94855a1c3a14689ba6e0f29fa512034/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 21:02:15.968976 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4854242-5601-4df3-bc61-02055c65ca8f None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:15.969306 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4854242-5601-4df3-bc61-02055c65ca8f None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:15.969664 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4854242-5601-4df3-bc61-02055c65ca8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:16.002524 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-f4854242-5601-4df3-bc61-02055c65ca8f None None] MFA Rules not processed for user `f94855a1c3a14689ba6e0f29fa512034`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:02:16.003781 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-f4854242-5601-4df3-bc61-02055c65ca8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:16.088098 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1398/2801] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:02:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:02:16.104478 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22965674-0222-4dbc-9dbf-00250c6a9a99 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:16.110643 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-22965674-0222-4dbc-9dbf-00250c6a9a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:16.229951 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22965674-0222-4dbc-9dbf-00250c6a9a99 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:16.235997 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59329ad2-05fc-4301-a5de-93df7d0a4f23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:16.237057 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59329ad2-05fc-4301-a5de-93df7d0a4f23 service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:16.239059 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59329ad2-05fc-4301-a5de-93df7d0a4f23 service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:16.239623 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59329ad2-05fc-4301-a5de-93df7d0a4f23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:16.253763 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59329ad2-05fc-4301-a5de-93df7d0a4f23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:16.255610 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59329ad2-05fc-4301-a5de-93df7d0a4f23 service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:16.292625 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1404/2802] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:02:16 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:02:16.338625 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4854242-5601-4df3-bc61-02055c65ca8f None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:16.421905 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4854242-5601-4df3-bc61-02055c65ca8f None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:16.427346 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02aeacb-bc39-4bd1-a636-1530b94dca6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:16.429153 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02aeacb-bc39-4bd1-a636-1530b94dca6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:16.429684 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02aeacb-bc39-4bd1-a636-1530b94dca6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:16.430282 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02aeacb-bc39-4bd1-a636-1530b94dca6a admin admin] PATH_INFO: `/v3/users/97ffd98342dd473097560e3a3afe0bbc` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:16.432091 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02aeacb-bc39-4bd1-a636-1530b94dca6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=97ffd98342dd473097560e3a3afe0bbc)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:16.435236 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02aeacb-bc39-4bd1-a636-1530b94dca6a admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:16.517275 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-b02aeacb-bc39-4bd1-a636-1530b94dca6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97ffd98342dd473097560e3a3afe0bbc'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:16.530130 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-b02aeacb-bc39-4bd1-a636-1530b94dca6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97ffd98342dd473097560e3a3afe0bbc'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:16.531283 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-b02aeacb-bc39-4bd1-a636-1530b94dca6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97ffd98342dd473097560e3a3afe0bbc'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:16.550347 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-b02aeacb-bc39-4bd1-a636-1530b94dca6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97ffd98342dd473097560e3a3afe0bbc'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:16.551088 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-b02aeacb-bc39-4bd1-a636-1530b94dca6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97ffd98342dd473097560e3a3afe0bbc'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:16.588568 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1399/2803] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:02:16 2022] DELETE /identity/v3/users/97ffd98342dd473097560e3a3afe0bbc => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:02:16.594458 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910a542-2f34-4b03-8d2d-9befc5d3f085 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:16.595032 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910a542-2f34-4b03-8d2d-9befc5d3f085 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:16.595346 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910a542-2f34-4b03-8d2d-9befc5d3f085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:16.629289 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-b910a542-2f34-4b03-8d2d-9befc5d3f085 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:02:16.630909 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-b910a542-2f34-4b03-8d2d-9befc5d3f085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:16.765629 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1405/2804] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:02:16.778835 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02aeacb-bc39-4bd1-a636-1530b94dca6a admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:16.781019 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-b02aeacb-bc39-4bd1-a636-1530b94dca6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:16.901465 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02aeacb-bc39-4bd1-a636-1530b94dca6a admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:16.905590 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7ec5a-ef4f-47a9-a28b-83fdd71aa603 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:16.906712 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7ec5a-ef4f-47a9-a28b-83fdd71aa603 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:16.906712 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7ec5a-ef4f-47a9-a28b-83fdd71aa603 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:16.906943 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7ec5a-ef4f-47a9-a28b-83fdd71aa603 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:16.919583 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7ec5a-ef4f-47a9-a28b-83fdd71aa603 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:16.923830 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7ec5a-ef4f-47a9-a28b-83fdd71aa603 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:16.941130 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1400/2805] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:02:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:02:17.705982 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910a542-2f34-4b03-8d2d-9befc5d3f085 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:17.708479 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-b910a542-2f34-4b03-8d2d-9befc5d3f085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:17.731728 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910a542-2f34-4b03-8d2d-9befc5d3f085 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:17.764412 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffec382-aaf0-4dc4-9d84-2c08b66b247b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:17.765318 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffec382-aaf0-4dc4-9d84-2c08b66b247b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:17.765603 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffec382-aaf0-4dc4-9d84-2c08b66b247b admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:17.765878 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffec382-aaf0-4dc4-9d84-2c08b66b247b admin admin] PATH_INFO: `/v3/projects/05babfc2bee8451caf6f17544c0fcda9` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:17.780944 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffec382-aaf0-4dc4-9d84-2c08b66b247b admin admin] RBAC: Authorizing `identity:delete_project(project_id=05babfc2bee8451caf6f17544c0fcda9)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:17.795892 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffec382-aaf0-4dc4-9d84-2c08b66b247b admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:17.957802 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-dffec382-aaf0-4dc4-9d84-2c08b66b247b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05babfc2bee8451caf6f17544c0fcda9', 'request_id': 'req-dffec382-aaf0-4dc4-9d84-2c08b66b247b'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:17.975402 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-dffec382-aaf0-4dc4-9d84-2c08b66b247b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05babfc2bee8451caf6f17544c0fcda9', 'request_id': 'req-dffec382-aaf0-4dc4-9d84-2c08b66b247b'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:17.991182 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadd2f3-8174-48d2-8143-6758fb5dfb72 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:17.991706 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadd2f3-8174-48d2-8143-6758fb5dfb72 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:17.992005 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadd2f3-8174-48d2-8143-6758fb5dfb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:17.996360 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-dffec382-aaf0-4dc4-9d84-2c08b66b247b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05babfc2bee8451caf6f17544c0fcda9', 'request_id': 'req-dffec382-aaf0-4dc4-9d84-2c08b66b247b'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:18.017599 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-dffec382-aaf0-4dc4-9d84-2c08b66b247b admin admin] The token cache is being invalidate because project 05babfc2bee8451caf6f17544c0fcda9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:02:18.018148 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-dffec382-aaf0-4dc4-9d84-2c08b66b247b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:18.024886 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-dffec382-aaf0-4dc4-9d84-2c08b66b247b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:18.027836 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1406/2806] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:02:17 2022] DELETE /identity/v3/projects/05babfc2bee8451caf6f17544c0fcda9 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:02:18.031907 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-9eadd2f3-8174-48d2-8143-6758fb5dfb72 None None] MFA Rules not processed for user `de477cdd9c8b4ad49c6eac58f107318a`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:02:18.032330 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffec382-aaf0-4dc4-9d84-2c08b66b247b admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:18.033892 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-dffec382-aaf0-4dc4-9d84-2c08b66b247b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:18.041638 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-9eadd2f3-8174-48d2-8143-6758fb5dfb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:18.180555 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffec382-aaf0-4dc4-9d84-2c08b66b247b admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:18.192152 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1401/2807] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:02:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:02:18.198975 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34590361-18b2-4b68-a95a-984543f673bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:18.203067 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34590361-18b2-4b68-a95a-984543f673bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:18.203768 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34590361-18b2-4b68-a95a-984543f673bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:18.204763 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34590361-18b2-4b68-a95a-984543f673bc admin admin] PATH_INFO: `/v3/users/f94855a1c3a14689ba6e0f29fa512034` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:18.207723 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34590361-18b2-4b68-a95a-984543f673bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f94855a1c3a14689ba6e0f29fa512034)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:18.216220 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34590361-18b2-4b68-a95a-984543f673bc admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:18.347638 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-34590361-18b2-4b68-a95a-984543f673bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f94855a1c3a14689ba6e0f29fa512034'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:18.363537 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-34590361-18b2-4b68-a95a-984543f673bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f94855a1c3a14689ba6e0f29fa512034'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:18.378803 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-34590361-18b2-4b68-a95a-984543f673bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f94855a1c3a14689ba6e0f29fa512034'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:18.384213 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-34590361-18b2-4b68-a95a-984543f673bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f94855a1c3a14689ba6e0f29fa512034'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:18.399565 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-34590361-18b2-4b68-a95a-984543f673bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f94855a1c3a14689ba6e0f29fa512034'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:18.407327 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1407/2808] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:02:18 2022] DELETE /identity/v3/users/f94855a1c3a14689ba6e0f29fa512034 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 21:02:18.849798 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eadd2f3-8174-48d2-8143-6758fb5dfb72 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:18.874313 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eadd2f3-8174-48d2-8143-6758fb5dfb72 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:18.991978 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6570fdc-2de0-46b7-9a8a-8b85559aea81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:18.992939 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6570fdc-2de0-46b7-9a8a-8b85559aea81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:18.993435 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6570fdc-2de0-46b7-9a8a-8b85559aea81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:18.993898 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6570fdc-2de0-46b7-9a8a-8b85559aea81 admin admin] PATH_INFO: `/v3/projects/11a1bde408454e039bedd62e6217f83b` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:18.995535 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6570fdc-2de0-46b7-9a8a-8b85559aea81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11a1bde408454e039bedd62e6217f83b)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:18.998269 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6570fdc-2de0-46b7-9a8a-8b85559aea81 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:19.063852 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-b6570fdc-2de0-46b7-9a8a-8b85559aea81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11a1bde408454e039bedd62e6217f83b', 'request_id': 'req-b6570fdc-2de0-46b7-9a8a-8b85559aea81'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:19.074156 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-b6570fdc-2de0-46b7-9a8a-8b85559aea81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11a1bde408454e039bedd62e6217f83b', 'request_id': 'req-b6570fdc-2de0-46b7-9a8a-8b85559aea81'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:19.083838 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-b6570fdc-2de0-46b7-9a8a-8b85559aea81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11a1bde408454e039bedd62e6217f83b', 'request_id': 'req-b6570fdc-2de0-46b7-9a8a-8b85559aea81'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:19.100944 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-b6570fdc-2de0-46b7-9a8a-8b85559aea81 admin admin] The token cache is being invalidate because project 11a1bde408454e039bedd62e6217f83b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:02:19.101236 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-b6570fdc-2de0-46b7-9a8a-8b85559aea81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:19.101879 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-b6570fdc-2de0-46b7-9a8a-8b85559aea81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:19.103844 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1402/2809] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:02:18 2022] DELETE /identity/v3/projects/11a1bde408454e039bedd62e6217f83b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:02:19.109600 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6c8e3-4301-41d7-ac85-30f119d7db39 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:19.111480 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6c8e3-4301-41d7-ac85-30f119d7db39 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:19.112016 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6c8e3-4301-41d7-ac85-30f119d7db39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:19.134929 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-a1f6c8e3-4301-41d7-ac85-30f119d7db39 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:02:19.138413 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-a1f6c8e3-4301-41d7-ac85-30f119d7db39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:19.314613 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1408/2810] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:02:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 21:02:19.330775 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642a8f8-025b-4b1d-86ae-cf41a2eecee4 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:19.331063 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642a8f8-025b-4b1d-86ae-cf41a2eecee4 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:19.331340 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642a8f8-025b-4b1d-86ae-cf41a2eecee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:19.376855 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-f642a8f8-025b-4b1d-86ae-cf41a2eecee4 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:02:19.378384 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-f642a8f8-025b-4b1d-86ae-cf41a2eecee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:19.393189 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1403/2811] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:02:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:02:19.397591 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6c8e3-4301-41d7-ac85-30f119d7db39 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:19.408295 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6c8e3-4301-41d7-ac85-30f119d7db39 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:19.415575 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2109190-62cf-4c74-9c06-405c1b7d214e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:19.417052 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2109190-62cf-4c74-9c06-405c1b7d214e admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:19.417705 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2109190-62cf-4c74-9c06-405c1b7d214e admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:19.418294 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2109190-62cf-4c74-9c06-405c1b7d214e admin admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:19.420149 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2109190-62cf-4c74-9c06-405c1b7d214e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 21:02:19.420737 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2109190-62cf-4c74-9c06-405c1b7d214e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:19.422940 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2109190-62cf-4c74-9c06-405c1b7d214e admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:19.487976 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1409/2812] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 21:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 21:02:19.493282 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642a8f8-025b-4b1d-86ae-cf41a2eecee4 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:19.507250 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642a8f8-025b-4b1d-86ae-cf41a2eecee4 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:19.523193 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75aeaf-d704-4983-9686-caf89057ba5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:19.524280 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75aeaf-d704-4983-9686-caf89057ba5f admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:19.524718 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75aeaf-d704-4983-9686-caf89057ba5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:19.525146 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75aeaf-d704-4983-9686-caf89057ba5f admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:19.526022 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75aeaf-d704-4983-9686-caf89057ba5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:19.544676 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75aeaf-d704-4983-9686-caf89057ba5f admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:19.598763 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1404/2813] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 21:02:19 2022] POST /identity/v3/projects => generated 391 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:02:19.600794 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2109190-62cf-4c74-9c06-405c1b7d214e admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:19.625256 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2109190-62cf-4c74-9c06-405c1b7d214e admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:19.766630 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b531da68-5829-40ed-afce-00bd95634437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:19.767506 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531da68-5829-40ed-afce-00bd95634437 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:19.768072 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531da68-5829-40ed-afce-00bd95634437 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:19.768347 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531da68-5829-40ed-afce-00bd95634437 admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:19.769087 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b531da68-5829-40ed-afce-00bd95634437 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:19.771137 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b531da68-5829-40ed-afce-00bd95634437 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:19.802131 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1410/2814] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 21:02:19 2022] POST /identity/v3/users => generated 296 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:02:19.812334 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75aeaf-d704-4983-9686-caf89057ba5f admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:19.823482 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75aeaf-d704-4983-9686-caf89057ba5f admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:19.843433 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ef64a-bebd-4d9b-86f7-89a75201a79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:19.844300 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ef64a-bebd-4d9b-86f7-89a75201a79c admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:19.844654 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ef64a-bebd-4d9b-86f7-89a75201a79c admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:19.845027 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ef64a-bebd-4d9b-86f7-89a75201a79c admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:19.854412 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ef64a-bebd-4d9b-86f7-89a75201a79c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:19.854412 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ef64a-bebd-4d9b-86f7-89a75201a79c admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:19.881050 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1405/2815] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:02:19.889054 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b531da68-5829-40ed-afce-00bd95634437 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:19.899584 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b531da68-5829-40ed-afce-00bd95634437 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:19.905605 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666fcd82-3150-4bc1-8c73-bcc379ee14dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:19.906274 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fcd82-3150-4bc1-8c73-bcc379ee14dd admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:19.906574 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fcd82-3150-4bc1-8c73-bcc379ee14dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:19.906834 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fcd82-3150-4bc1-8c73-bcc379ee14dd admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:19.907583 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666fcd82-3150-4bc1-8c73-bcc379ee14dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:19.909224 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666fcd82-3150-4bc1-8c73-bcc379ee14dd admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:19.920861 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1411/2816] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:02:19.924715 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ef64a-bebd-4d9b-86f7-89a75201a79c admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:19.938977 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ef64a-bebd-4d9b-86f7-89a75201a79c admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:19.948882 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8c925-6d56-4a9e-8799-1981dacd8ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:19.950889 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8c925-6d56-4a9e-8799-1981dacd8ca8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:19.951092 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8c925-6d56-4a9e-8799-1981dacd8ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:19.951259 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8c925-6d56-4a9e-8799-1981dacd8ca8 admin admin] PATH_INFO: `/v3/projects/e578b58108a84d948cd7e7709e72dd60/users/6993405af78e423d987ea2d2a6496a96/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:19.980530 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e8c925-6d56-4a9e-8799-1981dacd8ca8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e578b58108a84d948cd7e7709e72dd60, user_id=6993405af78e423d987ea2d2a6496a96, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:19.985242 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e8c925-6d56-4a9e-8799-1981dacd8ca8 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:20.010242 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1406/2817] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:02:19 2022] PUT /identity/v3/projects/e578b58108a84d948cd7e7709e72dd60/users/6993405af78e423d987ea2d2a6496a96/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:02:20.022193 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80834d-37c4-41f1-ad40-22ce5bf83410 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:20.022480 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80834d-37c4-41f1-ad40-22ce5bf83410 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:20.022762 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80834d-37c4-41f1-ad40-22ce5bf83410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:20.054343 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-2d80834d-37c4-41f1-ad40-22ce5bf83410 None None] MFA Rules not processed for user `6993405af78e423d987ea2d2a6496a96`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:02:20.055567 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-2d80834d-37c4-41f1-ad40-22ce5bf83410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:20.153700 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1412/2818] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:02:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:02:20.158740 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8c925-6d56-4a9e-8799-1981dacd8ca8 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:20.248748 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8c925-6d56-4a9e-8799-1981dacd8ca8 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:20.259002 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14037d29-8c02-4804-9a6b-a91755681646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:20.260748 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14037d29-8c02-4804-9a6b-a91755681646 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:20.261107 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14037d29-8c02-4804-9a6b-a91755681646 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:20.261489 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14037d29-8c02-4804-9a6b-a91755681646 admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:20.262564 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14037d29-8c02-4804-9a6b-a91755681646 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:20.265247 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14037d29-8c02-4804-9a6b-a91755681646 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:20.305160 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1407/2819] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 21:02:20 2022] POST /identity/v3/projects => generated 393 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 21:02:20.310951 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80834d-37c4-41f1-ad40-22ce5bf83410 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:20.323056 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80834d-37c4-41f1-ad40-22ce5bf83410 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:20.399396 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a535a2-d08b-475b-8223-041bde00e3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:20.400512 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a535a2-d08b-475b-8223-041bde00e3c6 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:20.400969 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a535a2-d08b-475b-8223-041bde00e3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:20.401244 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a535a2-d08b-475b-8223-041bde00e3c6 admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:20.401964 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a535a2-d08b-475b-8223-041bde00e3c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:20.404316 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a535a2-d08b-475b-8223-041bde00e3c6 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:20.429407 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1413/2820] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 21:02:20 2022] POST /identity/v3/users => generated 303 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:02:20.430619 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14037d29-8c02-4804-9a6b-a91755681646 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:20.441769 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14037d29-8c02-4804-9a6b-a91755681646 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:20.446492 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac03ebc-e962-4cd4-acb5-05434e2d5eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:20.447149 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac03ebc-e962-4cd4-acb5-05434e2d5eed admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:20.447426 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac03ebc-e962-4cd4-acb5-05434e2d5eed admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:20.447700 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac03ebc-e962-4cd4-acb5-05434e2d5eed admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:20.448669 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac03ebc-e962-4cd4-acb5-05434e2d5eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:20.450907 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac03ebc-e962-4cd4-acb5-05434e2d5eed admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:20.461850 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1408/2821] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:02:20.466265 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a535a2-d08b-475b-8223-041bde00e3c6 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:20.477129 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a535a2-d08b-475b-8223-041bde00e3c6 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:20.484474 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d296b0-1df6-4f10-a5f2-a6109e5e7ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:20.485619 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d296b0-1df6-4f10-a5f2-a6109e5e7ab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:20.485897 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d296b0-1df6-4f10-a5f2-a6109e5e7ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:20.486169 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d296b0-1df6-4f10-a5f2-a6109e5e7ab1 admin admin] PATH_INFO: `/v3/projects/a143e5d35f0845d2900cfda486bd3e84/users/98e2d219357d48aa9062bcb9dc0496a7/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:20.506221 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d296b0-1df6-4f10-a5f2-a6109e5e7ab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a143e5d35f0845d2900cfda486bd3e84, user_id=98e2d219357d48aa9062bcb9dc0496a7, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:20.509730 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d296b0-1df6-4f10-a5f2-a6109e5e7ab1 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:20.530398 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1414/2822] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:02:20 2022] PUT /identity/v3/projects/a143e5d35f0845d2900cfda486bd3e84/users/98e2d219357d48aa9062bcb9dc0496a7/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:02:20.534257 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac03ebc-e962-4cd4-acb5-05434e2d5eed admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:20.545699 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac03ebc-e962-4cd4-acb5-05434e2d5eed admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:20.676929 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677331b9-3900-4b28-9569-0650a3edc385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:20.678277 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677331b9-3900-4b28-9569-0650a3edc385 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:20.678751 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677331b9-3900-4b28-9569-0650a3edc385 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:20.679399 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677331b9-3900-4b28-9569-0650a3edc385 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:20.680367 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677331b9-3900-4b28-9569-0650a3edc385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:20.683461 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677331b9-3900-4b28-9569-0650a3edc385 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:20.701145 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1409/2823] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 21:02:20.702075 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d296b0-1df6-4f10-a5f2-a6109e5e7ab1 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:20.725032 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d296b0-1df6-4f10-a5f2-a6109e5e7ab1 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:20.743994 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2562b-c140-4cef-8a1c-736120b8bb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:20.744258 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2562b-c140-4cef-8a1c-736120b8bb64 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:20.744435 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2562b-c140-4cef-8a1c-736120b8bb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:20.744716 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2562b-c140-4cef-8a1c-736120b8bb64 admin admin] PATH_INFO: `/v3/projects/a143e5d35f0845d2900cfda486bd3e84/users/98e2d219357d48aa9062bcb9dc0496a7/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:20.748336 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2562b-c140-4cef-8a1c-736120b8bb64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a143e5d35f0845d2900cfda486bd3e84, user_id=98e2d219357d48aa9062bcb9dc0496a7, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:20.751779 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2562b-c140-4cef-8a1c-736120b8bb64 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:20.780988 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7aca20-7100-402a-8080-8bd8093d9b49 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:20.781319 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7aca20-7100-402a-8080-8bd8093d9b49 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:20.781692 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7aca20-7100-402a-8080-8bd8093d9b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:20.783121 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1415/2824] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:02:20 2022] PUT /identity/v3/projects/a143e5d35f0845d2900cfda486bd3e84/users/98e2d219357d48aa9062bcb9dc0496a7/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 21:02:20.815929 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-3f7aca20-7100-402a-8080-8bd8093d9b49 None None] MFA Rules not processed for user `98e2d219357d48aa9062bcb9dc0496a7`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:02:20.817167 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-3f7aca20-7100-402a-8080-8bd8093d9b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:20.901983 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1410/2825] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:02:20 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:02:20.913003 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2562b-c140-4cef-8a1c-736120b8bb64 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:20.914704 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-07b2562b-c140-4cef-8a1c-736120b8bb64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:20.980415 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2562b-c140-4cef-8a1c-736120b8bb64 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:20.984582 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50193771-e755-400f-8558-e7feef8ad426 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:20.985695 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50193771-e755-400f-8558-e7feef8ad426 service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:20.985848 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50193771-e755-400f-8558-e7feef8ad426 service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:20.986097 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50193771-e755-400f-8558-e7feef8ad426 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:21.008993 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50193771-e755-400f-8558-e7feef8ad426 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:21.011384 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50193771-e755-400f-8558-e7feef8ad426 service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:21.022145 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1416/2826] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:02:20 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:02:21.111954 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7aca20-7100-402a-8080-8bd8093d9b49 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:21.122868 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7aca20-7100-402a-8080-8bd8093d9b49 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:21.126532 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7e9bf-a75d-47ac-b732-5662f712dd69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:21.127171 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7e9bf-a75d-47ac-b732-5662f712dd69 service cinder] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:21.127441 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7e9bf-a75d-47ac-b732-5662f712dd69 service cinder] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:21.127706 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7e9bf-a75d-47ac-b732-5662f712dd69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:21.189223 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7e9bf-a75d-47ac-b732-5662f712dd69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:21.191119 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7e9bf-a75d-47ac-b732-5662f712dd69 service cinder] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:21.201587 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1411/2827] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:02:21 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:02:22.235840 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43814b42-b14f-4f37-95be-19053a6be107 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:22.236279 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43814b42-b14f-4f37-95be-19053a6be107 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:22.236389 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43814b42-b14f-4f37-95be-19053a6be107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:22.256098 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-43814b42-b14f-4f37-95be-19053a6be107 None None] MFA Rules not processed for user `78cde480dd8b4a85ac30895026bfc406`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:02:22.257303 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-43814b42-b14f-4f37-95be-19053a6be107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:22.315750 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1417/2828] 10.222.0.49 () {58 vars in 967 bytes} [Fri Oct 28 21:02:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:02:22.330836 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7e9bf-a75d-47ac-b732-5662f712dd69 service cinder] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:22.332329 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-41a7e9bf-a75d-47ac-b732-5662f712dd69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:22.406576 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7e9bf-a75d-47ac-b732-5662f712dd69 service cinder] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:22.411628 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a8f91-7408-4e7b-b030-e731825e6047 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d70db11d2d4923943bc6479bc49206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:22.412305 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a8f91-7408-4e7b-b030-e731825e6047 service swift] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:22.412580 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a8f91-7408-4e7b-b030-e731825e6047 service swift] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:22.412890 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a8f91-7408-4e7b-b030-e731825e6047 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:22.422121 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a8f91-7408-4e7b-b030-e731825e6047 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:22.423729 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a8f91-7408-4e7b-b030-e731825e6047 service swift] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:22.432051 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1412/2829] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Oct 28 21:02:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 21:02:24.421427 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43814b42-b14f-4f37-95be-19053a6be107 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:24.423318 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-43814b42-b14f-4f37-95be-19053a6be107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:24.489702 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43814b42-b14f-4f37-95be-19053a6be107 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:24.494406 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d7582-736d-40b3-b5b1-abc25c6081b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:24.495265 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d7582-736d-40b3-b5b1-abc25c6081b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:24.495545 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d7582-736d-40b3-b5b1-abc25c6081b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:24.495846 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d7582-736d-40b3-b5b1-abc25c6081b4 admin admin] PATH_INFO: `/v3/users/1774f109538d481fbe180c72ef200940` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:24.497171 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d7582-736d-40b3-b5b1-abc25c6081b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1774f109538d481fbe180c72ef200940)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:24.499418 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d7582-736d-40b3-b5b1-abc25c6081b4 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:24.546477 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-3a3d7582-736d-40b3-b5b1-abc25c6081b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1774f109538d481fbe180c72ef200940'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:24.553517 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-3a3d7582-736d-40b3-b5b1-abc25c6081b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1774f109538d481fbe180c72ef200940'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:24.561452 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-3a3d7582-736d-40b3-b5b1-abc25c6081b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1774f109538d481fbe180c72ef200940'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:24.562243 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-3a3d7582-736d-40b3-b5b1-abc25c6081b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1774f109538d481fbe180c72ef200940'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:24.575902 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-3a3d7582-736d-40b3-b5b1-abc25c6081b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1774f109538d481fbe180c72ef200940'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:24.593969 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1418/2830] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:02:24 2022] DELETE /identity/v3/users/1774f109538d481fbe180c72ef200940 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:02:24.683196 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a8f91-7408-4e7b-b030-e731825e6047 service swift] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:24.694842 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a8f91-7408-4e7b-b030-e731825e6047 service swift] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:24.751382 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b295510-efb6-4eef-b92b-9ee5736c48b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:24.752635 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b295510-efb6-4eef-b92b-9ee5736c48b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:24.753012 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b295510-efb6-4eef-b92b-9ee5736c48b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:24.753350 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b295510-efb6-4eef-b92b-9ee5736c48b9 admin admin] PATH_INFO: `/v3/users/6993405af78e423d987ea2d2a6496a96` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:24.754750 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b295510-efb6-4eef-b92b-9ee5736c48b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6993405af78e423d987ea2d2a6496a96)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:24.756891 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b295510-efb6-4eef-b92b-9ee5736c48b9 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:24.773093 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d7582-736d-40b3-b5b1-abc25c6081b4 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:24.774988 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-3a3d7582-736d-40b3-b5b1-abc25c6081b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:24.806411 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d7582-736d-40b3-b5b1-abc25c6081b4 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:24.811336 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-1b295510-efb6-4eef-b92b-9ee5736c48b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6993405af78e423d987ea2d2a6496a96'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:24.814945 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719898e0-75e5-4309-9d6e-7018966a21d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:24.815836 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719898e0-75e5-4309-9d6e-7018966a21d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:24.816122 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719898e0-75e5-4309-9d6e-7018966a21d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:24.816395 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719898e0-75e5-4309-9d6e-7018966a21d8 admin admin] PATH_INFO: `/v3/projects/bb3b9f179ad24392a4858db70f6b4dc0` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:24.817574 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719898e0-75e5-4309-9d6e-7018966a21d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb3b9f179ad24392a4858db70f6b4dc0)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:24.818433 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-1b295510-efb6-4eef-b92b-9ee5736c48b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6993405af78e423d987ea2d2a6496a96'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:24.819074 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-1b295510-efb6-4eef-b92b-9ee5736c48b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6993405af78e423d987ea2d2a6496a96'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:24.819482 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719898e0-75e5-4309-9d6e-7018966a21d8 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:24.832569 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-1b295510-efb6-4eef-b92b-9ee5736c48b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6993405af78e423d987ea2d2a6496a96'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:24.833298 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-1b295510-efb6-4eef-b92b-9ee5736c48b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6993405af78e423d987ea2d2a6496a96'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:24.848177 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1413/2831] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:02:24 2022] DELETE /identity/v3/users/6993405af78e423d987ea2d2a6496a96 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:02:24.852856 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448da5f2-e1e6-4d66-9a4d-342d0280a7c0 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:24.853148 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448da5f2-e1e6-4d66-9a4d-342d0280a7c0 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:24.853572 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448da5f2-e1e6-4d66-9a4d-342d0280a7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:24.868843 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-719898e0-75e5-4309-9d6e-7018966a21d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb3b9f179ad24392a4858db70f6b4dc0', 'request_id': 'req-719898e0-75e5-4309-9d6e-7018966a21d8'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:24.872672 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-448da5f2-e1e6-4d66-9a4d-342d0280a7c0 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:02:24.873919 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-448da5f2-e1e6-4d66-9a4d-342d0280a7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:24.875258 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-719898e0-75e5-4309-9d6e-7018966a21d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb3b9f179ad24392a4858db70f6b4dc0', 'request_id': 'req-719898e0-75e5-4309-9d6e-7018966a21d8'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:24.882545 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-719898e0-75e5-4309-9d6e-7018966a21d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb3b9f179ad24392a4858db70f6b4dc0', 'request_id': 'req-719898e0-75e5-4309-9d6e-7018966a21d8'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:24.894873 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-719898e0-75e5-4309-9d6e-7018966a21d8 admin admin] The token cache is being invalidate because project bb3b9f179ad24392a4858db70f6b4dc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:02:24.895153 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-719898e0-75e5-4309-9d6e-7018966a21d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:24.895806 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-719898e0-75e5-4309-9d6e-7018966a21d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:24.897351 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1419/2832] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:02:24 2022] DELETE /identity/v3/projects/bb3b9f179ad24392a4858db70f6b4dc0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:02:24.936531 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1414/2833] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 21:02:24.946584 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719898e0-75e5-4309-9d6e-7018966a21d8 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:24.948190 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-719898e0-75e5-4309-9d6e-7018966a21d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:25.011290 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719898e0-75e5-4309-9d6e-7018966a21d8 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:25.014940 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e77b3-30db-4499-830e-8e4a726bbebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:25.015603 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e77b3-30db-4499-830e-8e4a726bbebd service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:25.015924 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e77b3-30db-4499-830e-8e4a726bbebd service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:25.016202 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e77b3-30db-4499-830e-8e4a726bbebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:25.026396 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e77b3-30db-4499-830e-8e4a726bbebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:25.028580 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e77b3-30db-4499-830e-8e4a726bbebd service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:25.039098 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1420/2834] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:02:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:02:25.333074 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448da5f2-e1e6-4d66-9a4d-342d0280a7c0 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:25.336324 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-448da5f2-e1e6-4d66-9a4d-342d0280a7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:25.360194 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448da5f2-e1e6-4d66-9a4d-342d0280a7c0 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:25.365692 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0cf5d4-9855-465f-9cd2-961ee73db645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:25.374961 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cf5d4-9855-465f-9cd2-961ee73db645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:25.375409 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cf5d4-9855-465f-9cd2-961ee73db645 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:25.375575 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cf5d4-9855-465f-9cd2-961ee73db645 admin admin] PATH_INFO: `/v3/projects/e578b58108a84d948cd7e7709e72dd60` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:25.377359 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0cf5d4-9855-465f-9cd2-961ee73db645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e578b58108a84d948cd7e7709e72dd60)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:25.382329 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0cf5d4-9855-465f-9cd2-961ee73db645 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:25.436233 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0e0cf5d4-9855-465f-9cd2-961ee73db645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e578b58108a84d948cd7e7709e72dd60', 'request_id': 'req-0e0cf5d4-9855-465f-9cd2-961ee73db645'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:25.441806 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0e0cf5d4-9855-465f-9cd2-961ee73db645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e578b58108a84d948cd7e7709e72dd60', 'request_id': 'req-0e0cf5d4-9855-465f-9cd2-961ee73db645'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:25.448172 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0e0cf5d4-9855-465f-9cd2-961ee73db645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e578b58108a84d948cd7e7709e72dd60', 'request_id': 'req-0e0cf5d4-9855-465f-9cd2-961ee73db645'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:25.465766 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0e0cf5d4-9855-465f-9cd2-961ee73db645 admin admin] The token cache is being invalidate because project e578b58108a84d948cd7e7709e72dd60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:02:25.466579 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0e0cf5d4-9855-465f-9cd2-961ee73db645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:25.468445 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0e0cf5d4-9855-465f-9cd2-961ee73db645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:25.471255 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1415/2835] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:02:25 2022] DELETE /identity/v3/projects/e578b58108a84d948cd7e7709e72dd60 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:02:25.476428 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e77b3-30db-4499-830e-8e4a726bbebd service neutron] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:25.487880 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e77b3-30db-4499-830e-8e4a726bbebd service neutron] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:25.550778 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb217e7-7ce7-4e0d-a78f-a014140a7fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:25.551649 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb217e7-7ce7-4e0d-a78f-a014140a7fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:25.551953 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb217e7-7ce7-4e0d-a78f-a014140a7fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:25.552224 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb217e7-7ce7-4e0d-a78f-a014140a7fd5 admin admin] PATH_INFO: `/v3/users/98e2d219357d48aa9062bcb9dc0496a7` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:25.553376 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb217e7-7ce7-4e0d-a78f-a014140a7fd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98e2d219357d48aa9062bcb9dc0496a7)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:25.555263 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb217e7-7ce7-4e0d-a78f-a014140a7fd5 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:25.600394 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-9fb217e7-7ce7-4e0d-a78f-a014140a7fd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98e2d219357d48aa9062bcb9dc0496a7'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:25.607191 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-9fb217e7-7ce7-4e0d-a78f-a014140a7fd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98e2d219357d48aa9062bcb9dc0496a7'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:25.615051 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-9fb217e7-7ce7-4e0d-a78f-a014140a7fd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98e2d219357d48aa9062bcb9dc0496a7'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:25.615818 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-9fb217e7-7ce7-4e0d-a78f-a014140a7fd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98e2d219357d48aa9062bcb9dc0496a7'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:25.628551 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-9fb217e7-7ce7-4e0d-a78f-a014140a7fd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98e2d219357d48aa9062bcb9dc0496a7'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:25.635073 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1421/2836] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:02:25 2022] DELETE /identity/v3/users/98e2d219357d48aa9062bcb9dc0496a7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:02:25.900663 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0cf5d4-9855-465f-9cd2-961ee73db645 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:25.902101 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-0e0cf5d4-9855-465f-9cd2-961ee73db645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:25.914915 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0cf5d4-9855-465f-9cd2-961ee73db645 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:25.971459 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615265b-dd6c-445b-b129-72fc0ee6cb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:25.972351 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615265b-dd6c-445b-b129-72fc0ee6cb39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:25.972631 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615265b-dd6c-445b-b129-72fc0ee6cb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:25.972903 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615265b-dd6c-445b-b129-72fc0ee6cb39 admin admin] PATH_INFO: `/v3/projects/a143e5d35f0845d2900cfda486bd3e84` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:25.974071 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615265b-dd6c-445b-b129-72fc0ee6cb39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a143e5d35f0845d2900cfda486bd3e84)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:25.976005 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615265b-dd6c-445b-b129-72fc0ee6cb39 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:26.021596 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-1615265b-dd6c-445b-b129-72fc0ee6cb39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a143e5d35f0845d2900cfda486bd3e84', 'request_id': 'req-1615265b-dd6c-445b-b129-72fc0ee6cb39'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:26.026732 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-1615265b-dd6c-445b-b129-72fc0ee6cb39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a143e5d35f0845d2900cfda486bd3e84', 'request_id': 'req-1615265b-dd6c-445b-b129-72fc0ee6cb39'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:26.032754 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-1615265b-dd6c-445b-b129-72fc0ee6cb39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a143e5d35f0845d2900cfda486bd3e84', 'request_id': 'req-1615265b-dd6c-445b-b129-72fc0ee6cb39'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:26.045908 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-1615265b-dd6c-445b-b129-72fc0ee6cb39 admin admin] The token cache is being invalidate because project a143e5d35f0845d2900cfda486bd3e84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:02:26.045908 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-1615265b-dd6c-445b-b129-72fc0ee6cb39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:26.046394 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-1615265b-dd6c-445b-b129-72fc0ee6cb39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:26.047957 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1416/2837] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:02:25 2022] DELETE /identity/v3/projects/a143e5d35f0845d2900cfda486bd3e84 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:02:26.053649 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d689bab-dbbc-4aea-81dd-4efa75f034f6 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:26.053941 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d689bab-dbbc-4aea-81dd-4efa75f034f6 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:26.054218 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d689bab-dbbc-4aea-81dd-4efa75f034f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:26.072909 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-5d689bab-dbbc-4aea-81dd-4efa75f034f6 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:02:26.074041 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-5d689bab-dbbc-4aea-81dd-4efa75f034f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:26.133360 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1422/2838] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:02:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:02:26.141699 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fa535-b84b-45dd-b8e5-d5eb5d220a69 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:26.141982 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fa535-b84b-45dd-b8e5-d5eb5d220a69 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:26.142278 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fa535-b84b-45dd-b8e5-d5eb5d220a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:26.160757 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-6a5fa535-b84b-45dd-b8e5-d5eb5d220a69 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:02:26.161947 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-6a5fa535-b84b-45dd-b8e5-d5eb5d220a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:26.170181 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1417/2839] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:02:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 21:02:26.174532 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d689bab-dbbc-4aea-81dd-4efa75f034f6 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:26.184922 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d689bab-dbbc-4aea-81dd-4efa75f034f6 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:26.189522 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee78ee-cc63-4af6-8970-d1a4d218c860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:26.190170 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee78ee-cc63-4af6-8970-d1a4d218c860 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:26.190449 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee78ee-cc63-4af6-8970-d1a4d218c860 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:26.190721 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee78ee-cc63-4af6-8970-d1a4d218c860 admin admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:26.191438 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee78ee-cc63-4af6-8970-d1a4d218c860 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 21:02:26.191762 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee78ee-cc63-4af6-8970-d1a4d218c860 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:26.193372 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee78ee-cc63-4af6-8970-d1a4d218c860 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:26.205151 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1423/2840] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 21:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 21:02:26.209593 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fa535-b84b-45dd-b8e5-d5eb5d220a69 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:26.219319 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fa535-b84b-45dd-b8e5-d5eb5d220a69 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:26.228864 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273ded8-8d5a-4018-b263-40a90c8c58a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:26.228864 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273ded8-8d5a-4018-b263-40a90c8c58a2 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:26.228864 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273ded8-8d5a-4018-b263-40a90c8c58a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:26.228864 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273ded8-8d5a-4018-b263-40a90c8c58a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:26.229886 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273ded8-8d5a-4018-b263-40a90c8c58a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:26.229886 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273ded8-8d5a-4018-b263-40a90c8c58a2 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:26.253542 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1418/2841] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 21:02:26 2022] POST /identity/v3/projects => generated 399 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 21:02:26.257728 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee78ee-cc63-4af6-8970-d1a4d218c860 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:26.267598 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee78ee-cc63-4af6-8970-d1a4d218c860 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:26.322971 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad03dfb-68b6-4b25-a94b-68b0be9718a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:26.323637 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad03dfb-68b6-4b25-a94b-68b0be9718a8 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:26.323949 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad03dfb-68b6-4b25-a94b-68b0be9718a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:26.324225 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad03dfb-68b6-4b25-a94b-68b0be9718a8 admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:26.325201 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad03dfb-68b6-4b25-a94b-68b0be9718a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:26.327107 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad03dfb-68b6-4b25-a94b-68b0be9718a8 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:26.346858 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1424/2842] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 21:02:26 2022] POST /identity/v3/users => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:02:26.350922 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273ded8-8d5a-4018-b263-40a90c8c58a2 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:26.361659 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273ded8-8d5a-4018-b263-40a90c8c58a2 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:26.366275 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539db57-5446-460d-a8e8-c89031ba61f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:26.366924 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539db57-5446-460d-a8e8-c89031ba61f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:26.367310 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539db57-5446-460d-a8e8-c89031ba61f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:26.367589 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539db57-5446-460d-a8e8-c89031ba61f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:26.368358 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539db57-5446-460d-a8e8-c89031ba61f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:26.369955 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539db57-5446-460d-a8e8-c89031ba61f8 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:26.380574 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1419/2843] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:02:26.384509 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad03dfb-68b6-4b25-a94b-68b0be9718a8 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:26.394589 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad03dfb-68b6-4b25-a94b-68b0be9718a8 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:26.399216 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e5a22-993c-424a-9553-31c33f64a5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:26.399894 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e5a22-993c-424a-9553-31c33f64a5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:26.400178 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e5a22-993c-424a-9553-31c33f64a5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:26.400469 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e5a22-993c-424a-9553-31c33f64a5d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:26.401172 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e5a22-993c-424a-9553-31c33f64a5d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:26.403839 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e5a22-993c-424a-9553-31c33f64a5d1 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:26.413773 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1425/2844] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:02:26.418104 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539db57-5446-460d-a8e8-c89031ba61f8 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:26.428445 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539db57-5446-460d-a8e8-c89031ba61f8 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:26.433100 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41003737-70ae-46e8-9689-c7518877e4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:26.434278 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41003737-70ae-46e8-9689-c7518877e4b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:26.434562 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41003737-70ae-46e8-9689-c7518877e4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:26.434833 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41003737-70ae-46e8-9689-c7518877e4b3 admin admin] PATH_INFO: `/v3/projects/fa8a0d6c451a4e50a50ad9247386e523/users/d004692ca6504498ab1813d0aef8a865/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:26.449427 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41003737-70ae-46e8-9689-c7518877e4b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa8a0d6c451a4e50a50ad9247386e523, user_id=d004692ca6504498ab1813d0aef8a865, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:26.452104 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41003737-70ae-46e8-9689-c7518877e4b3 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:26.466454 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1420/2845] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:02:26 2022] PUT /identity/v3/projects/fa8a0d6c451a4e50a50ad9247386e523/users/d004692ca6504498ab1813d0aef8a865/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:02:26.476945 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e7a10-d17c-4ed1-8f3b-b4dc01c3e379 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:26.477427 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e7a10-d17c-4ed1-8f3b-b4dc01c3e379 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:26.477563 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e7a10-d17c-4ed1-8f3b-b4dc01c3e379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:26.504174 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-058e7a10-d17c-4ed1-8f3b-b4dc01c3e379 None None] MFA Rules not processed for user `d004692ca6504498ab1813d0aef8a865`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:02:26.505377 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-058e7a10-d17c-4ed1-8f3b-b4dc01c3e379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:26.573215 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1426/2846] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:02:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:02:26.578214 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41003737-70ae-46e8-9689-c7518877e4b3 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:26.657925 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41003737-70ae-46e8-9689-c7518877e4b3 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:26.664181 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052fdb06-148f-4214-a880-945705b90e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:26.665081 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fdb06-148f-4214-a880-945705b90e8c admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:26.665358 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fdb06-148f-4214-a880-945705b90e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:26.665664 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fdb06-148f-4214-a880-945705b90e8c admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:26.666461 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052fdb06-148f-4214-a880-945705b90e8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:26.669019 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052fdb06-148f-4214-a880-945705b90e8c admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:26.705056 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1421/2847] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 21:02:26 2022] POST /identity/v3/projects => generated 399 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:02:26.706269 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e7a10-d17c-4ed1-8f3b-b4dc01c3e379 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:26.717853 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e7a10-d17c-4ed1-8f3b-b4dc01c3e379 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:26.773496 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa95f5f-4c30-4a1c-9dc7-0a634634e069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:26.774177 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa95f5f-4c30-4a1c-9dc7-0a634634e069 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:26.774496 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa95f5f-4c30-4a1c-9dc7-0a634634e069 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:26.774980 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa95f5f-4c30-4a1c-9dc7-0a634634e069 admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:26.775692 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa95f5f-4c30-4a1c-9dc7-0a634634e069 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:26.777981 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa95f5f-4c30-4a1c-9dc7-0a634634e069 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:26.799283 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1427/2848] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 21:02:26 2022] POST /identity/v3/users => generated 306 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:02:26.803428 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052fdb06-148f-4214-a880-945705b90e8c admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:26.814329 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052fdb06-148f-4214-a880-945705b90e8c admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:26.818921 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5845f-265d-4452-b114-cfb6c7cafb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:26.819584 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5845f-265d-4452-b114-cfb6c7cafb82 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:26.819905 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5845f-265d-4452-b114-cfb6c7cafb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:26.820185 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5845f-265d-4452-b114-cfb6c7cafb82 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:26.820916 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5845f-265d-4452-b114-cfb6c7cafb82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:26.823101 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5845f-265d-4452-b114-cfb6c7cafb82 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:26.834529 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1422/2849] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:02:26.838878 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa95f5f-4c30-4a1c-9dc7-0a634634e069 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:26.850841 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa95f5f-4c30-4a1c-9dc7-0a634634e069 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:26.856840 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a57a1-7aca-4e6c-ae21-1b3823f05052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:26.857723 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a57a1-7aca-4e6c-ae21-1b3823f05052 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:26.858002 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a57a1-7aca-4e6c-ae21-1b3823f05052 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:26.858271 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a57a1-7aca-4e6c-ae21-1b3823f05052 admin admin] PATH_INFO: `/v3/projects/dc278153b61d41f0b4484e76ad07c8fc/users/c3f93dc9f4574817882968528aa22c1a/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:26.873251 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a57a1-7aca-4e6c-ae21-1b3823f05052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc278153b61d41f0b4484e76ad07c8fc, user_id=c3f93dc9f4574817882968528aa22c1a, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:26.876568 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a57a1-7aca-4e6c-ae21-1b3823f05052 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:26.890059 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1428/2850] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:02:26 2022] PUT /identity/v3/projects/dc278153b61d41f0b4484e76ad07c8fc/users/c3f93dc9f4574817882968528aa22c1a/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:02:26.894238 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5845f-265d-4452-b114-cfb6c7cafb82 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:26.904952 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5845f-265d-4452-b114-cfb6c7cafb82 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:26.958844 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ba218-b8d2-42c5-a861-13bca258d1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:26.959502 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ba218-b8d2-42c5-a861-13bca258d1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:26.959811 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ba218-b8d2-42c5-a861-13bca258d1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:26.960089 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ba218-b8d2-42c5-a861-13bca258d1d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:26.960808 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78ba218-b8d2-42c5-a861-13bca258d1d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:26.962402 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78ba218-b8d2-42c5-a861-13bca258d1d1 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:26.973258 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1423/2851] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:02:26.977493 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a57a1-7aca-4e6c-ae21-1b3823f05052 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:26.987892 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a57a1-7aca-4e6c-ae21-1b3823f05052 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:26.992357 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d93a06-6876-4a55-b457-48a97e267485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:26.993213 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d93a06-6876-4a55-b457-48a97e267485 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:26.993488 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d93a06-6876-4a55-b457-48a97e267485 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:26.993758 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d93a06-6876-4a55-b457-48a97e267485 admin admin] PATH_INFO: `/v3/projects/dc278153b61d41f0b4484e76ad07c8fc/users/c3f93dc9f4574817882968528aa22c1a/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:26.995686 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d93a06-6876-4a55-b457-48a97e267485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc278153b61d41f0b4484e76ad07c8fc, user_id=c3f93dc9f4574817882968528aa22c1a, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:26.998916 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d93a06-6876-4a55-b457-48a97e267485 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:27.008946 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1429/2852] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:02:26 2022] PUT /identity/v3/projects/dc278153b61d41f0b4484e76ad07c8fc/users/c3f93dc9f4574817882968528aa22c1a/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:02:27.020796 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae129fa8-a334-4f4a-8b28-cffb8f9e430c None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:27.021083 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae129fa8-a334-4f4a-8b28-cffb8f9e430c None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:27.021361 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae129fa8-a334-4f4a-8b28-cffb8f9e430c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:27.047134 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-ae129fa8-a334-4f4a-8b28-cffb8f9e430c None None] MFA Rules not processed for user `c3f93dc9f4574817882968528aa22c1a`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:02:27.048339 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-ae129fa8-a334-4f4a-8b28-cffb8f9e430c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:27.116721 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1424/2853] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:02:27 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:02:27.129150 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d93a06-6876-4a55-b457-48a97e267485 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:27.130962 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-b4d93a06-6876-4a55-b457-48a97e267485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:27.188115 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d93a06-6876-4a55-b457-48a97e267485 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:27.191963 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b68a13-00e1-44f1-9bc9-c68cc17fbc84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:27.192601 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b68a13-00e1-44f1-9bc9-c68cc17fbc84 service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:27.192884 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b68a13-00e1-44f1-9bc9-c68cc17fbc84 service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:27.193159 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b68a13-00e1-44f1-9bc9-c68cc17fbc84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:27.202839 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b68a13-00e1-44f1-9bc9-c68cc17fbc84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:27.204300 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b68a13-00e1-44f1-9bc9-c68cc17fbc84 service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:27.213506 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1430/2854] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:02:27 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:02:27.296493 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae129fa8-a334-4f4a-8b28-cffb8f9e430c None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:27.306625 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae129fa8-a334-4f4a-8b28-cffb8f9e430c None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:27.311093 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77683c6-0adb-47be-a655-cd72d3e567a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:27.311760 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77683c6-0adb-47be-a655-cd72d3e567a6 service cinder] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:27.312061 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77683c6-0adb-47be-a655-cd72d3e567a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:27.312353 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77683c6-0adb-47be-a655-cd72d3e567a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:27.367460 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77683c6-0adb-47be-a655-cd72d3e567a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:27.368842 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77683c6-0adb-47be-a655-cd72d3e567a6 service cinder] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:27.378383 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1425/2855] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:02:27 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:02:28.290243 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b68a13-00e1-44f1-9bc9-c68cc17fbc84 service cinder] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:28.291842 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-20b68a13-00e1-44f1-9bc9-c68cc17fbc84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:28.358468 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b68a13-00e1-44f1-9bc9-c68cc17fbc84 service cinder] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:28.363004 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7ee1d-7154-4a14-9492-e12f5f34af81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:28.363905 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7ee1d-7154-4a14-9492-e12f5f34af81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:28.364183 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7ee1d-7154-4a14-9492-e12f5f34af81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:28.364455 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7ee1d-7154-4a14-9492-e12f5f34af81 admin admin] PATH_INFO: `/v3/users/0e7a065d7e5f442fb841328777b64d51` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:28.365620 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7ee1d-7154-4a14-9492-e12f5f34af81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e7a065d7e5f442fb841328777b64d51)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:28.367521 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7ee1d-7154-4a14-9492-e12f5f34af81 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:28.413922 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-18c7ee1d-7154-4a14-9492-e12f5f34af81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e7a065d7e5f442fb841328777b64d51'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:28.421174 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-18c7ee1d-7154-4a14-9492-e12f5f34af81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e7a065d7e5f442fb841328777b64d51'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:28.428315 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-18c7ee1d-7154-4a14-9492-e12f5f34af81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e7a065d7e5f442fb841328777b64d51'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:28.428923 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-18c7ee1d-7154-4a14-9492-e12f5f34af81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e7a065d7e5f442fb841328777b64d51'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:28.440868 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-18c7ee1d-7154-4a14-9492-e12f5f34af81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e7a065d7e5f442fb841328777b64d51'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:28.446602 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1431/2856] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:02:28 2022] DELETE /identity/v3/users/0e7a065d7e5f442fb841328777b64d51 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:02:28.616824 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77683c6-0adb-47be-a655-cd72d3e567a6 service cinder] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:28.628067 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77683c6-0adb-47be-a655-cd72d3e567a6 service cinder] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:28.686539 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa259a-f8a0-4bec-b626-bee5fc99ab64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:28.687398 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa259a-f8a0-4bec-b626-bee5fc99ab64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:28.687725 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa259a-f8a0-4bec-b626-bee5fc99ab64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:28.688014 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa259a-f8a0-4bec-b626-bee5fc99ab64 admin admin] PATH_INFO: `/v3/projects/4cf31f6da5c044e4b3664270104192c8` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:28.689191 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa259a-f8a0-4bec-b626-bee5fc99ab64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cf31f6da5c044e4b3664270104192c8)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:28.691075 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa259a-f8a0-4bec-b626-bee5fc99ab64 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:28.737383 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0caa259a-f8a0-4bec-b626-bee5fc99ab64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cf31f6da5c044e4b3664270104192c8', 'request_id': 'req-0caa259a-f8a0-4bec-b626-bee5fc99ab64'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:28.742913 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0caa259a-f8a0-4bec-b626-bee5fc99ab64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cf31f6da5c044e4b3664270104192c8', 'request_id': 'req-0caa259a-f8a0-4bec-b626-bee5fc99ab64'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:28.749445 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0caa259a-f8a0-4bec-b626-bee5fc99ab64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cf31f6da5c044e4b3664270104192c8', 'request_id': 'req-0caa259a-f8a0-4bec-b626-bee5fc99ab64'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:28.763970 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0caa259a-f8a0-4bec-b626-bee5fc99ab64 admin admin] The token cache is being invalidate because project 4cf31f6da5c044e4b3664270104192c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:02:28.763970 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0caa259a-f8a0-4bec-b626-bee5fc99ab64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:28.763970 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-0caa259a-f8a0-4bec-b626-bee5fc99ab64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:28.765590 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1426/2857] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:02:28 2022] DELETE /identity/v3/projects/4cf31f6da5c044e4b3664270104192c8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:02:31.462961 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7ee1d-7154-4a14-9492-e12f5f34af81 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:31.464466 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-18c7ee1d-7154-4a14-9492-e12f5f34af81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:31.478552 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7ee1d-7154-4a14-9492-e12f5f34af81 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:31.539171 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d818e5d-eb15-4066-a918-a84ef7dd89d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:31.540086 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d818e5d-eb15-4066-a918-a84ef7dd89d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:31.540412 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d818e5d-eb15-4066-a918-a84ef7dd89d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:31.540690 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d818e5d-eb15-4066-a918-a84ef7dd89d7 admin admin] PATH_INFO: `/v3/users/d004692ca6504498ab1813d0aef8a865` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:31.541889 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d818e5d-eb15-4066-a918-a84ef7dd89d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d004692ca6504498ab1813d0aef8a865)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:31.544513 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d818e5d-eb15-4066-a918-a84ef7dd89d7 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:31.590154 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-4d818e5d-eb15-4066-a918-a84ef7dd89d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd004692ca6504498ab1813d0aef8a865'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:31.597266 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-4d818e5d-eb15-4066-a918-a84ef7dd89d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd004692ca6504498ab1813d0aef8a865'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:31.604513 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-4d818e5d-eb15-4066-a918-a84ef7dd89d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd004692ca6504498ab1813d0aef8a865'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:31.605137 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-4d818e5d-eb15-4066-a918-a84ef7dd89d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd004692ca6504498ab1813d0aef8a865'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:31.617866 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-4d818e5d-eb15-4066-a918-a84ef7dd89d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd004692ca6504498ab1813d0aef8a865'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:31.623917 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1432/2858] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:02:31 2022] DELETE /identity/v3/users/d004692ca6504498ab1813d0aef8a865 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:02:31.628465 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f1e4b-8b3f-4f94-b23f-f59d74bb0cb8 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:31.628929 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f1e4b-8b3f-4f94-b23f-f59d74bb0cb8 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:31.629042 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f1e4b-8b3f-4f94-b23f-f59d74bb0cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:31.647125 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-dc1f1e4b-8b3f-4f94-b23f-f59d74bb0cb8 None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:02:31.648424 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-dc1f1e4b-8b3f-4f94-b23f-f59d74bb0cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:31.713331 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1427/2859] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 21:02:31.724161 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d818e5d-eb15-4066-a918-a84ef7dd89d7 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:31.725586 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-4d818e5d-eb15-4066-a918-a84ef7dd89d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:31.788497 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d818e5d-eb15-4066-a918-a84ef7dd89d7 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:31.792179 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea00f8-387d-47bf-aefb-a8db869b2432 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:31.792839 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea00f8-387d-47bf-aefb-a8db869b2432 service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:31.793123 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea00f8-387d-47bf-aefb-a8db869b2432 service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:31.793403 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea00f8-387d-47bf-aefb-a8db869b2432 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:31.804794 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea00f8-387d-47bf-aefb-a8db869b2432 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:31.806258 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea00f8-387d-47bf-aefb-a8db869b2432 service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:31.817650 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1433/2860] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:02:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:02:32.097325 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f1e4b-8b3f-4f94-b23f-f59d74bb0cb8 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:32.098954 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-dc1f1e4b-8b3f-4f94-b23f-f59d74bb0cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:32.113163 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f1e4b-8b3f-4f94-b23f-f59d74bb0cb8 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:32.117947 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c2112-9a42-4653-b7ea-355f707f8edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:32.118816 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c2112-9a42-4653-b7ea-355f707f8edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:32.119091 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c2112-9a42-4653-b7ea-355f707f8edb admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:32.119361 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c2112-9a42-4653-b7ea-355f707f8edb admin admin] PATH_INFO: `/v3/projects/fa8a0d6c451a4e50a50ad9247386e523` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:32.120588 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c2112-9a42-4653-b7ea-355f707f8edb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa8a0d6c451a4e50a50ad9247386e523)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:32.122812 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c2112-9a42-4653-b7ea-355f707f8edb admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:32.171475 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-da3c2112-9a42-4653-b7ea-355f707f8edb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa8a0d6c451a4e50a50ad9247386e523', 'request_id': 'req-da3c2112-9a42-4653-b7ea-355f707f8edb'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:32.176769 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-da3c2112-9a42-4653-b7ea-355f707f8edb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa8a0d6c451a4e50a50ad9247386e523', 'request_id': 'req-da3c2112-9a42-4653-b7ea-355f707f8edb'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:32.183121 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-da3c2112-9a42-4653-b7ea-355f707f8edb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa8a0d6c451a4e50a50ad9247386e523', 'request_id': 'req-da3c2112-9a42-4653-b7ea-355f707f8edb'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:32.196217 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-da3c2112-9a42-4653-b7ea-355f707f8edb admin admin] The token cache is being invalidate because project fa8a0d6c451a4e50a50ad9247386e523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:02:32.196501 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-da3c2112-9a42-4653-b7ea-355f707f8edb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:32.197168 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-da3c2112-9a42-4653-b7ea-355f707f8edb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:32.198967 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1428/2861] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:02:32 2022] DELETE /identity/v3/projects/fa8a0d6c451a4e50a50ad9247386e523 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:02:32.203733 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea00f8-387d-47bf-aefb-a8db869b2432 service neutron] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:32.214124 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea00f8-387d-47bf-aefb-a8db869b2432 service neutron] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:32.276415 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d6ffd-0b8b-4702-9412-df21df1b2996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:32.277405 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d6ffd-0b8b-4702-9412-df21df1b2996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:32.277566 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d6ffd-0b8b-4702-9412-df21df1b2996 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:32.277838 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d6ffd-0b8b-4702-9412-df21df1b2996 admin admin] PATH_INFO: `/v3/users/c3f93dc9f4574817882968528aa22c1a` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:32.279600 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7d6ffd-0b8b-4702-9412-df21df1b2996 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3f93dc9f4574817882968528aa22c1a)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:32.281577 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7d6ffd-0b8b-4702-9412-df21df1b2996 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:32.332152 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-6f7d6ffd-0b8b-4702-9412-df21df1b2996 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3f93dc9f4574817882968528aa22c1a'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:32.338816 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-6f7d6ffd-0b8b-4702-9412-df21df1b2996 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3f93dc9f4574817882968528aa22c1a'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:32.346257 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-6f7d6ffd-0b8b-4702-9412-df21df1b2996 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3f93dc9f4574817882968528aa22c1a'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:32.346898 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-6f7d6ffd-0b8b-4702-9412-df21df1b2996 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3f93dc9f4574817882968528aa22c1a'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:32.358692 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-6f7d6ffd-0b8b-4702-9412-df21df1b2996 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3f93dc9f4574817882968528aa22c1a'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:32.364501 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1434/2862] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:02:32 2022] DELETE /identity/v3/users/c3f93dc9f4574817882968528aa22c1a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:02:32.658469 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c2112-9a42-4653-b7ea-355f707f8edb admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:32.659983 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-da3c2112-9a42-4653-b7ea-355f707f8edb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:32.674160 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c2112-9a42-4653-b7ea-355f707f8edb admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:32.740701 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c93f32-5361-4118-b198-d01bf4c846da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:32.741671 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c93f32-5361-4118-b198-d01bf4c846da admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:32.742120 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c93f32-5361-4118-b198-d01bf4c846da admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:32.742501 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c93f32-5361-4118-b198-d01bf4c846da admin admin] PATH_INFO: `/v3/projects/dc278153b61d41f0b4484e76ad07c8fc` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:32.743985 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c93f32-5361-4118-b198-d01bf4c846da admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc278153b61d41f0b4484e76ad07c8fc)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:32.746003 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c93f32-5361-4118-b198-d01bf4c846da admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:32.793490 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-c4c93f32-5361-4118-b198-d01bf4c846da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc278153b61d41f0b4484e76ad07c8fc', 'request_id': 'req-c4c93f32-5361-4118-b198-d01bf4c846da'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:32.799235 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-c4c93f32-5361-4118-b198-d01bf4c846da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc278153b61d41f0b4484e76ad07c8fc', 'request_id': 'req-c4c93f32-5361-4118-b198-d01bf4c846da'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:32.805727 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-c4c93f32-5361-4118-b198-d01bf4c846da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc278153b61d41f0b4484e76ad07c8fc', 'request_id': 'req-c4c93f32-5361-4118-b198-d01bf4c846da'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:32.818468 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-c4c93f32-5361-4118-b198-d01bf4c846da admin admin] The token cache is being invalidate because project dc278153b61d41f0b4484e76ad07c8fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:02:32.818750 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-c4c93f32-5361-4118-b198-d01bf4c846da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:32.819360 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-c4c93f32-5361-4118-b198-d01bf4c846da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:32.820947 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1429/2863] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:02:32 2022] DELETE /identity/v3/projects/dc278153b61d41f0b4484e76ad07c8fc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:02:32.826094 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452281f-ad1f-42de-b996-6cd59268ca2e None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:32.826619 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452281f-ad1f-42de-b996-6cd59268ca2e None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:32.826619 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452281f-ad1f-42de-b996-6cd59268ca2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:32.846030 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-9452281f-ad1f-42de-b996-6cd59268ca2e None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:02:32.847237 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-9452281f-ad1f-42de-b996-6cd59268ca2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:32.905307 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1435/2864] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 21:02:32.912992 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa6e5d-e793-433e-ac5b-44646fb3867e None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:32.913277 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa6e5d-e793-433e-ac5b-44646fb3867e None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:32.913558 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa6e5d-e793-433e-ac5b-44646fb3867e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:32.933343 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-b4aa6e5d-e793-433e-ac5b-44646fb3867e None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:02:32.935263 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-b4aa6e5d-e793-433e-ac5b-44646fb3867e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:32.942957 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1430/2865] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:02:32.947139 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452281f-ad1f-42de-b996-6cd59268ca2e None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:32.956571 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452281f-ad1f-42de-b996-6cd59268ca2e None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:32.961009 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff83e85-e261-4657-b15f-0c377f936f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:32.961647 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff83e85-e261-4657-b15f-0c377f936f98 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:32.961924 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff83e85-e261-4657-b15f-0c377f936f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:32.962194 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff83e85-e261-4657-b15f-0c377f936f98 admin admin] PATH_INFO: `/v3/domains` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:32.962899 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff83e85-e261-4657-b15f-0c377f936f98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91652) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 21:02:32.963198 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff83e85-e261-4657-b15f-0c377f936f98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:32.964806 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff83e85-e261-4657-b15f-0c377f936f98 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:32.976597 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1436/2866] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 21:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 21:02:32.981132 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa6e5d-e793-433e-ac5b-44646fb3867e None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:32.990869 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa6e5d-e793-433e-ac5b-44646fb3867e None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:32.995479 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4a594-78c7-4473-bb69-3432002f048b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:32.996163 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4a594-78c7-4473-bb69-3432002f048b admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:32.996437 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4a594-78c7-4473-bb69-3432002f048b admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:32.996707 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4a594-78c7-4473-bb69-3432002f048b admin admin] PATH_INFO: `/v3/projects` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:32.997482 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4a594-78c7-4473-bb69-3432002f048b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:32.999359 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4a594-78c7-4473-bb69-3432002f048b admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:33.024749 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1431/2867] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 21:02:32 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:02:33.029650 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff83e85-e261-4657-b15f-0c377f936f98 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:33.039444 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff83e85-e261-4657-b15f-0c377f936f98 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:33.094026 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a63bd-3025-42e3-9fc5-302639f903e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:33.094601 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a63bd-3025-42e3-9fc5-302639f903e9 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:33.094880 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a63bd-3025-42e3-9fc5-302639f903e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:33.095154 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a63bd-3025-42e3-9fc5-302639f903e9 admin admin] PATH_INFO: `/v3/users` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:33.095868 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a63bd-3025-42e3-9fc5-302639f903e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:33.097776 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a63bd-3025-42e3-9fc5-302639f903e9 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:33.118178 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1437/2868] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 21:02:33 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:02:33.122381 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4a594-78c7-4473-bb69-3432002f048b admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:33.133183 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4a594-78c7-4473-bb69-3432002f048b admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:33.137736 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b207749-5cb5-4b4d-8256-c5ce8d6b7a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:33.138380 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b207749-5cb5-4b4d-8256-c5ce8d6b7a8c admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:33.138655 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b207749-5cb5-4b4d-8256-c5ce8d6b7a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:33.138919 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b207749-5cb5-4b4d-8256-c5ce8d6b7a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:33.139623 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b207749-5cb5-4b4d-8256-c5ce8d6b7a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:33.141239 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b207749-5cb5-4b4d-8256-c5ce8d6b7a8c admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:33.151663 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1432/2869] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:02:33.156301 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a63bd-3025-42e3-9fc5-302639f903e9 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:33.166213 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a63bd-3025-42e3-9fc5-302639f903e9 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:33.171546 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8d489-7257-463a-ae51-9843e6b90cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:33.172229 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8d489-7257-463a-ae51-9843e6b90cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:33.172513 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8d489-7257-463a-ae51-9843e6b90cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:33.172787 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8d489-7257-463a-ae51-9843e6b90cc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:33.173506 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d8d489-7257-463a-ae51-9843e6b90cc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:33.175111 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d8d489-7257-463a-ae51-9843e6b90cc2 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:33.185034 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1438/2870] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:02:33.189172 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b207749-5cb5-4b4d-8256-c5ce8d6b7a8c admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:33.198782 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b207749-5cb5-4b4d-8256-c5ce8d6b7a8c admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:33.203512 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4422d2-3607-4e96-83b9-ffaabd9ff391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:33.204423 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4422d2-3607-4e96-83b9-ffaabd9ff391 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:33.204740 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4422d2-3607-4e96-83b9-ffaabd9ff391 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:33.205143 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4422d2-3607-4e96-83b9-ffaabd9ff391 admin admin] PATH_INFO: `/v3/projects/7eecdd3e8ad241d6857ad6483943f68d/users/0a2d2a0d61994df9ac786e0cbed160c6/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:33.221092 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4422d2-3607-4e96-83b9-ffaabd9ff391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eecdd3e8ad241d6857ad6483943f68d, user_id=0a2d2a0d61994df9ac786e0cbed160c6, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:33.223772 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4422d2-3607-4e96-83b9-ffaabd9ff391 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:33.237390 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1433/2871] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:02:33 2022] PUT /identity/v3/projects/7eecdd3e8ad241d6857ad6483943f68d/users/0a2d2a0d61994df9ac786e0cbed160c6/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 21:02:33.308750 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb316f83-0273-423b-bebf-965bb7ce1fde None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:33.309036 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb316f83-0273-423b-bebf-965bb7ce1fde None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:33.309340 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb316f83-0273-423b-bebf-965bb7ce1fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:33.336739 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-fb316f83-0273-423b-bebf-965bb7ce1fde None None] MFA Rules not processed for user `0a2d2a0d61994df9ac786e0cbed160c6`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:02:33.338200 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-fb316f83-0273-423b-bebf-965bb7ce1fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:33.410618 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1439/2872] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:02:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:02:33.424336 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4422d2-3607-4e96-83b9-ffaabd9ff391 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:33.426054 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-8e4422d2-3607-4e96-83b9-ffaabd9ff391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:33.482174 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4422d2-3607-4e96-83b9-ffaabd9ff391 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:33.485921 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249c53b-f08f-456c-aa48-00dbeeaabe5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:33.486559 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249c53b-f08f-456c-aa48-00dbeeaabe5f service cinder] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:33.486838 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249c53b-f08f-456c-aa48-00dbeeaabe5f service cinder] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:33.487111 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249c53b-f08f-456c-aa48-00dbeeaabe5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:33.495221 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a249c53b-f08f-456c-aa48-00dbeeaabe5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:33.496684 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a249c53b-f08f-456c-aa48-00dbeeaabe5f service cinder] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:33.505911 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1434/2873] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:02:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:02:33.524725 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb316f83-0273-423b-bebf-965bb7ce1fde None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:33.585307 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb316f83-0273-423b-bebf-965bb7ce1fde None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:33.589799 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc134c56-8c36-4224-9385-f4696147a2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:33.590702 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc134c56-8c36-4224-9385-f4696147a2cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:33.591060 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc134c56-8c36-4224-9385-f4696147a2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:33.591504 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc134c56-8c36-4224-9385-f4696147a2cf admin admin] PATH_INFO: `/v3/users/0a2d2a0d61994df9ac786e0cbed160c6` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:33.592728 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc134c56-8c36-4224-9385-f4696147a2cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a2d2a0d61994df9ac786e0cbed160c6)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:33.594632 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc134c56-8c36-4224-9385-f4696147a2cf admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:33.639849 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-dc134c56-8c36-4224-9385-f4696147a2cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a2d2a0d61994df9ac786e0cbed160c6'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:33.646798 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-dc134c56-8c36-4224-9385-f4696147a2cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a2d2a0d61994df9ac786e0cbed160c6'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:33.653449 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-dc134c56-8c36-4224-9385-f4696147a2cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a2d2a0d61994df9ac786e0cbed160c6'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:33.654133 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-dc134c56-8c36-4224-9385-f4696147a2cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a2d2a0d61994df9ac786e0cbed160c6'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:33.665593 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-dc134c56-8c36-4224-9385-f4696147a2cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a2d2a0d61994df9ac786e0cbed160c6'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:33.672532 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1440/2874] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:02:33 2022] DELETE /identity/v3/users/0a2d2a0d61994df9ac786e0cbed160c6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:02:33.677308 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec25f14-0269-4698-89fe-cce8fb21af3d None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:33.677831 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec25f14-0269-4698-89fe-cce8fb21af3d None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:33.677831 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec25f14-0269-4698-89fe-cce8fb21af3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:33.695716 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-fec25f14-0269-4698-89fe-cce8fb21af3d None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:02:33.696954 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-fec25f14-0269-4698-89fe-cce8fb21af3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:33.755059 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1435/2875] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:02:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:02:33.765245 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc134c56-8c36-4224-9385-f4696147a2cf admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:33.766652 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-dc134c56-8c36-4224-9385-f4696147a2cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:33.828569 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc134c56-8c36-4224-9385-f4696147a2cf admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:33.832300 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830d64c-d997-4a31-9009-88582bb0ce8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:33.832945 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830d64c-d997-4a31-9009-88582bb0ce8f service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:33.833243 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830d64c-d997-4a31-9009-88582bb0ce8f service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:33.833495 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830d64c-d997-4a31-9009-88582bb0ce8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:33.843677 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1830d64c-d997-4a31-9009-88582bb0ce8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:33.845163 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1830d64c-d997-4a31-9009-88582bb0ce8f service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:33.855015 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1441/2876] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:02:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:02:34.183334 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec25f14-0269-4698-89fe-cce8fb21af3d None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:34.194116 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec25f14-0269-4698-89fe-cce8fb21af3d None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:34.198845 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee13c38-bcc3-40e1-9b21-03592ee97fac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:34.199565 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee13c38-bcc3-40e1-9b21-03592ee97fac service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:34.201482 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830d64c-d997-4a31-9009-88582bb0ce8f service neutron] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:34.202804 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-1830d64c-d997-4a31-9009-88582bb0ce8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:34.207374 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee13c38-bcc3-40e1-9b21-03592ee97fac service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:34.207665 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee13c38-bcc3-40e1-9b21-03592ee97fac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:34.209752 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-0ee13c38-bcc3-40e1-9b21-03592ee97fac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:34.218111 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830d64c-d997-4a31-9009-88582bb0ce8f service neutron] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:34.223545 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960cbcf-d9c5-4664-b636-a0101c2e88aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:34.225140 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960cbcf-d9c5-4664-b636-a0101c2e88aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:34.225140 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960cbcf-d9c5-4664-b636-a0101c2e88aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:34.225331 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960cbcf-d9c5-4664-b636-a0101c2e88aa admin admin] PATH_INFO: `/v3/projects/7eecdd3e8ad241d6857ad6483943f68d` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:34.226612 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960cbcf-d9c5-4664-b636-a0101c2e88aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eecdd3e8ad241d6857ad6483943f68d)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:34.228666 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960cbcf-d9c5-4664-b636-a0101c2e88aa admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:34.279596 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-1960cbcf-d9c5-4664-b636-a0101c2e88aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eecdd3e8ad241d6857ad6483943f68d', 'request_id': 'req-1960cbcf-d9c5-4664-b636-a0101c2e88aa'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:34.280071 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee13c38-bcc3-40e1-9b21-03592ee97fac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:34.281520 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee13c38-bcc3-40e1-9b21-03592ee97fac service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:34.285286 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-1960cbcf-d9c5-4664-b636-a0101c2e88aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eecdd3e8ad241d6857ad6483943f68d', 'request_id': 'req-1960cbcf-d9c5-4664-b636-a0101c2e88aa'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:34.292027 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1436/2877] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:02:34 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:02:34.296512 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-1960cbcf-d9c5-4664-b636-a0101c2e88aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eecdd3e8ad241d6857ad6483943f68d', 'request_id': 'req-1960cbcf-d9c5-4664-b636-a0101c2e88aa'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:34.308633 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-1960cbcf-d9c5-4664-b636-a0101c2e88aa admin admin] The token cache is being invalidate because project 7eecdd3e8ad241d6857ad6483943f68d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91652) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:02:34.308920 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-1960cbcf-d9c5-4664-b636-a0101c2e88aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:34.310122 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-1960cbcf-d9c5-4664-b636-a0101c2e88aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:34.312053 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1442/2878] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:02:34 2022] DELETE /identity/v3/projects/7eecdd3e8ad241d6857ad6483943f68d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 21:02:34.316891 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c7b29-1e19-4327-8f79-ce2910b0378b None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:34.317180 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c7b29-1e19-4327-8f79-ce2910b0378b None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:34.317508 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c7b29-1e19-4327-8f79-ce2910b0378b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:34.336263 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-1e9c7b29-1e19-4327-8f79-ce2910b0378b None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:02:34.337476 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-1e9c7b29-1e19-4327-8f79-ce2910b0378b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:34.398810 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1437/2879] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:02:34.406422 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507f503-f304-45b4-ab2a-0d862ca2392b None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:34.406706 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507f503-f304-45b4-ab2a-0d862ca2392b None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:34.406980 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507f503-f304-45b4-ab2a-0d862ca2392b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:34.425828 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-6507f503-f304-45b4-ab2a-0d862ca2392b None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:02:34.427019 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-6507f503-f304-45b4-ab2a-0d862ca2392b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:34.435692 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1443/2880] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:02:34.439853 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c7b29-1e19-4327-8f79-ce2910b0378b None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:34.449446 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c7b29-1e19-4327-8f79-ce2910b0378b None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:34.454272 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a46bb8-84e6-4f61-8263-0a3c4b994913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:34.454864 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a46bb8-84e6-4f61-8263-0a3c4b994913 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:34.455137 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a46bb8-84e6-4f61-8263-0a3c4b994913 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:34.455405 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a46bb8-84e6-4f61-8263-0a3c4b994913 admin admin] PATH_INFO: `/v3/domains` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:34.456159 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a46bb8-84e6-4f61-8263-0a3c4b994913 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91651) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 21:02:34.456461 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a46bb8-84e6-4f61-8263-0a3c4b994913 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:34.458058 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a46bb8-84e6-4f61-8263-0a3c4b994913 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:34.473461 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1438/2881] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 21:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 21:02:34.474579 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507f503-f304-45b4-ab2a-0d862ca2392b None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:34.484382 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507f503-f304-45b4-ab2a-0d862ca2392b None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:34.489476 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9b97c-ff7f-45b4-912f-2b279884a93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:34.490148 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9b97c-ff7f-45b4-912f-2b279884a93e admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:34.490423 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9b97c-ff7f-45b4-912f-2b279884a93e admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:34.490690 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9b97c-ff7f-45b4-912f-2b279884a93e admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:34.491383 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf9b97c-ff7f-45b4-912f-2b279884a93e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:34.493299 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf9b97c-ff7f-45b4-912f-2b279884a93e admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:34.518903 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1444/2882] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 21:02:34 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:02:34.523347 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a46bb8-84e6-4f61-8263-0a3c4b994913 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:34.534693 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a46bb8-84e6-4f61-8263-0a3c4b994913 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:34.595315 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14ffce-e412-423f-bc9e-20ddacea5cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:34.596027 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14ffce-e412-423f-bc9e-20ddacea5cc9 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:34.596307 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14ffce-e412-423f-bc9e-20ddacea5cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:34.596580 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14ffce-e412-423f-bc9e-20ddacea5cc9 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:34.597275 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14ffce-e412-423f-bc9e-20ddacea5cc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:34.599224 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14ffce-e412-423f-bc9e-20ddacea5cc9 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:34.622655 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1439/2883] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 21:02:34 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:02:34.626898 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9b97c-ff7f-45b4-912f-2b279884a93e admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:34.638108 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9b97c-ff7f-45b4-912f-2b279884a93e admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:34.643548 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096e5a1-67b7-4719-941b-fec095a85ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:34.644318 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096e5a1-67b7-4719-941b-fec095a85ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:34.644595 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096e5a1-67b7-4719-941b-fec095a85ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:34.644866 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096e5a1-67b7-4719-941b-fec095a85ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:34.645591 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096e5a1-67b7-4719-941b-fec095a85ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:34.647205 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096e5a1-67b7-4719-941b-fec095a85ee8 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:34.661708 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1445/2884] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:02:34.663043 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14ffce-e412-423f-bc9e-20ddacea5cc9 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:34.673782 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14ffce-e412-423f-bc9e-20ddacea5cc9 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:34.678730 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38097e1-0631-4bc4-a52e-6cba3f3cf8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:34.679639 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38097e1-0631-4bc4-a52e-6cba3f3cf8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:34.680014 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38097e1-0631-4bc4-a52e-6cba3f3cf8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:34.680351 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38097e1-0631-4bc4-a52e-6cba3f3cf8e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:34.681183 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38097e1-0631-4bc4-a52e-6cba3f3cf8e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:34.682875 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38097e1-0631-4bc4-a52e-6cba3f3cf8e6 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:34.694646 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1440/2885] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 21:02:34.699007 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096e5a1-67b7-4719-941b-fec095a85ee8 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:34.710147 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096e5a1-67b7-4719-941b-fec095a85ee8 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:34.714926 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dfe59b-d280-4d8e-86f7-52865b1afe8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:34.716103 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfe59b-d280-4d8e-86f7-52865b1afe8d admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:34.716418 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfe59b-d280-4d8e-86f7-52865b1afe8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:34.716693 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfe59b-d280-4d8e-86f7-52865b1afe8d admin admin] PATH_INFO: `/v3/projects/136209d0e241407d968e86e0e6f84279/users/cc4743d9ea3b446b96de917b84f9673a/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:34.732117 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dfe59b-d280-4d8e-86f7-52865b1afe8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=136209d0e241407d968e86e0e6f84279, user_id=cc4743d9ea3b446b96de917b84f9673a, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:34.734786 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dfe59b-d280-4d8e-86f7-52865b1afe8d admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:34.749278 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1446/2886] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:02:34 2022] PUT /identity/v3/projects/136209d0e241407d968e86e0e6f84279/users/cc4743d9ea3b446b96de917b84f9673a/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:02:34.759760 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5550e5-ff5d-42f9-9dec-68e78d068711 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:34.760075 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5550e5-ff5d-42f9-9dec-68e78d068711 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:34.760594 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5550e5-ff5d-42f9-9dec-68e78d068711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:34.791465 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-7a5550e5-ff5d-42f9-9dec-68e78d068711 None None] MFA Rules not processed for user `cc4743d9ea3b446b96de917b84f9673a`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:02:34.792714 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-7a5550e5-ff5d-42f9-9dec-68e78d068711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:34.859781 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1441/2887] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:02:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:02:34.863837 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dfe59b-d280-4d8e-86f7-52865b1afe8d admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:34.925455 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dfe59b-d280-4d8e-86f7-52865b1afe8d admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:34.930394 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c72ff-a23d-46e2-9ec5-c786f35192bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:34.931070 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c72ff-a23d-46e2-9ec5-c786f35192bd admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:34.931361 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c72ff-a23d-46e2-9ec5-c786f35192bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:34.931808 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c72ff-a23d-46e2-9ec5-c786f35192bd admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:34.932380 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c72ff-a23d-46e2-9ec5-c786f35192bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:34.934918 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c72ff-a23d-46e2-9ec5-c786f35192bd admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:34.963456 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1447/2888] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 21:02:34 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:02:34.964686 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5550e5-ff5d-42f9-9dec-68e78d068711 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:34.976080 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5550e5-ff5d-42f9-9dec-68e78d068711 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:35.035441 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d2f60-7044-4137-849a-301101b57e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:35.036086 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d2f60-7044-4137-849a-301101b57e73 admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:35.036362 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d2f60-7044-4137-849a-301101b57e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:35.036633 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d2f60-7044-4137-849a-301101b57e73 admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:35.037323 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d2f60-7044-4137-849a-301101b57e73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:35.039242 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d2f60-7044-4137-849a-301101b57e73 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:35.063237 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1442/2889] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 21:02:34 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 21:02:35.067410 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c72ff-a23d-46e2-9ec5-c786f35192bd admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:35.079702 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c72ff-a23d-46e2-9ec5-c786f35192bd admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:35.084480 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03d1be-bd19-4084-90f0-b1767a163f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:35.085141 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03d1be-bd19-4084-90f0-b1767a163f4f admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:35.085585 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03d1be-bd19-4084-90f0-b1767a163f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:35.085864 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03d1be-bd19-4084-90f0-b1767a163f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:35.086582 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03d1be-bd19-4084-90f0-b1767a163f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:35.088196 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03d1be-bd19-4084-90f0-b1767a163f4f admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:35.098936 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1448/2890] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:02:35.102978 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d2f60-7044-4137-849a-301101b57e73 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:35.114133 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d2f60-7044-4137-849a-301101b57e73 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:35.119339 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996eef63-3df3-4ec0-95ab-5b55d88b5aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:35.120008 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996eef63-3df3-4ec0-95ab-5b55d88b5aab admin admin] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:35.120783 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996eef63-3df3-4ec0-95ab-5b55d88b5aab admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:35.120783 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996eef63-3df3-4ec0-95ab-5b55d88b5aab admin admin] PATH_INFO: `/v3/roles` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:35.121248 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996eef63-3df3-4ec0-95ab-5b55d88b5aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:35.123671 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996eef63-3df3-4ec0-95ab-5b55d88b5aab admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:35.133950 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1443/2891] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:02:35.138513 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03d1be-bd19-4084-90f0-b1767a163f4f admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:35.149887 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03d1be-bd19-4084-90f0-b1767a163f4f admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:35.154742 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adccff5-c336-4944-8d32-ce28fb95fcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:35.155611 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adccff5-c336-4944-8d32-ce28fb95fcb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:35.155918 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adccff5-c336-4944-8d32-ce28fb95fcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:35.156193 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adccff5-c336-4944-8d32-ce28fb95fcb8 admin admin] PATH_INFO: `/v3/projects/e4cf2e6408e04854b06499351e3bdb1d/users/2926ddb9b4174f56b6257f3e9bf1506c/roles/aaafbf9fe78e46cd9f06410394fdb531` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:35.171714 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adccff5-c336-4944-8d32-ce28fb95fcb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4cf2e6408e04854b06499351e3bdb1d, user_id=2926ddb9b4174f56b6257f3e9bf1506c, role_id=aaafbf9fe78e46cd9f06410394fdb531)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:35.174412 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adccff5-c336-4944-8d32-ce28fb95fcb8 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:35.191628 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1449/2892] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:02:35 2022] PUT /identity/v3/projects/e4cf2e6408e04854b06499351e3bdb1d/users/2926ddb9b4174f56b6257f3e9bf1506c/roles/aaafbf9fe78e46cd9f06410394fdb531 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:02:35.203284 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2df10-7ea3-4a13-8fa8-bb4f44f594e6 None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:35.203632 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2df10-7ea3-4a13-8fa8-bb4f44f594e6 None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:35.203956 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2df10-7ea3-4a13-8fa8-bb4f44f594e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:35.233336 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-d1f2df10-7ea3-4a13-8fa8-bb4f44f594e6 None None] MFA Rules not processed for user `2926ddb9b4174f56b6257f3e9bf1506c`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:02:35.234575 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-d1f2df10-7ea3-4a13-8fa8-bb4f44f594e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:35.305993 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1444/2893] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:02:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:02:35.311008 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adccff5-c336-4944-8d32-ce28fb95fcb8 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:35.379114 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adccff5-c336-4944-8d32-ce28fb95fcb8 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:35.383809 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b6a7b-f1ae-4508-a128-78c166422f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:35.384468 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b6a7b-f1ae-4508-a128-78c166422f72 admin admin] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:35.384744 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b6a7b-f1ae-4508-a128-78c166422f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:35.385014 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b6a7b-f1ae-4508-a128-78c166422f72 admin admin] PATH_INFO: `/v3/projects` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:35.385714 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b6a7b-f1ae-4508-a128-78c166422f72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:35.387768 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b6a7b-f1ae-4508-a128-78c166422f72 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:35.418102 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1450/2894] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 21:02:35 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 21:02:35.419864 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2df10-7ea3-4a13-8fa8-bb4f44f594e6 None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:35.430937 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2df10-7ea3-4a13-8fa8-bb4f44f594e6 None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:35.491381 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54eab10-ad01-4d32-90b4-64336762028f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:35.491985 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54eab10-ad01-4d32-90b4-64336762028f admin admin] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:35.492261 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54eab10-ad01-4d32-90b4-64336762028f admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:35.492528 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54eab10-ad01-4d32-90b4-64336762028f admin admin] PATH_INFO: `/v3/users` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:35.493212 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54eab10-ad01-4d32-90b4-64336762028f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:35.495126 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54eab10-ad01-4d32-90b4-64336762028f admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:35.516713 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1445/2895] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 21:02:35 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 21:02:35.521340 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b6a7b-f1ae-4508-a128-78c166422f72 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:35.532249 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b6a7b-f1ae-4508-a128-78c166422f72 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:35.537838 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c2b8f-e23c-4447-9fd9-933dc4b47c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:35.538498 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c2b8f-e23c-4447-9fd9-933dc4b47c28 admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:35.538822 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c2b8f-e23c-4447-9fd9-933dc4b47c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:35.539085 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c2b8f-e23c-4447-9fd9-933dc4b47c28 admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:35.539838 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c2b8f-e23c-4447-9fd9-933dc4b47c28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:35.541475 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c2b8f-e23c-4447-9fd9-933dc4b47c28 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:35.553696 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1451/2896] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:02:35.558057 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54eab10-ad01-4d32-90b4-64336762028f admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:35.568421 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54eab10-ad01-4d32-90b4-64336762028f admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:35.573463 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5844f-f265-4888-8612-dbbe018e1002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:35.574350 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5844f-f265-4888-8612-dbbe018e1002 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:35.574622 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5844f-f265-4888-8612-dbbe018e1002 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:35.575415 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5844f-f265-4888-8612-dbbe018e1002 admin admin] PATH_INFO: `/v3/projects/4fab438684d04889a51cfc8de64dedb8/users/70099edf460a454c87c8a2a4483c419a/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:35.591708 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf5844f-f265-4888-8612-dbbe018e1002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fab438684d04889a51cfc8de64dedb8, user_id=70099edf460a454c87c8a2a4483c419a, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:35.594541 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf5844f-f265-4888-8612-dbbe018e1002 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:35.608766 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1446/2897] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:02:35 2022] PUT /identity/v3/projects/4fab438684d04889a51cfc8de64dedb8/users/70099edf460a454c87c8a2a4483c419a/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 21:02:35.612665 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c2b8f-e23c-4447-9fd9-933dc4b47c28 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:35.622666 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c2b8f-e23c-4447-9fd9-933dc4b47c28 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:35.688519 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0bb9e-e1d8-4f67-84d4-cbcdba059f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:35.689198 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0bb9e-e1d8-4f67-84d4-cbcdba059f2e admin admin] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:35.689481 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0bb9e-e1d8-4f67-84d4-cbcdba059f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:35.689755 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0bb9e-e1d8-4f67-84d4-cbcdba059f2e admin admin] PATH_INFO: `/v3/roles` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:35.690516 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f0bb9e-e1d8-4f67-84d4-cbcdba059f2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:35.692178 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f0bb9e-e1d8-4f67-84d4-cbcdba059f2e admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:35.703108 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1452/2898] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 21:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 21:02:35.707094 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5844f-f265-4888-8612-dbbe018e1002 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:35.719927 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5844f-f265-4888-8612-dbbe018e1002 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:35.725705 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df80b5-3cea-4ff5-ba62-e373152177b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:35.726732 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df80b5-3cea-4ff5-ba62-e373152177b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:35.726944 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df80b5-3cea-4ff5-ba62-e373152177b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:35.727218 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df80b5-3cea-4ff5-ba62-e373152177b7 admin admin] PATH_INFO: `/v3/projects/4fab438684d04889a51cfc8de64dedb8/users/70099edf460a454c87c8a2a4483c419a/roles/8fe105eeb7bf4856a94b0633bd781414` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:35.729288 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df80b5-3cea-4ff5-ba62-e373152177b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fab438684d04889a51cfc8de64dedb8, user_id=70099edf460a454c87c8a2a4483c419a, role_id=8fe105eeb7bf4856a94b0633bd781414)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:35.732307 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df80b5-3cea-4ff5-ba62-e373152177b7 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:35.743005 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1447/2899] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 21:02:35 2022] PUT /identity/v3/projects/4fab438684d04889a51cfc8de64dedb8/users/70099edf460a454c87c8a2a4483c419a/roles/8fe105eeb7bf4856a94b0633bd781414 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:02:35.753213 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8898f3e-fcf0-4933-925f-016c9ae2c2d7 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:35.753512 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8898f3e-fcf0-4933-925f-016c9ae2c2d7 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:35.753778 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8898f3e-fcf0-4933-925f-016c9ae2c2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:35.782685 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-a8898f3e-fcf0-4933-925f-016c9ae2c2d7 None None] MFA Rules not processed for user `70099edf460a454c87c8a2a4483c419a`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:02:35.783931 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-a8898f3e-fcf0-4933-925f-016c9ae2c2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:35.854673 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1453/2900] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:02:35 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:02:35.866690 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df80b5-3cea-4ff5-ba62-e373152177b7 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:35.868581 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-d8df80b5-3cea-4ff5-ba62-e373152177b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:35.926818 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df80b5-3cea-4ff5-ba62-e373152177b7 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:35.930511 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f16b6-8f96-45af-b646-a984dc38c79c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:35.931157 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f16b6-8f96-45af-b646-a984dc38c79c service cinder] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:35.931467 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f16b6-8f96-45af-b646-a984dc38c79c service cinder] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:35.931767 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f16b6-8f96-45af-b646-a984dc38c79c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:35.988951 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f16b6-8f96-45af-b646-a984dc38c79c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:35.990401 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f16b6-8f96-45af-b646-a984dc38c79c service cinder] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:35.999491 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1448/2901] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:02:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:02:37.538878 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8898f3e-fcf0-4933-925f-016c9ae2c2d7 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:37.540349 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-a8898f3e-fcf0-4933-925f-016c9ae2c2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:37.552766 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8898f3e-fcf0-4933-925f-016c9ae2c2d7 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:37.556321 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79998686-7061-401c-833d-54662e446319 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:37.556952 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79998686-7061-401c-833d-54662e446319 service cinder] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:37.557233 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79998686-7061-401c-833d-54662e446319 service cinder] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:37.557508 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79998686-7061-401c-833d-54662e446319 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:37.613070 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79998686-7061-401c-833d-54662e446319 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:37.614429 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79998686-7061-401c-833d-54662e446319 service cinder] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:37.623572 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1454/2902] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:02:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:02:38.148040 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f16b6-8f96-45af-b646-a984dc38c79c service cinder] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:38.157600 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f16b6-8f96-45af-b646-a984dc38c79c service cinder] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:38.161328 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a474f91-88c5-4d48-b735-ea78a9458f07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f305aece531c412b9e0ac30be9f47667', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:38.161982 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a474f91-88c5-4d48-b735-ea78a9458f07 service cinder] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:38.162257 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a474f91-88c5-4d48-b735-ea78a9458f07 service cinder] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:38.162533 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a474f91-88c5-4d48-b735-ea78a9458f07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:38.172555 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a474f91-88c5-4d48-b735-ea78a9458f07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:38.173987 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a474f91-88c5-4d48-b735-ea78a9458f07 service cinder] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:38.183486 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1449/2903] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:02:38 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:02:42.047279 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79998686-7061-401c-833d-54662e446319 service cinder] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:42.110468 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79998686-7061-401c-833d-54662e446319 service cinder] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:42.115161 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd66539-a392-44f5-b975-5dc9da736d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:42.116058 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd66539-a392-44f5-b975-5dc9da736d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:42.116331 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd66539-a392-44f5-b975-5dc9da736d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:42.116598 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd66539-a392-44f5-b975-5dc9da736d0c admin admin] PATH_INFO: `/v3/users/cc4743d9ea3b446b96de917b84f9673a` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:42.117784 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd66539-a392-44f5-b975-5dc9da736d0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc4743d9ea3b446b96de917b84f9673a)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:42.119689 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd66539-a392-44f5-b975-5dc9da736d0c admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:42.167846 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-2cd66539-a392-44f5-b975-5dc9da736d0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc4743d9ea3b446b96de917b84f9673a'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:42.176557 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-2cd66539-a392-44f5-b975-5dc9da736d0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc4743d9ea3b446b96de917b84f9673a'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:42.185440 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-2cd66539-a392-44f5-b975-5dc9da736d0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc4743d9ea3b446b96de917b84f9673a'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:42.186121 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-2cd66539-a392-44f5-b975-5dc9da736d0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc4743d9ea3b446b96de917b84f9673a'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:42.198743 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-2cd66539-a392-44f5-b975-5dc9da736d0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc4743d9ea3b446b96de917b84f9673a'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:42.206861 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1455/2904] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:02:42 2022] DELETE /identity/v3/users/cc4743d9ea3b446b96de917b84f9673a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:02:42.212844 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5304d7-82ea-4dba-9ea7-0d6cb33555ff None None] REQUEST_METHOD: `POST` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:42.213902 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5304d7-82ea-4dba-9ea7-0d6cb33555ff None None] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:42.214352 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5304d7-82ea-4dba-9ea7-0d6cb33555ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:42.236440 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.auth.core [None req-ed5304d7-82ea-4dba-9ea7-0d6cb33555ff None None] MFA Rules not processed for user `57b0953dcb104303876815cf22027f50`. Rule list: `[]` (Enabled: `True`). {{(pid=91651) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:02:42.237895 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-ed5304d7-82ea-4dba-9ea7-0d6cb33555ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:42.317801 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1450/2905] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:02:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 21:02:42.356288 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd66539-a392-44f5-b975-5dc9da736d0c admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:42.357545 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-2cd66539-a392-44f5-b975-5dc9da736d0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:42.418637 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd66539-a392-44f5-b975-5dc9da736d0c admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:42.422528 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2094a-3e8e-406b-88d4-b5f7cf04d605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:42.423185 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2094a-3e8e-406b-88d4-b5f7cf04d605 service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:42.423466 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2094a-3e8e-406b-88d4-b5f7cf04d605 service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:42.423767 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2094a-3e8e-406b-88d4-b5f7cf04d605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:42.433322 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b2094a-3e8e-406b-88d4-b5f7cf04d605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:42.434942 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b2094a-3e8e-406b-88d4-b5f7cf04d605 service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:42.444797 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1456/2906] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:02:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:02:42.806449 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5304d7-82ea-4dba-9ea7-0d6cb33555ff None None] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:42.808149 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-ed5304d7-82ea-4dba-9ea7-0d6cb33555ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:42.835582 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5304d7-82ea-4dba-9ea7-0d6cb33555ff None None] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:42.841425 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee569da7-e392-497c-81aa-08d30278242f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:42.842442 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee569da7-e392-497c-81aa-08d30278242f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:42.842743 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee569da7-e392-497c-81aa-08d30278242f admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:42.842918 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee569da7-e392-497c-81aa-08d30278242f admin admin] PATH_INFO: `/v3/projects/136209d0e241407d968e86e0e6f84279` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:42.844578 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee569da7-e392-497c-81aa-08d30278242f admin admin] RBAC: Authorizing `identity:delete_project(project_id=136209d0e241407d968e86e0e6f84279)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:42.847368 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee569da7-e392-497c-81aa-08d30278242f admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:42.899711 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-ee569da7-e392-497c-81aa-08d30278242f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '136209d0e241407d968e86e0e6f84279', 'request_id': 'req-ee569da7-e392-497c-81aa-08d30278242f'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:42.906249 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-ee569da7-e392-497c-81aa-08d30278242f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '136209d0e241407d968e86e0e6f84279', 'request_id': 'req-ee569da7-e392-497c-81aa-08d30278242f'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:42.912765 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-ee569da7-e392-497c-81aa-08d30278242f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '136209d0e241407d968e86e0e6f84279', 'request_id': 'req-ee569da7-e392-497c-81aa-08d30278242f'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:42.926810 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-ee569da7-e392-497c-81aa-08d30278242f admin admin] The token cache is being invalidate because project 136209d0e241407d968e86e0e6f84279 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:02:42.927096 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-ee569da7-e392-497c-81aa-08d30278242f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:42.927763 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-ee569da7-e392-497c-81aa-08d30278242f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:42.929764 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1451/2907] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:02:42 2022] DELETE /identity/v3/projects/136209d0e241407d968e86e0e6f84279 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:02:42.933722 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2094a-3e8e-406b-88d4-b5f7cf04d605 service neutron] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:42.944065 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2094a-3e8e-406b-88d4-b5f7cf04d605 service neutron] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:43.003068 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5252ac-8a6a-4fc7-b1b9-d47cee9cc61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:43.003886 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5252ac-8a6a-4fc7-b1b9-d47cee9cc61f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:43.004175 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5252ac-8a6a-4fc7-b1b9-d47cee9cc61f admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:43.004451 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5252ac-8a6a-4fc7-b1b9-d47cee9cc61f admin admin] PATH_INFO: `/v3/users/2926ddb9b4174f56b6257f3e9bf1506c` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:43.005668 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5252ac-8a6a-4fc7-b1b9-d47cee9cc61f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2926ddb9b4174f56b6257f3e9bf1506c)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:43.007599 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5252ac-8a6a-4fc7-b1b9-d47cee9cc61f admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:43.056196 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-fe5252ac-8a6a-4fc7-b1b9-d47cee9cc61f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2926ddb9b4174f56b6257f3e9bf1506c'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:43.062993 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-fe5252ac-8a6a-4fc7-b1b9-d47cee9cc61f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2926ddb9b4174f56b6257f3e9bf1506c'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:43.070560 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-fe5252ac-8a6a-4fc7-b1b9-d47cee9cc61f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2926ddb9b4174f56b6257f3e9bf1506c'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:43.071321 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-fe5252ac-8a6a-4fc7-b1b9-d47cee9cc61f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2926ddb9b4174f56b6257f3e9bf1506c'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:43.084064 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-fe5252ac-8a6a-4fc7-b1b9-d47cee9cc61f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2926ddb9b4174f56b6257f3e9bf1506c'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:43.090140 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1457/2908] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:02:42 2022] DELETE /identity/v3/users/2926ddb9b4174f56b6257f3e9bf1506c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:02:43.359980 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee569da7-e392-497c-81aa-08d30278242f admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:43.361385 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-ee569da7-e392-497c-81aa-08d30278242f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:43.374484 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee569da7-e392-497c-81aa-08d30278242f admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:43.436037 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e568b6-5b7c-485e-9dc3-52994b80363f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:43.436904 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e568b6-5b7c-485e-9dc3-52994b80363f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:43.437209 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e568b6-5b7c-485e-9dc3-52994b80363f admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:43.437481 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e568b6-5b7c-485e-9dc3-52994b80363f admin admin] PATH_INFO: `/v3/projects/e4cf2e6408e04854b06499351e3bdb1d` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:43.438717 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e568b6-5b7c-485e-9dc3-52994b80363f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4cf2e6408e04854b06499351e3bdb1d)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:43.440667 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e568b6-5b7c-485e-9dc3-52994b80363f admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:43.488341 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-20e568b6-5b7c-485e-9dc3-52994b80363f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4cf2e6408e04854b06499351e3bdb1d', 'request_id': 'req-20e568b6-5b7c-485e-9dc3-52994b80363f'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:43.493713 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-20e568b6-5b7c-485e-9dc3-52994b80363f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4cf2e6408e04854b06499351e3bdb1d', 'request_id': 'req-20e568b6-5b7c-485e-9dc3-52994b80363f'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:43.500532 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-20e568b6-5b7c-485e-9dc3-52994b80363f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4cf2e6408e04854b06499351e3bdb1d', 'request_id': 'req-20e568b6-5b7c-485e-9dc3-52994b80363f'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:43.514429 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-20e568b6-5b7c-485e-9dc3-52994b80363f admin admin] The token cache is being invalidate because project e4cf2e6408e04854b06499351e3bdb1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:02:43.514624 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-20e568b6-5b7c-485e-9dc3-52994b80363f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:43.515363 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-20e568b6-5b7c-485e-9dc3-52994b80363f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:43.517045 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1452/2909] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:02:43 2022] DELETE /identity/v3/projects/e4cf2e6408e04854b06499351e3bdb1d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:02:43.521383 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5252ac-8a6a-4fc7-b1b9-d47cee9cc61f admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:43.523078 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-fe5252ac-8a6a-4fc7-b1b9-d47cee9cc61f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:43.536734 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5252ac-8a6a-4fc7-b1b9-d47cee9cc61f admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:43.594326 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eba229-f040-494b-b821-a497b13d9b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:43.595202 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eba229-f040-494b-b821-a497b13d9b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:43.595482 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eba229-f040-494b-b821-a497b13d9b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:43.595781 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eba229-f040-494b-b821-a497b13d9b09 admin admin] PATH_INFO: `/v3/users/70099edf460a454c87c8a2a4483c419a` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:43.597017 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eba229-f040-494b-b821-a497b13d9b09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70099edf460a454c87c8a2a4483c419a)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:43.598969 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eba229-f040-494b-b821-a497b13d9b09 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:43.646790 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-78eba229-f040-494b-b821-a497b13d9b09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70099edf460a454c87c8a2a4483c419a'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:43.654065 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-78eba229-f040-494b-b821-a497b13d9b09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70099edf460a454c87c8a2a4483c419a'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:43.661476 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-78eba229-f040-494b-b821-a497b13d9b09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70099edf460a454c87c8a2a4483c419a'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:43.662084 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-78eba229-f040-494b-b821-a497b13d9b09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70099edf460a454c87c8a2a4483c419a'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:43.675025 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-78eba229-f040-494b-b821-a497b13d9b09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70099edf460a454c87c8a2a4483c419a'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:43.680938 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1458/2910] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:02:43 2022] DELETE /identity/v3/users/70099edf460a454c87c8a2a4483c419a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:02:43.948386 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e568b6-5b7c-485e-9dc3-52994b80363f admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:02:43.950525 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-20e568b6-5b7c-485e-9dc3-52994b80363f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:02:43.963784 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e568b6-5b7c-485e-9dc3-52994b80363f admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:02:44.022856 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffd53f-5503-4942-b702-4aa91b0341b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:02:44.023634 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffd53f-5503-4942-b702-4aa91b0341b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:02:44.023939 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffd53f-5503-4942-b702-4aa91b0341b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:02:44.024213 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffd53f-5503-4942-b702-4aa91b0341b1 admin admin] PATH_INFO: `/v3/projects/4fab438684d04889a51cfc8de64dedb8` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:02:44.025393 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ffd53f-5503-4942-b702-4aa91b0341b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fab438684d04889a51cfc8de64dedb8)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:02:44.027292 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ffd53f-5503-4942-b702-4aa91b0341b1 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:02:44.072488 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-f5ffd53f-5503-4942-b702-4aa91b0341b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fab438684d04889a51cfc8de64dedb8', 'request_id': 'req-f5ffd53f-5503-4942-b702-4aa91b0341b1'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:44.078172 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-f5ffd53f-5503-4942-b702-4aa91b0341b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fab438684d04889a51cfc8de64dedb8', 'request_id': 'req-f5ffd53f-5503-4942-b702-4aa91b0341b1'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:44.084202 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-f5ffd53f-5503-4942-b702-4aa91b0341b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fab438684d04889a51cfc8de64dedb8', 'request_id': 'req-f5ffd53f-5503-4942-b702-4aa91b0341b1'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:44.097418 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-f5ffd53f-5503-4942-b702-4aa91b0341b1 admin admin] The token cache is being invalidate because project 4fab438684d04889a51cfc8de64dedb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:02:44.097703 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-f5ffd53f-5503-4942-b702-4aa91b0341b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:44.098327 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-f5ffd53f-5503-4942-b702-4aa91b0341b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:02:44.099954 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1453/2911] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:02:43 2022] DELETE /identity/v3/projects/4fab438684d04889a51cfc8de64dedb8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:03:29.912213 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eba229-f040-494b-b821-a497b13d9b09 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:03:29.913572 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-78eba229-f040-494b-b821-a497b13d9b09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:03:29.968632 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eba229-f040-494b-b821-a497b13d9b09 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:03:30.014700 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7008a7-221c-458a-be9a-3e32c0d5c805 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:03:30.015329 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7008a7-221c-458a-be9a-3e32c0d5c805 service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:03:30.015611 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7008a7-221c-458a-be9a-3e32c0d5c805 service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:03:30.015929 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7008a7-221c-458a-be9a-3e32c0d5c805 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:03:30.017972 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-ab7008a7-221c-458a-be9a-3e32c0d5c805 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:03:30.084135 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7008a7-221c-458a-be9a-3e32c0d5c805 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:03:30.085565 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7008a7-221c-458a-be9a-3e32c0d5c805 service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:03:30.096704 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1459/2912] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:03:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:03:35.468351 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffd53f-5503-4942-b702-4aa91b0341b1 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:03:35.469874 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-f5ffd53f-5503-4942-b702-4aa91b0341b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:03:35.483615 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffd53f-5503-4942-b702-4aa91b0341b1 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:03:35.487203 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247a164-8bca-4a06-a2e8-fc243175740e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:03:35.487873 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247a164-8bca-4a06-a2e8-fc243175740e service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:03:35.488156 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247a164-8bca-4a06-a2e8-fc243175740e service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:03:35.488427 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247a164-8bca-4a06-a2e8-fc243175740e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:03:35.490210 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-5247a164-8bca-4a06-a2e8-fc243175740e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:03:35.503762 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247a164-8bca-4a06-a2e8-fc243175740e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:03:35.505206 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247a164-8bca-4a06-a2e8-fc243175740e service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:03:35.516491 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1454/2913] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:03:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:03:37.866837 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c19aa-dd76-42f6-b511-5fbd37090867 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:03:37.867358 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c19aa-dd76-42f6-b511-5fbd37090867 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:03:37.867358 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c19aa-dd76-42f6-b511-5fbd37090867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:03:37.886457 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-865c19aa-dd76-42f6-b511-5fbd37090867 None None] MFA Rules not processed for user `78cde480dd8b4a85ac30895026bfc406`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:03:37.887655 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-865c19aa-dd76-42f6-b511-5fbd37090867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:03:37.940601 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1460/2914] 10.222.0.49 () {58 vars in 967 bytes} [Fri Oct 28 21:03:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:03:37.991501 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247a164-8bca-4a06-a2e8-fc243175740e service neutron] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:03:37.993737 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-5247a164-8bca-4a06-a2e8-fc243175740e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:03:38.061014 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247a164-8bca-4a06-a2e8-fc243175740e service neutron] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:03:38.066074 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c4c02-fb32-4945-b981-715719026aea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d70db11d2d4923943bc6479bc49206', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:03:38.066715 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c4c02-fb32-4945-b981-715719026aea service swift] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:03:38.067000 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c4c02-fb32-4945-b981-715719026aea service swift] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:03:38.067272 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c4c02-fb32-4945-b981-715719026aea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:03:38.075133 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c4c02-fb32-4945-b981-715719026aea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:03:38.077331 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c4c02-fb32-4945-b981-715719026aea service swift] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:03:38.085144 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1455/2915] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Oct 28 21:03:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 21:03:45.013318 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c19aa-dd76-42f6-b511-5fbd37090867 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:03:45.015636 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-865c19aa-dd76-42f6-b511-5fbd37090867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:03:45.080679 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c19aa-dd76-42f6-b511-5fbd37090867 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:03:45.085284 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfee316-7fd0-46b3-96ac-48793983ff48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:03:45.086138 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfee316-7fd0-46b3-96ac-48793983ff48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:03:45.086415 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfee316-7fd0-46b3-96ac-48793983ff48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:03:45.086685 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfee316-7fd0-46b3-96ac-48793983ff48 admin admin] PATH_INFO: `/v3/users/37094f974c164d50890b46d0581ebf9c` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:03:45.087911 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfee316-7fd0-46b3-96ac-48793983ff48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37094f974c164d50890b46d0581ebf9c)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:03:45.089809 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfee316-7fd0-46b3-96ac-48793983ff48 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:03:45.134428 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-2cfee316-7fd0-46b3-96ac-48793983ff48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37094f974c164d50890b46d0581ebf9c'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:03:45.141710 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-2cfee316-7fd0-46b3-96ac-48793983ff48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37094f974c164d50890b46d0581ebf9c'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:03:45.149275 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-2cfee316-7fd0-46b3-96ac-48793983ff48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37094f974c164d50890b46d0581ebf9c'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:03:45.149947 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-2cfee316-7fd0-46b3-96ac-48793983ff48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37094f974c164d50890b46d0581ebf9c'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:03:45.161352 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-2cfee316-7fd0-46b3-96ac-48793983ff48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37094f974c164d50890b46d0581ebf9c'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:03:45.167121 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1461/2916] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:03:45 2022] DELETE /identity/v3/users/37094f974c164d50890b46d0581ebf9c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:03:45.347986 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c4c02-fb32-4945-b981-715719026aea service swift] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:03:45.359551 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c4c02-fb32-4945-b981-715719026aea service swift] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:03:45.416202 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa617a3c-d0b3-4230-831f-5ccf58304882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:03:45.417017 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa617a3c-d0b3-4230-831f-5ccf58304882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:03:45.417233 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa617a3c-d0b3-4230-831f-5ccf58304882 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:03:45.417496 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa617a3c-d0b3-4230-831f-5ccf58304882 admin admin] PATH_INFO: `/v3/projects/a2ca6052d1b140e5a90e38d9252d5fd6` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:03:45.418680 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa617a3c-d0b3-4230-831f-5ccf58304882 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2ca6052d1b140e5a90e38d9252d5fd6)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:03:45.421082 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa617a3c-d0b3-4230-831f-5ccf58304882 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:03:45.465504 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-fa617a3c-d0b3-4230-831f-5ccf58304882 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2ca6052d1b140e5a90e38d9252d5fd6', 'request_id': 'req-fa617a3c-d0b3-4230-831f-5ccf58304882'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:03:45.470967 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-fa617a3c-d0b3-4230-831f-5ccf58304882 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2ca6052d1b140e5a90e38d9252d5fd6', 'request_id': 'req-fa617a3c-d0b3-4230-831f-5ccf58304882'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:03:45.477577 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-fa617a3c-d0b3-4230-831f-5ccf58304882 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2ca6052d1b140e5a90e38d9252d5fd6', 'request_id': 'req-fa617a3c-d0b3-4230-831f-5ccf58304882'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:03:45.489745 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-fa617a3c-d0b3-4230-831f-5ccf58304882 admin admin] The token cache is being invalidate because project a2ca6052d1b140e5a90e38d9252d5fd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:03:45.490015 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-fa617a3c-d0b3-4230-831f-5ccf58304882 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:03:45.490629 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-fa617a3c-d0b3-4230-831f-5ccf58304882 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:03:45.492215 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1456/2917] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:03:45 2022] DELETE /identity/v3/projects/a2ca6052d1b140e5a90e38d9252d5fd6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:03:45.496206 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfee316-7fd0-46b3-96ac-48793983ff48 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:03:45.497579 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-2cfee316-7fd0-46b3-96ac-48793983ff48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:03:45.511339 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfee316-7fd0-46b3-96ac-48793983ff48 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:03:45.565055 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d35f7-9469-41f6-a60d-443606d70878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:03:45.565914 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d35f7-9469-41f6-a60d-443606d70878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:03:45.566194 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d35f7-9469-41f6-a60d-443606d70878 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:03:45.566467 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d35f7-9469-41f6-a60d-443606d70878 admin admin] PATH_INFO: `/v3/users/2403d027c96b4e689c06443518cd19aa` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:03:45.567639 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d35f7-9469-41f6-a60d-443606d70878 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2403d027c96b4e689c06443518cd19aa)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:03:45.569639 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d35f7-9469-41f6-a60d-443606d70878 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:03:45.612885 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-926d35f7-9469-41f6-a60d-443606d70878 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2403d027c96b4e689c06443518cd19aa'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:03:45.619478 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-926d35f7-9469-41f6-a60d-443606d70878 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2403d027c96b4e689c06443518cd19aa'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:03:45.628242 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-926d35f7-9469-41f6-a60d-443606d70878 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2403d027c96b4e689c06443518cd19aa'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:03:45.628880 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-926d35f7-9469-41f6-a60d-443606d70878 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2403d027c96b4e689c06443518cd19aa'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:03:45.640959 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-926d35f7-9469-41f6-a60d-443606d70878 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2403d027c96b4e689c06443518cd19aa'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:03:45.647030 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1462/2918] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:03:45 2022] DELETE /identity/v3/users/2403d027c96b4e689c06443518cd19aa => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:03:45.824123 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa617a3c-d0b3-4230-831f-5ccf58304882 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:03:45.825625 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-fa617a3c-d0b3-4230-831f-5ccf58304882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:03:45.838608 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa617a3c-d0b3-4230-831f-5ccf58304882 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:03:45.899802 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7ea04-363d-4d72-97f0-b03749869843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:03:45.900667 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7ea04-363d-4d72-97f0-b03749869843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:03:45.900946 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7ea04-363d-4d72-97f0-b03749869843 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:03:45.901220 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7ea04-363d-4d72-97f0-b03749869843 admin admin] PATH_INFO: `/v3/projects/97611f6926764d3c89aa0dfbf332330e` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:03:45.902398 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7ea04-363d-4d72-97f0-b03749869843 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97611f6926764d3c89aa0dfbf332330e)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:03:45.904341 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7ea04-363d-4d72-97f0-b03749869843 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:03:45.949458 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-73a7ea04-363d-4d72-97f0-b03749869843 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97611f6926764d3c89aa0dfbf332330e', 'request_id': 'req-73a7ea04-363d-4d72-97f0-b03749869843'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:03:45.954572 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-73a7ea04-363d-4d72-97f0-b03749869843 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97611f6926764d3c89aa0dfbf332330e', 'request_id': 'req-73a7ea04-363d-4d72-97f0-b03749869843'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:03:45.960807 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-73a7ea04-363d-4d72-97f0-b03749869843 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97611f6926764d3c89aa0dfbf332330e', 'request_id': 'req-73a7ea04-363d-4d72-97f0-b03749869843'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:03:45.973575 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-73a7ea04-363d-4d72-97f0-b03749869843 admin admin] The token cache is being invalidate because project 97611f6926764d3c89aa0dfbf332330e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:03:45.973859 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-73a7ea04-363d-4d72-97f0-b03749869843 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:03:45.974586 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-73a7ea04-363d-4d72-97f0-b03749869843 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:03:45.976242 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1457/2919] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:03:45 2022] DELETE /identity/v3/projects/97611f6926764d3c89aa0dfbf332330e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:04:37.101773 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092960b0-983e-4509-947a-f7267080b407 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:04:37.102334 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092960b0-983e-4509-947a-f7267080b407 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:04:37.102334 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092960b0-983e-4509-947a-f7267080b407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:04:37.120744 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-092960b0-983e-4509-947a-f7267080b407 None None] MFA Rules not processed for user `de477cdd9c8b4ad49c6eac58f107318a`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:04:37.122104 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-092960b0-983e-4509-947a-f7267080b407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:04:37.183010 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1463/2920] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:04:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:04:37.964396 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7ea04-363d-4d72-97f0-b03749869843 admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:04:37.965907 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-73a7ea04-363d-4d72-97f0-b03749869843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:04:38.039699 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7ea04-363d-4d72-97f0-b03749869843 admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:04:38.044674 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f32973-d50f-4e29-827a-8597b0075420 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '938634e835b94a75af698aef6941958f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:04:38.045320 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f32973-d50f-4e29-827a-8597b0075420 service placement] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:04:38.045600 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f32973-d50f-4e29-827a-8597b0075420 service placement] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:04:38.045870 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f32973-d50f-4e29-827a-8597b0075420 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:04:38.047993 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-d9f32973-d50f-4e29-827a-8597b0075420 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:04:38.059431 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f32973-d50f-4e29-827a-8597b0075420 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:04:38.061043 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f32973-d50f-4e29-827a-8597b0075420 service placement] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:04:38.071632 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1458/2921] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:04:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:04:39.755770 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092960b0-983e-4509-947a-f7267080b407 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:04:39.757242 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-092960b0-983e-4509-947a-f7267080b407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:04:39.818717 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092960b0-983e-4509-947a-f7267080b407 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:04:39.822479 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635f8f1-ce6f-4048-acf8-ec113dd6e8d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:04:39.823118 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635f8f1-ce6f-4048-acf8-ec113dd6e8d0 service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:04:39.823423 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635f8f1-ce6f-4048-acf8-ec113dd6e8d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:04:39.823701 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635f8f1-ce6f-4048-acf8-ec113dd6e8d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:04:39.825522 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-0635f8f1-ce6f-4048-acf8-ec113dd6e8d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:04:39.837369 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635f8f1-ce6f-4048-acf8-ec113dd6e8d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:04:39.838859 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635f8f1-ce6f-4048-acf8-ec113dd6e8d0 service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:04:39.848698 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1464/2922] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:04:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:04:52.468772 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f32973-d50f-4e29-827a-8597b0075420 service placement] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:04:52.471202 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-d9f32973-d50f-4e29-827a-8597b0075420 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:04:52.595557 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f32973-d50f-4e29-827a-8597b0075420 service placement] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:04:52.601167 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7169d-888d-4568-991e-5f7f14010beb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:04:52.601808 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7169d-888d-4568-991e-5f7f14010beb service nova] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:04:52.602084 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7169d-888d-4568-991e-5f7f14010beb service nova] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:04:52.602378 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7169d-888d-4568-991e-5f7f14010beb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:04:52.604198 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-bfa7169d-888d-4568-991e-5f7f14010beb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:04:52.616651 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7169d-888d-4568-991e-5f7f14010beb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:04:52.618216 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7169d-888d-4568-991e-5f7f14010beb service nova] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:04:52.628997 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1459/2923] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:04:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:04:56.483562 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635f8f1-ce6f-4048-acf8-ec113dd6e8d0 service neutron] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:04:56.507510 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635f8f1-ce6f-4048-acf8-ec113dd6e8d0 service neutron] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:04:56.513370 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d045e9a-32ec-4a9f-a889-ad65ff133072 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:04:56.514057 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d045e9a-32ec-4a9f-a889-ad65ff133072 service nova] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:04:56.514338 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d045e9a-32ec-4a9f-a889-ad65ff133072 service nova] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:04:56.514613 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d045e9a-32ec-4a9f-a889-ad65ff133072 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:04:56.516886 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-1d045e9a-32ec-4a9f-a889-ad65ff133072 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:04:56.529360 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d045e9a-32ec-4a9f-a889-ad65ff133072 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:04:56.531609 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d045e9a-32ec-4a9f-a889-ad65ff133072 service nova] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:04:56.542452 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1465/2924] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:04:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:05:54.490291 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7169d-888d-4568-991e-5f7f14010beb service nova] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:05:54.491904 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-bfa7169d-888d-4568-991e-5f7f14010beb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:05:54.527684 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7169d-888d-4568-991e-5f7f14010beb service nova] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:05:54.532620 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c04606-b925-4ef3-893d-332d2fec5e72 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '938634e835b94a75af698aef6941958f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:05:54.533272 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c04606-b925-4ef3-893d-332d2fec5e72 service placement] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:05:54.533545 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c04606-b925-4ef3-893d-332d2fec5e72 service placement] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:05:54.533812 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c04606-b925-4ef3-893d-332d2fec5e72 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:05:54.535548 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-a5c04606-b925-4ef3-893d-332d2fec5e72 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:05:54.547421 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c04606-b925-4ef3-893d-332d2fec5e72 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:05:54.549022 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c04606-b925-4ef3-893d-332d2fec5e72 service placement] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:05:54.558809 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1460/2925] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:05:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:06:33.262492 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ad621-950a-4f99-bebe-bd4883aeb0c0 None None] REQUEST_METHOD: `POST` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:06:33.263043 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ad621-950a-4f99-bebe-bd4883aeb0c0 None None] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:06:33.263043 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ad621-950a-4f99-bebe-bd4883aeb0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:06:33.281284 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.auth.core [None req-598ad621-950a-4f99-bebe-bd4883aeb0c0 None None] MFA Rules not processed for user `de477cdd9c8b4ad49c6eac58f107318a`. Rule list: `[]` (Enabled: `True`). {{(pid=91652) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 21:06:33.282511 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-598ad621-950a-4f99-bebe-bd4883aeb0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:06:33.289325 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1466/2926] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 21:06:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 21:06:33.605679 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c04606-b925-4ef3-893d-332d2fec5e72 service placement] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:06:33.607057 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-a5c04606-b925-4ef3-893d-332d2fec5e72 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:06:33.640535 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c04606-b925-4ef3-893d-332d2fec5e72 service placement] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:06:33.644352 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831da5e-32f8-4e9e-ac4e-38e624f1d4f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:06:33.644986 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831da5e-32f8-4e9e-ac4e-38e624f1d4f5 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:06:33.645257 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831da5e-32f8-4e9e-ac4e-38e624f1d4f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:06:33.645519 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831da5e-32f8-4e9e-ac4e-38e624f1d4f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:06:33.647239 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-4831da5e-32f8-4e9e-ac4e-38e624f1d4f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:06:33.656723 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4831da5e-32f8-4e9e-ac4e-38e624f1d4f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:06:33.658137 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4831da5e-32f8-4e9e-ac4e-38e624f1d4f5 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:06:33.665997 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1461/2927] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:06:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:06:36.413605 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ad621-950a-4f99-bebe-bd4883aeb0c0 None None] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:06:36.416485 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-598ad621-950a-4f99-bebe-bd4883aeb0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:06:36.470016 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ad621-950a-4f99-bebe-bd4883aeb0c0 None None] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:06:36.475912 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4f6f5-5784-40e4-b3ff-03c76e9036f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:06:36.476560 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4f6f5-5784-40e4-b3ff-03c76e9036f7 service nova] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:06:36.476838 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4f6f5-5784-40e4-b3ff-03c76e9036f7 service nova] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:06:36.477111 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4f6f5-5784-40e4-b3ff-03c76e9036f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:06:36.478891 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-1ec4f6f5-5784-40e4-b3ff-03c76e9036f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:06:36.491959 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4f6f5-5784-40e4-b3ff-03c76e9036f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:06:36.493571 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4f6f5-5784-40e4-b3ff-03c76e9036f7 service nova] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:06:36.505406 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1467/2928] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:06:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:06:48.102962 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831da5e-32f8-4e9e-ac4e-38e624f1d4f5 service neutron] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:06:48.116095 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831da5e-32f8-4e9e-ac4e-38e624f1d4f5 service neutron] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:06:48.121571 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20697da4-f81a-46f3-a1fe-fdd77eede7c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04bc6ee009e34a5f82e2807db51523d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:06:48.122205 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20697da4-f81a-46f3-a1fe-fdd77eede7c1 service nova] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:06:48.122484 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20697da4-f81a-46f3-a1fe-fdd77eede7c1 service nova] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:06:48.122755 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20697da4-f81a-46f3-a1fe-fdd77eede7c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:06:48.124553 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-20697da4-f81a-46f3-a1fe-fdd77eede7c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:06:48.135229 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20697da4-f81a-46f3-a1fe-fdd77eede7c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:06:48.136861 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20697da4-f81a-46f3-a1fe-fdd77eede7c1 service nova] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:06:48.149234 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1462/2929] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:06:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:08:30.489261 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4f6f5-5784-40e4-b3ff-03c76e9036f7 service nova] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:08:30.500168 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4f6f5-5784-40e4-b3ff-03c76e9036f7 service nova] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:08:30.504136 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8fc8d-d1fd-48b7-ad8c-5f70dca893cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:08:30.504786 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8fc8d-d1fd-48b7-ad8c-5f70dca893cc service neutron] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:08:30.505062 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8fc8d-d1fd-48b7-ad8c-5f70dca893cc service neutron] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:08:30.505331 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8fc8d-d1fd-48b7-ad8c-5f70dca893cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:08:30.508136 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-daf8fc8d-d1fd-48b7-ad8c-5f70dca893cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:08:30.525006 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8fc8d-d1fd-48b7-ad8c-5f70dca893cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:08:30.526645 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8fc8d-d1fd-48b7-ad8c-5f70dca893cc service neutron] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:08:30.540184 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1468/2930] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:08:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:08:34.749254 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20697da4-f81a-46f3-a1fe-fdd77eede7c1 service nova] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:08:34.759145 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20697da4-f81a-46f3-a1fe-fdd77eede7c1 service nova] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:08:34.762675 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa0e43-94fe-4659-9535-ca21dc1cb058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691a2da563a84da48ca8fd75a0bfe787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:08:34.763328 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa0e43-94fe-4659-9535-ca21dc1cb058 service neutron] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:08:34.763885 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa0e43-94fe-4659-9535-ca21dc1cb058 service neutron] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:08:34.764158 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa0e43-94fe-4659-9535-ca21dc1cb058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:08:34.766009 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-3efa0e43-94fe-4659-9535-ca21dc1cb058 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:08:34.849594 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa0e43-94fe-4659-9535-ca21dc1cb058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:08:34.851702 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa0e43-94fe-4659-9535-ca21dc1cb058 service neutron] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:08:34.871014 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1463/2931] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:08:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:08:37.893070 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8fc8d-d1fd-48b7-ad8c-5f70dca893cc service neutron] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:08:37.906984 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8fc8d-d1fd-48b7-ad8c-5f70dca893cc service neutron] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:08:37.914634 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0c2f0-64b1-48c3-918c-7e74d2debc76 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '938634e835b94a75af698aef6941958f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:08:37.915528 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0c2f0-64b1-48c3-918c-7e74d2debc76 service placement] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:08:37.915835 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0c2f0-64b1-48c3-918c-7e74d2debc76 service placement] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:08:37.916114 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0c2f0-64b1-48c3-918c-7e74d2debc76 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:08:37.917921 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-eee0c2f0-64b1-48c3-918c-7e74d2debc76 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:08:37.931377 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee0c2f0-64b1-48c3-918c-7e74d2debc76 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:08:37.933004 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee0c2f0-64b1-48c3-918c-7e74d2debc76 service placement] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:08:37.944964 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1469/2932] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:08:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:08:40.871200 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa0e43-94fe-4659-9535-ca21dc1cb058 service neutron] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:08:40.883667 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa0e43-94fe-4659-9535-ca21dc1cb058 service neutron] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:08:40.895252 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc9afb-e677-4ff9-b384-c60d49515372 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '938634e835b94a75af698aef6941958f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:08:40.895949 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc9afb-e677-4ff9-b384-c60d49515372 service placement] REQUEST_METHOD: `GET` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:08:40.896226 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc9afb-e677-4ff9-b384-c60d49515372 service placement] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:08:40.896492 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc9afb-e677-4ff9-b384-c60d49515372 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:08:40.898936 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-b4dc9afb-e677-4ff9-b384-c60d49515372 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:08:40.913202 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc9afb-e677-4ff9-b384-c60d49515372 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:08:40.915574 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc9afb-e677-4ff9-b384-c60d49515372 service placement] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:08:40.924456 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0c2f0-64b1-48c3-918c-7e74d2debc76 service placement] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:08:40.927459 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-eee0c2f0-64b1-48c3-918c-7e74d2debc76 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:08:40.930313 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1464/2933] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:08:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 21:08:40.941262 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0c2f0-64b1-48c3-918c-7e74d2debc76 service placement] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:08:40.946075 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d23eca-736b-4f9d-bbf8-3bc05e0c7097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:08:40.946937 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d23eca-736b-4f9d-bbf8-3bc05e0c7097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:08:40.947212 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d23eca-736b-4f9d-bbf8-3bc05e0c7097 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:08:40.947482 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d23eca-736b-4f9d-bbf8-3bc05e0c7097 admin admin] PATH_INFO: `/v3/users/de477cdd9c8b4ad49c6eac58f107318a` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:08:40.950983 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d23eca-736b-4f9d-bbf8-3bc05e0c7097 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de477cdd9c8b4ad49c6eac58f107318a)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:08:40.952939 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d23eca-736b-4f9d-bbf8-3bc05e0c7097 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:08:40.998229 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-99d23eca-736b-4f9d-bbf8-3bc05e0c7097 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de477cdd9c8b4ad49c6eac58f107318a'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:08:41.004697 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-99d23eca-736b-4f9d-bbf8-3bc05e0c7097 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de477cdd9c8b4ad49c6eac58f107318a'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:08:41.013688 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-99d23eca-736b-4f9d-bbf8-3bc05e0c7097 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de477cdd9c8b4ad49c6eac58f107318a'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:08:41.014358 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-99d23eca-736b-4f9d-bbf8-3bc05e0c7097 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de477cdd9c8b4ad49c6eac58f107318a'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:08:41.026004 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-99d23eca-736b-4f9d-bbf8-3bc05e0c7097 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de477cdd9c8b4ad49c6eac58f107318a'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:08:41.031755 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1470/2934] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:08:40 2022] DELETE /identity/v3/users/de477cdd9c8b4ad49c6eac58f107318a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:08:41.200401 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc9afb-e677-4ff9-b384-c60d49515372 service placement] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:08:41.212503 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc9afb-e677-4ff9-b384-c60d49515372 service placement] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:08:41.277783 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250240b-1fbd-4850-afb8-d9687a2d9b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:08:41.278646 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250240b-1fbd-4850-afb8-d9687a2d9b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:08:41.278922 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250240b-1fbd-4850-afb8-d9687a2d9b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:08:41.279195 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250240b-1fbd-4850-afb8-d9687a2d9b8b admin admin] PATH_INFO: `/v3/projects/fa451a74d7364a499fa109c6e840ce23` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:08:41.280391 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d250240b-1fbd-4850-afb8-d9687a2d9b8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa451a74d7364a499fa109c6e840ce23)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:08:41.282284 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d250240b-1fbd-4850-afb8-d9687a2d9b8b admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:08:41.328289 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-d250240b-1fbd-4850-afb8-d9687a2d9b8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa451a74d7364a499fa109c6e840ce23', 'request_id': 'req-d250240b-1fbd-4850-afb8-d9687a2d9b8b'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:08:41.333571 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-d250240b-1fbd-4850-afb8-d9687a2d9b8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa451a74d7364a499fa109c6e840ce23', 'request_id': 'req-d250240b-1fbd-4850-afb8-d9687a2d9b8b'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:08:41.340257 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-d250240b-1fbd-4850-afb8-d9687a2d9b8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa451a74d7364a499fa109c6e840ce23', 'request_id': 'req-d250240b-1fbd-4850-afb8-d9687a2d9b8b'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:08:41.352513 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-d250240b-1fbd-4850-afb8-d9687a2d9b8b admin admin] The token cache is being invalidate because project fa451a74d7364a499fa109c6e840ce23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:08:41.352796 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-d250240b-1fbd-4850-afb8-d9687a2d9b8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:08:41.353419 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-d250240b-1fbd-4850-afb8-d9687a2d9b8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:08:41.354941 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1465/2935] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:08:41 2022] DELETE /identity/v3/projects/fa451a74d7364a499fa109c6e840ce23 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:08:41.359261 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d23eca-736b-4f9d-bbf8-3bc05e0c7097 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:08:41.361500 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-99d23eca-736b-4f9d-bbf8-3bc05e0c7097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:08:41.375066 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d23eca-736b-4f9d-bbf8-3bc05e0c7097 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:08:41.430960 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86ed2b-d24b-4bb5-9a95-b1d9b11e3796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:08:41.431892 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86ed2b-d24b-4bb5-9a95-b1d9b11e3796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:08:41.432168 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86ed2b-d24b-4bb5-9a95-b1d9b11e3796 admin admin] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:08:41.432433 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86ed2b-d24b-4bb5-9a95-b1d9b11e3796 admin admin] PATH_INFO: `/v3/users/60d0ed1f71c3433c8afe8668bee0b836` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:08:41.433595 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86ed2b-d24b-4bb5-9a95-b1d9b11e3796 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60d0ed1f71c3433c8afe8668bee0b836)` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:08:41.435562 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86ed2b-d24b-4bb5-9a95-b1d9b11e3796 admin admin] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:08:41.481119 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-1e86ed2b-d24b-4bb5-9a95-b1d9b11e3796 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60d0ed1f71c3433c8afe8668bee0b836'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:08:41.487949 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-1e86ed2b-d24b-4bb5-9a95-b1d9b11e3796 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60d0ed1f71c3433c8afe8668bee0b836'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:08:41.495219 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-1e86ed2b-d24b-4bb5-9a95-b1d9b11e3796 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60d0ed1f71c3433c8afe8668bee0b836'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:08:41.495849 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-1e86ed2b-d24b-4bb5-9a95-b1d9b11e3796 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60d0ed1f71c3433c8afe8668bee0b836'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:08:41.507620 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.notifications [None req-1e86ed2b-d24b-4bb5-9a95-b1d9b11e3796 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60d0ed1f71c3433c8afe8668bee0b836'} {{(pid=91652) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:08:41.513639 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1471/2936] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 21:08:41 2022] DELETE /identity/v3/users/60d0ed1f71c3433c8afe8668bee0b836 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:08:41.685456 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250240b-1fbd-4850-afb8-d9687a2d9b8b admin admin] Authenticating user token {{(pid=91651) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:08:41.686960 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.fernet_utils [None req-d250240b-1fbd-4850-afb8-d9687a2d9b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91651) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:08:41.700666 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250240b-1fbd-4850-afb8-d9687a2d9b8b admin admin] Validating token access rules against request {{(pid=91651) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:08:41.757140 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bea367-a6cd-4e04-b51e-f0e2c88f0887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57b0953dcb104303876815cf22027f50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ac39942cf3a45f18781d7210d0aa25e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91651) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:08:41.758028 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bea367-a6cd-4e04-b51e-f0e2c88f0887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:08:41.758333 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bea367-a6cd-4e04-b51e-f0e2c88f0887 admin admin] SCRIPT_NAME: `/identity` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:08:41.758604 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bea367-a6cd-4e04-b51e-f0e2c88f0887 admin admin] PATH_INFO: `/v3/projects/01c6be4239274a17996adbefbf96ff1c` {{(pid=91651) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:08:41.759823 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bea367-a6cd-4e04-b51e-f0e2c88f0887 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01c6be4239274a17996adbefbf96ff1c)` {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:08:41.761727 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bea367-a6cd-4e04-b51e-f0e2c88f0887 admin admin] RBAC: Authorization granted {{(pid=91651) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:08:41.806491 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-62bea367-a6cd-4e04-b51e-f0e2c88f0887 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01c6be4239274a17996adbefbf96ff1c', 'request_id': 'req-62bea367-a6cd-4e04-b51e-f0e2c88f0887'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:08:41.811896 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-62bea367-a6cd-4e04-b51e-f0e2c88f0887 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01c6be4239274a17996adbefbf96ff1c', 'request_id': 'req-62bea367-a6cd-4e04-b51e-f0e2c88f0887'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:08:41.818232 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-62bea367-a6cd-4e04-b51e-f0e2c88f0887 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01c6be4239274a17996adbefbf96ff1c', 'request_id': 'req-62bea367-a6cd-4e04-b51e-f0e2c88f0887'} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:08:41.833587 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-62bea367-a6cd-4e04-b51e-f0e2c88f0887 admin admin] The token cache is being invalidate because project 01c6be4239274a17996adbefbf96ff1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91651) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 21:08:41.833876 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-62bea367-a6cd-4e04-b51e-f0e2c88f0887 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:08:41.834582 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: DEBUG keystone.notifications [None req-62bea367-a6cd-4e04-b51e-f0e2c88f0887 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91651) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 21:08:41.836170 dv-cinder-859839-2-iscsi devstack@keystone.service[91651]: [pid: 91651|app: 0|req: 1466/2937] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 21:08:41 2022] DELETE /identity/v3/projects/01c6be4239274a17996adbefbf96ff1c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 21:11:00.397461 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86ed2b-d24b-4bb5-9a95-b1d9b11e3796 admin admin] Authenticating user token {{(pid=91652) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 21:11:00.398871 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-1e86ed2b-d24b-4bb5-9a95-b1d9b11e3796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:11:00.465101 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86ed2b-d24b-4bb5-9a95-b1d9b11e3796 admin admin] Validating token access rules against request {{(pid=91652) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 21:11:00.521612 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372943de-7554-4255-a1a8-0c767561bd4b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '938634e835b94a75af698aef6941958f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c55c2ee59af14cf8a7e4275de4f43037', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91652) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 21:11:00.522182 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372943de-7554-4255-a1a8-0c767561bd4b service placement] REQUEST_METHOD: `GET` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 21:11:00.522464 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372943de-7554-4255-a1a8-0c767561bd4b service placement] SCRIPT_NAME: `/identity` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 21:11:00.522736 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372943de-7554-4255-a1a8-0c767561bd4b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91652) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 21:11:00.524519 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.fernet_utils [None req-372943de-7554-4255-a1a8-0c767561bd4b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91652) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 21:11:00.535404 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372943de-7554-4255-a1a8-0c767561bd4b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 21:11:00.536993 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372943de-7554-4255-a1a8-0c767561bd4b service placement] RBAC: Authorization granted {{(pid=91652) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 21:11:00.547111 dv-cinder-859839-2-iscsi devstack@keystone.service[91652]: [pid: 91652|app: 0|req: 1472/2938] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 21:11:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)